[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:10:00.590772 27432 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.202.62:46781
I20260709 13:10:00.592842 27432 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:10:00.594058 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:00.614384 27441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.614370 27439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.615474 27432 server_base.cc:1061] running on GCE node
W20260709 13:10:00.614392 27438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:01.858798 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:01.859081 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:01.859371 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602601859324 us; error 0 us; skew 500 ppm
I20260709 13:10:01.860314 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:01.868554 27432 webserver.cc:533] Webserver started at http://127.26.202.62:46711/ using document root <none> and password file <none>
I20260709 13:10:01.869649 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:01.869922 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:01.870481 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:01.877226 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/master-0-root/instance:
uuid: "d6da5484e88948e3b51f0856d5b92503"
format_stamp: "Formatted at 2026-07-09 13:10:01 on dist-test-slave-008w"
I20260709 13:10:01.887384 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:01.893649 27447 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:01.895053 27432 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:01.895514 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/master-0-root
uuid: "d6da5484e88948e3b51f0856d5b92503"
format_stamp: "Formatted at 2026-07-09 13:10:01 on dist-test-slave-008w"
I20260709 13:10:01.895871 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:01.954028 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:01.955720 27432 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:10:01.956408 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.048040 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.62:46781
I20260709 13:10:02.048878 27498 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.62:46781 every 8 connection(s)
I20260709 13:10:02.058193 27499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.083547 27499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503: Bootstrap starting.
I20260709 13:10:02.090474 27499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.092515 27499 log.cc:826] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503: Log is configured to *not* fsync() on all Append() calls
I20260709 13:10:02.097805 27499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503: No bootstrap required, opened a new log
I20260709 13:10:02.119798 27499 raft_consensus.cc:359] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6da5484e88948e3b51f0856d5b92503" member_type: VOTER }
I20260709 13:10:02.120388 27499 raft_consensus.cc:385] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.120590 27499 raft_consensus.cc:740] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6da5484e88948e3b51f0856d5b92503, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.121486 27499 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6da5484e88948e3b51f0856d5b92503" member_type: VOTER }
I20260709 13:10:02.121995 27499 raft_consensus.cc:399] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:02.122263 27499 raft_consensus.cc:493] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:02.122846 27499 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.128283 27499 raft_consensus.cc:515] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6da5484e88948e3b51f0856d5b92503" member_type: VOTER }
I20260709 13:10:02.129522 27499 leader_election.cc:304] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6da5484e88948e3b51f0856d5b92503; no voters: 
I20260709 13:10:02.131884 27499 leader_election.cc:290] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:02.132135 27502 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.134852 27502 raft_consensus.cc:697] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 1 LEADER]: Becoming Leader. State: Replica: d6da5484e88948e3b51f0856d5b92503, State: Running, Role: LEADER
I20260709 13:10:02.135960 27502 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6da5484e88948e3b51f0856d5b92503" member_type: VOTER }
I20260709 13:10:02.137104 27499 sys_catalog.cc:565] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:02.153892 27504 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6da5484e88948e3b51f0856d5b92503" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6da5484e88948e3b51f0856d5b92503" member_type: VOTER } }
I20260709 13:10:02.154412 27503 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6da5484e88948e3b51f0856d5b92503. Latest consensus state: current_term: 1 leader_uuid: "d6da5484e88948e3b51f0856d5b92503" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6da5484e88948e3b51f0856d5b92503" member_type: VOTER } }
I20260709 13:10:02.155110 27503 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:02.155079 27504 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:02.159740 27511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:02.171957 27511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:02.174460 27432 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:02.191144 27511 catalog_manager.cc:1383] Generated new cluster ID: a3933251ecba41cc8c22e792af6cc56b
I20260709 13:10:02.191496 27511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:02.212164 27511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:02.213941 27511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:02.237793 27511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503: Generated new TSK 0
I20260709 13:10:02.238880 27511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:02.306113 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:02.315426 27521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.318872 27522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.322185 27432 server_base.cc:1061] running on GCE node
W20260709 13:10:02.322268 27524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.323307 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:02.323516 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:02.323763 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602602323726 us; error 0 us; skew 500 ppm
I20260709 13:10:02.324399 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:02.329272 27432 webserver.cc:533] Webserver started at http://127.26.202.1:39481/ using document root <none> and password file <none>
I20260709 13:10:02.329903 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:02.330120 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:02.330441 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:02.331666 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-0-root/instance:
uuid: "e27053d980d04923a3a74669956e168c"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-008w"
I20260709 13:10:02.338682 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:10:02.343995 27529 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.344980 27432 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:10:02.345355 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "e27053d980d04923a3a74669956e168c"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-008w"
I20260709 13:10:02.345656 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:02.387892 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:02.389447 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.392829 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:02.397728 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:02.397979 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.398363 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:02.398605 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.525053 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:37801
I20260709 13:10:02.525163 27591 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:37801 every 8 connection(s)
I20260709 13:10:02.533419 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:02.547937 27596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.549453 27597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.558176 27599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.558276 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:02.560094 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:02.560475 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:02.560729 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602602560710 us; error 0 us; skew 500 ppm
I20260709 13:10:02.561548 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:02.566813 27592 heartbeater.cc:344] Connected to a master server at 127.26.202.62:46781
I20260709 13:10:02.567291 27432 webserver.cc:533] Webserver started at http://127.26.202.2:45857/ using document root <none> and password file <none>
I20260709 13:10:02.567444 27592 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:02.568328 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:02.568674 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:02.568971 27592 heartbeater.cc:507] Master 127.26.202.62:46781 requested a full tablet report, sending...
I20260709 13:10:02.569088 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:02.570752 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-1-root/instance:
uuid: "aba4e74450e44edf93d6d64c936937d6"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-008w"
I20260709 13:10:02.573061 27464 ts_manager.cc:194] Registered new tserver with Master: e27053d980d04923a3a74669956e168c (127.26.202.1:37801)
I20260709 13:10:02.577353 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:02.577348 27464 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54710
I20260709 13:10:02.583613 27604 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.584702 27432 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:10:02.585094 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-1-root
uuid: "aba4e74450e44edf93d6d64c936937d6"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-008w"
I20260709 13:10:02.585466 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:02.605346 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:02.607095 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.609058 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:02.613065 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:02.613358 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.613648 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:02.613868 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.713997 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.2:39121
I20260709 13:10:02.714100 27666 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.2:39121 every 8 connection(s)
I20260709 13:10:02.724020 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:02.739439 27670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.746791 27667 heartbeater.cc:344] Connected to a master server at 127.26.202.62:46781
I20260709 13:10:02.747339 27667 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:02.748797 27667 heartbeater.cc:507] Master 127.26.202.62:46781 requested a full tablet report, sending...
I20260709 13:10:02.752763 27464 ts_manager.cc:194] Registered new tserver with Master: aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:02.754729 27464 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54716
W20260709 13:10:02.756255 27673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.757483 27671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.759667 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:02.760778 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:02.761082 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:02.761282 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602602761266 us; error 0 us; skew 500 ppm
I20260709 13:10:02.762022 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:02.765074 27432 webserver.cc:533] Webserver started at http://127.26.202.3:45465/ using document root <none> and password file <none>
I20260709 13:10:02.765730 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:02.765964 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:02.766294 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:02.767830 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-2-root/instance:
uuid: "a4bd422097eb4ec88f7681a740db6ae3"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-008w"
I20260709 13:10:02.774085 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.006s
I20260709 13:10:02.779058 27678 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.780236 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:10:02.780702 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-2-root
uuid: "a4bd422097eb4ec88f7681a740db6ae3"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-008w"
I20260709 13:10:02.781121 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602600408833-27432-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:02.805605 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:02.807301 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.809948 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:02.813882 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:02.814173 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.814467 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:02.814687 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.911499 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.3:40231
I20260709 13:10:02.911577 27740 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.3:40231 every 8 connection(s)
I20260709 13:10:02.931793 27741 heartbeater.cc:344] Connected to a master server at 127.26.202.62:46781
I20260709 13:10:02.932232 27741 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:02.933244 27741 heartbeater.cc:507] Master 127.26.202.62:46781 requested a full tablet report, sending...
I20260709 13:10:02.935560 27464 ts_manager.cc:194] Registered new tserver with Master: a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:02.936051 27432 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013996418s
I20260709 13:10:02.937106 27464 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54726
I20260709 13:10:02.998498 27464 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54736:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:03.002592 27464 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:03.108927 27632 tablet_service.cc:1511] Processing CreateTablet for tablet 6282f8aefbfb4ecabb4528c187b1590c (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:03.110327 27629 tablet_service.cc:1511] Processing CreateTablet for tablet e8958409c0d6450bbbdcb3f154def62c (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:03.110832 27632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6282f8aefbfb4ecabb4528c187b1590c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.115298 27631 tablet_service.cc:1511] Processing CreateTablet for tablet 2d16b6bae61c4af09a4f9735c5ae249d (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:03.114498 27630 tablet_service.cc:1511] Processing CreateTablet for tablet cb2fdd0e61af473d9d0cbd3334310f2a (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:03.119652 27631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16b6bae61c4af09a4f9735c5ae249d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.122275 27629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8958409c0d6450bbbdcb3f154def62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.126516 27630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2fdd0e61af473d9d0cbd3334310f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.151620 27628 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8c56bc3dd24c5dbd0c6573db7aa2d2 (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:03.169915 27628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8c56bc3dd24c5dbd0c6573db7aa2d2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:03.168010 27512 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:03.172531 27557 tablet_service.cc:1511] Processing CreateTablet for tablet 6282f8aefbfb4ecabb4528c187b1590c (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:03.169348 27555 tablet_service.cc:1511] Processing CreateTablet for tablet cb2fdd0e61af473d9d0cbd3334310f2a (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:03.178279 27553 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8c56bc3dd24c5dbd0c6573db7aa2d2 (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:03.174485 27556 tablet_service.cc:1511] Processing CreateTablet for tablet 2d16b6bae61c4af09a4f9735c5ae249d (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:03.177155 27554 tablet_service.cc:1511] Processing CreateTablet for tablet e8958409c0d6450bbbdcb3f154def62c (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:03.181583 27557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6282f8aefbfb4ecabb4528c187b1590c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.184667 27555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2fdd0e61af473d9d0cbd3334310f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.188514 27556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16b6bae61c4af09a4f9735c5ae249d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.191551 27554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8958409c0d6450bbbdcb3f154def62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.202353 27553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8c56bc3dd24c5dbd0c6573db7aa2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.201697 27552 tablet_service.cc:1511] Processing CreateTablet for tablet 1f83cde8815c483c9a3f62c250fd00ad (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:03.208495 27552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f83cde8815c483c9a3f62c250fd00ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.209504 27627 tablet_service.cc:1511] Processing CreateTablet for tablet 1f83cde8815c483c9a3f62c250fd00ad (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:03.214741 27627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f83cde8815c483c9a3f62c250fd00ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.235321 27551 tablet_service.cc:1511] Processing CreateTablet for tablet bfd058761c7a45e1bf9a46b4c430eb9d (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:03.236860 27551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd058761c7a45e1bf9a46b4c430eb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.263861 27705 tablet_service.cc:1511] Processing CreateTablet for tablet 2d16b6bae61c4af09a4f9735c5ae249d (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:03.259302 27706 tablet_service.cc:1511] Processing CreateTablet for tablet 6282f8aefbfb4ecabb4528c187b1590c (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:03.274716 27704 tablet_service.cc:1511] Processing CreateTablet for tablet cb2fdd0e61af473d9d0cbd3334310f2a (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:03.280247 27703 tablet_service.cc:1511] Processing CreateTablet for tablet e8958409c0d6450bbbdcb3f154def62c (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:03.282665 27705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16b6bae61c4af09a4f9735c5ae249d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.283494 27702 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8c56bc3dd24c5dbd0c6573db7aa2d2 (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:03.280617 27701 tablet_service.cc:1511] Processing CreateTablet for tablet 1f83cde8815c483c9a3f62c250fd00ad (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:03.294994 27703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8958409c0d6450bbbdcb3f154def62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.295006 27700 tablet_service.cc:1511] Processing CreateTablet for tablet bfd058761c7a45e1bf9a46b4c430eb9d (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:03.298223 27706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6282f8aefbfb4ecabb4528c187b1590c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.299715 27704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2fdd0e61af473d9d0cbd3334310f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.300546 27700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd058761c7a45e1bf9a46b4c430eb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.301393 27701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f83cde8815c483c9a3f62c250fd00ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.302258 27702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8c56bc3dd24c5dbd0c6573db7aa2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.311043 27550 tablet_service.cc:1511] Processing CreateTablet for tablet a1681a4bbbdc4c7281410ec0cd1de69b (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:03.317914 27550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1681a4bbbdc4c7281410ec0cd1de69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.335350 27759 tablet_bootstrap.cc:492] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:03.345999 27699 tablet_service.cc:1511] Processing CreateTablet for tablet a1681a4bbbdc4c7281410ec0cd1de69b (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:03.334933 27630 tablet_service.cc:1511] Processing CreateTablet for tablet a1681a4bbbdc4c7281410ec0cd1de69b (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:03.351531 27699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1681a4bbbdc4c7281410ec0cd1de69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.331755 27629 tablet_service.cc:1511] Processing CreateTablet for tablet bfd058761c7a45e1bf9a46b4c430eb9d (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:03.367113 27760 tablet_bootstrap.cc:492] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:03.378638 27630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1681a4bbbdc4c7281410ec0cd1de69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.408412 27629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd058761c7a45e1bf9a46b4c430eb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.409150 27551 tablet_service.cc:1511] Processing CreateTablet for tablet 4df1e8722eec47ecb082c3759244ed8e (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:03.410450 27551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df1e8722eec47ecb082c3759244ed8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.479230 27705 tablet_service.cc:1511] Processing CreateTablet for tablet 4df1e8722eec47ecb082c3759244ed8e (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:03.488969 27629 tablet_service.cc:1511] Processing CreateTablet for tablet 4df1e8722eec47ecb082c3759244ed8e (DEFAULT_TABLE table=test-workload [id=f0b14ac5b48d4d149195e08ce00ccb30]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:03.489828 27705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df1e8722eec47ecb082c3759244ed8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.490417 27629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df1e8722eec47ecb082c3759244ed8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.506839 27759 tablet_bootstrap.cc:654] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.511467 27761 tablet_bootstrap.cc:492] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:03.512732 27760 tablet_bootstrap.cc:654] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.537385 27761 tablet_bootstrap.cc:654] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.547521 27760 tablet_bootstrap.cc:492] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:03.548496 27760 ts_tablet_manager.cc:1403] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.195s	user 0.017s	sys 0.013s
I20260709 13:10:03.551609 27759 tablet_bootstrap.cc:492] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:03.552125 27759 ts_tablet_manager.cc:1403] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.271s	user 0.007s	sys 0.022s
I20260709 13:10:03.552742 27760 raft_consensus.cc:359] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.553648 27760 raft_consensus.cc:385] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.553959 27760 raft_consensus.cc:740] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.554766 27760 consensus_queue.cc:260] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.555222 27759 raft_consensus.cc:359] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.555941 27759 raft_consensus.cc:385] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.556356 27759 raft_consensus.cc:740] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.557319 27759 consensus_queue.cc:260] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.559171 27761 tablet_bootstrap.cc:492] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:03.559723 27761 ts_tablet_manager.cc:1403] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.010s
I20260709 13:10:03.562115 27592 heartbeater.cc:499] Master 127.26.202.62:46781 was elected leader, sending a full tablet report...
I20260709 13:10:03.563063 27761 raft_consensus.cc:359] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.563884 27761 raft_consensus.cc:385] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.564244 27761 raft_consensus.cc:740] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.565428 27761 consensus_queue.cc:260] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.566012 27667 heartbeater.cc:499] Master 127.26.202.62:46781 was elected leader, sending a full tablet report...
I20260709 13:10:03.567130 27759 ts_tablet_manager.cc:1434] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:10:03.568215 27759 tablet_bootstrap.cc:492] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:03.579094 27759 tablet_bootstrap.cc:654] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.583331 27760 ts_tablet_manager.cc:1434] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.005s
I20260709 13:10:03.584548 27760 tablet_bootstrap.cc:492] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:03.592543 27760 tablet_bootstrap.cc:654] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.596436 27741 heartbeater.cc:499] Master 127.26.202.62:46781 was elected leader, sending a full tablet report...
I20260709 13:10:03.597239 27761 ts_tablet_manager.cc:1434] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.029s
I20260709 13:10:03.598454 27761 tablet_bootstrap.cc:492] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:03.599849 27760 tablet_bootstrap.cc:492] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:03.600363 27760 ts_tablet_manager.cc:1403] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:10:03.603538 27760 raft_consensus.cc:359] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.604359 27760 raft_consensus.cc:385] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.604673 27760 raft_consensus.cc:740] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.605557 27760 consensus_queue.cc:260] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.606552 27761 tablet_bootstrap.cc:654] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.608160 27760 ts_tablet_manager.cc:1434] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:10:03.609393 27760 tablet_bootstrap.cc:492] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:03.616338 27760 tablet_bootstrap.cc:654] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.619535 27761 tablet_bootstrap.cc:492] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:03.620154 27761 ts_tablet_manager.cc:1403] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:10:03.623687 27761 raft_consensus.cc:359] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.624823 27761 raft_consensus.cc:385] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.625289 27761 raft_consensus.cc:740] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.626334 27761 consensus_queue.cc:260] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.629209 27761 ts_tablet_manager.cc:1434] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:03.630393 27761 tablet_bootstrap.cc:492] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:03.638115 27761 tablet_bootstrap.cc:654] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.638527 27759 tablet_bootstrap.cc:492] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:03.639214 27759 ts_tablet_manager.cc:1403] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.004s
I20260709 13:10:03.652474 27761 tablet_bootstrap.cc:492] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:03.653228 27761 ts_tablet_manager.cc:1403] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:10:03.656855 27761 raft_consensus.cc:359] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.658043 27761 raft_consensus.cc:385] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.658476 27761 raft_consensus.cc:740] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.659485 27761 consensus_queue.cc:260] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.662423 27761 ts_tablet_manager.cc:1434] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:10:03.663620 27761 tablet_bootstrap.cc:492] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:03.672369 27761 tablet_bootstrap.cc:654] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.674408 27759 raft_consensus.cc:359] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.675582 27759 raft_consensus.cc:385] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.676028 27759 raft_consensus.cc:740] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
W20260709 13:10:03.676278 27742 tablet.cc:2406] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:03.688045 27761 tablet_bootstrap.cc:492] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:03.688380 27760 tablet_bootstrap.cc:492] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:03.688722 27761 ts_tablet_manager.cc:1403] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 13:10:03.688851 27760 ts_tablet_manager.cc:1403] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.053s
I20260709 13:10:03.692595 27760 raft_consensus.cc:359] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.692780 27761 raft_consensus.cc:359] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.693480 27760 raft_consensus.cc:385] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.694083 27761 raft_consensus.cc:385] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.694242 27760 raft_consensus.cc:740] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.694551 27761 raft_consensus.cc:740] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.695290 27760 consensus_queue.cc:260] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.695565 27761 consensus_queue.cc:260] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.698210 27761 ts_tablet_manager.cc:1434] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:03.698657 27760 ts_tablet_manager.cc:1434] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:10:03.699395 27761 tablet_bootstrap.cc:492] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:03.699882 27760 tablet_bootstrap.cc:492] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:03.706840 27761 tablet_bootstrap.cc:654] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.708359 27760 tablet_bootstrap.cc:654] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.719942 27761 tablet_bootstrap.cc:492] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:03.720554 27761 ts_tablet_manager.cc:1403] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:10:03.722373 27760 tablet_bootstrap.cc:492] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:03.722873 27760 ts_tablet_manager.cc:1403] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 13:10:03.723115 27766 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.723661 27766 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.724340 27761 raft_consensus.cc:359] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.725265 27761 raft_consensus.cc:385] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.725620 27761 raft_consensus.cc:740] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.725979 27760 raft_consensus.cc:359] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.726730 27760 raft_consensus.cc:385] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.727077 27760 raft_consensus.cc:740] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.727851 27760 consensus_queue.cc:260] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.730609 27760 ts_tablet_manager.cc:1434] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:03.730511 27766 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:03.731658 27760 tablet_bootstrap.cc:492] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:03.731302 27759 consensus_queue.cc:260] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.738588 27759 ts_tablet_manager.cc:1434] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.002s
I20260709 13:10:03.738692 27760 tablet_bootstrap.cc:654] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.739790 27759 tablet_bootstrap.cc:492] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:03.751451 27760 tablet_bootstrap.cc:492] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:03.752089 27760 ts_tablet_manager.cc:1403] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:10:03.726504 27761 consensus_queue.cc:260] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.755581 27760 raft_consensus.cc:359] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.756353 27760 raft_consensus.cc:385] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.756696 27760 raft_consensus.cc:740] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.757570 27760 consensus_queue.cc:260] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.760571 27760 ts_tablet_manager.cc:1434] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.001s
I20260709 13:10:03.761770 27760 tablet_bootstrap.cc:492] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:03.760890 27761 ts_tablet_manager.cc:1434] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:10:03.764240 27767 raft_consensus.cc:493] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.764732 27767 raft_consensus.cc:515] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.767550 27767 leader_election.cc:290] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:03.768410 27760 tablet_bootstrap.cc:654] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.769522 27761 tablet_bootstrap.cc:492] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:03.788142 27760 tablet_bootstrap.cc:492] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:03.788689 27760 ts_tablet_manager.cc:1403] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.014s
I20260709 13:10:03.794627 27760 raft_consensus.cc:359] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.798319 27760 raft_consensus.cc:385] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.798954 27760 raft_consensus.cc:740] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.800089 27760 consensus_queue.cc:260] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.803000 27761 tablet_bootstrap.cc:654] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.816948 27766 raft_consensus.cc:493] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.818819 27766 raft_consensus.cc:515] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.829411 27766 leader_election.cc:290] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:03.831051 27760 ts_tablet_manager.cc:1434] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.009s
I20260709 13:10:03.832154 27760 tablet_bootstrap.cc:492] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:03.832304 27759 tablet_bootstrap.cc:654] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.838793 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:03.840698 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
W20260709 13:10:03.847460 27605 leader_election.cc:343] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e27053d980d04923a3a74669956e168c (127.26.202.1:37801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.846905 27767 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.846132 27566 raft_consensus.cc:2468] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 0.
I20260709 13:10:03.848423 27767 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.851946 27605 leader_election.cc:304] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:03.852855 27767 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:03.853900 27766 raft_consensus.cc:2804] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.855679 27766 raft_consensus.cc:493] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.858523 27766 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.869333 27761 tablet_bootstrap.cc:492] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:03.869886 27761 ts_tablet_manager.cc:1403] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.008s
I20260709 13:10:03.873508 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:03.875185 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:03.875954 27716 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 0.
I20260709 13:10:03.877650 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:03.874837 27715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:03.879159 27715 raft_consensus.cc:2468] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 0.
I20260709 13:10:03.880021 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:03.880084 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:03.880820 27607 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: e27053d980d04923a3a74669956e168c
I20260709 13:10:03.881335 27641 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 0.
I20260709 13:10:03.882264 27566 raft_consensus.cc:2468] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 0.
I20260709 13:10:03.885242 27680 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: 
I20260709 13:10:03.886061 27760 tablet_bootstrap.cc:654] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.886195 27767 raft_consensus.cc:2804] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.886654 27767 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.886991 27767 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.887180 27759 tablet_bootstrap.cc:492] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:03.888091 27759 ts_tablet_manager.cc:1403] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.149s	user 0.013s	sys 0.014s
W20260709 13:10:03.891510 27679 leader_election.cc:343] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e27053d980d04923a3a74669956e168c (127.26.202.1:37801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.893136 27679 leader_election.cc:304] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:03.893502 27766 raft_consensus.cc:515] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.895419 27642 raft_consensus.cc:2393] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4bd422097eb4ec88f7681a740db6ae3 in current term 1: Already voted for candidate aba4e74450e44edf93d6d64c936937d6 in this term.
I20260709 13:10:03.896222 27761 raft_consensus.cc:359] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.896988 27761 raft_consensus.cc:385] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.897338 27761 raft_consensus.cc:740] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.898183 27761 consensus_queue.cc:260] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.901469 27766 leader_election.cc:290] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:03.902318 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:03.903075 27566 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.903389 27766 raft_consensus.cc:2804] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.903198 27767 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.903764 27766 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.904093 27766 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.903028 27759 raft_consensus.cc:359] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.910190 27759 raft_consensus.cc:385] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.910528 27759 raft_consensus.cc:740] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.911330 27759 consensus_queue.cc:260] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.917523 27759 ts_tablet_manager.cc:1434] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.004s
I20260709 13:10:03.917654 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:03.918339 27566 raft_consensus.cc:2468] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 1.
I20260709 13:10:03.926131 27605 leader_election.cc:304] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:03.918900 27767 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:03.923069 27765 raft_consensus.cc:493] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.926427 27759 tablet_bootstrap.cc:492] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:03.920734 27766 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.928270 27765 raft_consensus.cc:515] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.937754 27787 raft_consensus.cc:2804] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.937937 27642 raft_consensus.cc:2393] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4bd422097eb4ec88f7681a740db6ae3 in current term 1: Already voted for candidate aba4e74450e44edf93d6d64c936937d6 in this term.
I20260709 13:10:03.938400 27787 raft_consensus.cc:697] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:03.927790 27789 raft_consensus.cc:2804] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.945917 27765 leader_election.cc:290] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
W20260709 13:10:03.937180 27679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:37801, user_credentials={real_user=slave}} blocked reactor thread for 44218.3us
I20260709 13:10:03.951267 27761 ts_tablet_manager.cc:1434] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.081s	user 0.010s	sys 0.006s
I20260709 13:10:03.940658 27787 consensus_queue.cc:237] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:03.953459 27761 tablet_bootstrap.cc:492] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:03.956075 27788 raft_consensus.cc:493] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.956777 27715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:03.962993 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:03.961928 27766 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:03.945230 27789 raft_consensus.cc:493] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.968776 27716 raft_consensus.cc:2393] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aba4e74450e44edf93d6d64c936937d6 in current term 1: Already voted for candidate a4bd422097eb4ec88f7681a740db6ae3 in this term.
I20260709 13:10:03.970510 27789 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.984392 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:03.980661 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
W20260709 13:10:03.990163 27679 leader_election.cc:343] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e27053d980d04923a3a74669956e168c (127.26.202.1:37801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:03.991400 27605 leader_election.cc:343] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e27053d980d04923a3a74669956e168c (127.26.202.1:37801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.991510 27679 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3; no voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c
I20260709 13:10:03.991880 27605 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6; no voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c
I20260709 13:10:03.993595 27767 raft_consensus.cc:2749] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.994712 27791 raft_consensus.cc:2749] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.959607 27788 raft_consensus.cc:515] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.000900 27760 tablet_bootstrap.cc:492] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:04.004029 27760 ts_tablet_manager.cc:1403] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.172s	user 0.017s	sys 0.021s
I20260709 13:10:04.005492 27765 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.006194 27765 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.007928 27759 tablet_bootstrap.cc:654] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.008769 27765 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.012087 27761 tablet_bootstrap.cc:654] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.016510 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:04.017289 27567 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 0.
I20260709 13:10:04.016512 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.019469 27642 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 0.
I20260709 13:10:04.021683 27680 leader_election.cc:304] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: 
I20260709 13:10:04.022578 27767 raft_consensus.cc:2804] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.022939 27767 raft_consensus.cc:493] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.023303 27767 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.015384 27788 leader_election.cc:290] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:04.027861 27461 catalog_manager.cc:5697] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.035944 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.036309 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.036633 27642 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 0.
W20260709 13:10:04.038511 27531 leader_election.cc:343] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.038568 27767 raft_consensus.cc:515] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.039341 27531 leader_election.cc:304] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:04.040303 27765 raft_consensus.cc:2804] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.040683 27765 raft_consensus.cc:493] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.041049 27765 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.044173 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:04.045341 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:04.045964 27642 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.052742 27765 raft_consensus.cc:515] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.054123 27567 raft_consensus.cc:2393] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4bd422097eb4ec88f7681a740db6ae3 in current term 1: Already voted for candidate e27053d980d04923a3a74669956e168c in this term.
I20260709 13:10:04.055408 27765 leader_election.cc:290] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.055994 27765 raft_consensus.cc:493] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.056500 27765 raft_consensus.cc:515] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.057303 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:04.058681 27765 leader_election.cc:290] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.058518 27642 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 1.
I20260709 13:10:04.063290 27680 leader_election.cc:304] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: e27053d980d04923a3a74669956e168c
I20260709 13:10:04.065986 27761 tablet_bootstrap.cc:492] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:04.066637 27761 ts_tablet_manager.cc:1403] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.001s
I20260709 13:10:04.070470 27761 raft_consensus.cc:359] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.071489 27761 raft_consensus.cc:385] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.071900 27761 raft_consensus.cc:740] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.061523 27767 leader_election.cc:290] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:04.072712 27788 raft_consensus.cc:2804] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.081837 27788 raft_consensus.cc:697] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 LEADER]: Becoming Leader. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:04.085260 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.081674 27761 consensus_queue.cc:260] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.089237 27798 raft_consensus.cc:493] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.093883 27759 tablet_bootstrap.cc:492] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:04.091682 27760 raft_consensus.cc:359] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.093520 27798 raft_consensus.cc:515] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.088876 27789 raft_consensus.cc:515] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.096446 27760 raft_consensus.cc:385] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.089823 27788 consensus_queue.cc:237] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
W20260709 13:10:04.095955 27531 leader_election.cc:343] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.095873 27759 ts_tablet_manager.cc:1403] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.003s
I20260709 13:10:04.098055 27760 raft_consensus.cc:740] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.100848 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.103865 27715 raft_consensus.cc:2393] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aba4e74450e44edf93d6d64c936937d6 in current term 1: Already voted for candidate a4bd422097eb4ec88f7681a740db6ae3 in this term.
I20260709 13:10:04.106519 27713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:04.106693 27767 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.111271 27798 leader_election.cc:290] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.115876 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.115962 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:04.104080 27760 consensus_queue.cc:260] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.103506 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.110589 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.119256 27567 raft_consensus.cc:2393] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4bd422097eb4ec88f7681a740db6ae3 in current term 1: Already voted for candidate aba4e74450e44edf93d6d64c936937d6 in this term.
I20260709 13:10:04.120851 27712 raft_consensus.cc:2468] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 0.
I20260709 13:10:04.119220 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.123085 27760 ts_tablet_manager.cc:1434] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.119s	user 0.016s	sys 0.003s
I20260709 13:10:04.123147 27761 ts_tablet_manager.cc:1434] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 13:10:04.124207 27765 raft_consensus.cc:493] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.124366 27761 tablet_bootstrap.cc:492] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:04.124532 27760 tablet_bootstrap.cc:492] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:04.122198 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:04.117568 27767 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.124671 27765 raft_consensus.cc:515] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.119880 27716 raft_consensus.cc:2468] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 0.
I20260709 13:10:04.121855 27789 leader_election.cc:290] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:04.119232 27532 leader_election.cc:304] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e27053d980d04923a3a74669956e168c; no voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.135177 27680 leader_election.cc:304] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3; no voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c
I20260709 13:10:04.135483 27765 leader_election.cc:290] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.135457 27532 leader_election.cc:304] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.136061 27765 raft_consensus.cc:2749] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.136024 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.136397 27789 raft_consensus.cc:2749] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.136857 27765 raft_consensus.cc:2804] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.137257 27765 raft_consensus.cc:493] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.137581 27765 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.138051 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.139385 27532 leader_election.cc:304] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
W20260709 13:10:04.140558 27531 leader_election.cc:343] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.141819 27798 raft_consensus.cc:2804] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.143175 27714 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 0.
I20260709 13:10:04.143370 27798 raft_consensus.cc:493] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.140905 27716 raft_consensus.cc:2468] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 0.
I20260709 13:10:04.145289 27798 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.148212 27532 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.148141 27759 raft_consensus.cc:359] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.151785 27759 raft_consensus.cc:385] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.152208 27759 raft_consensus.cc:740] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.153240 27759 consensus_queue.cc:260] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.150796 27765 raft_consensus.cc:515] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.159900 27532 leader_election.cc:304] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.165552 27767 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:04.165887 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:04.167667 27759 ts_tablet_manager.cc:1434] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:10:04.168118 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.168992 27765 leader_election.cc:290] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.169467 27798 raft_consensus.cc:515] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.169669 27765 raft_consensus.cc:2804] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:04.169756 27680 leader_election.cc:343] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.170295 27765 raft_consensus.cc:493] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.171123 27765 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.164592 27801 raft_consensus.cc:2804] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.173642 27759 tablet_bootstrap.cc:492] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:04.173601 27567 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 0.
I20260709 13:10:04.173930 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
W20260709 13:10:04.175560 27531 leader_election.cc:343] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.176236 27801 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.176820 27801 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.183326 27798 leader_election.cc:290] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.207957 27787 raft_consensus.cc:493] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.209101 27787 raft_consensus.cc:515] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.210482 27761 tablet_bootstrap.cc:654] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.219751 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:04.219197 27760 tablet_bootstrap.cc:654] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.219973 27787 leader_election.cc:290] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
W20260709 13:10:04.218010 27532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40231, user_credentials={real_user=slave}} blocked reactor thread for 61552.4us
I20260709 13:10:04.222596 27641 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.224140 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.225168 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:04.226140 27716 raft_consensus.cc:2468] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 0.
I20260709 13:10:04.226318 27714 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.228003 27607 leader_election.cc:304] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: 
I20260709 13:10:04.223277 27765 raft_consensus.cc:515] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.230654 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:04.230720 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:04.232710 27716 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.235133 27566 raft_consensus.cc:2393] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aba4e74450e44edf93d6d64c936937d6 in current term 1: Already voted for candidate e27053d980d04923a3a74669956e168c in this term.
I20260709 13:10:04.241120 27760 tablet_bootstrap.cc:492] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:04.241544 27760 ts_tablet_manager.cc:1403] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.017s
I20260709 13:10:04.250522 27765 leader_election.cc:290] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.251636 27760 raft_consensus.cc:359] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.252170 27760 raft_consensus.cc:385] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.252403 27760 raft_consensus.cc:740] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.253566 27640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
W20260709 13:10:04.256850 27531 leader_election.cc:343] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.278075 27760 consensus_queue.cc:260] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.279243 27716 raft_consensus.cc:2468] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 1.
I20260709 13:10:04.279696 27801 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.282132 27679 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.274334 27714 raft_consensus.cc:2468] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 1.
I20260709 13:10:04.255507 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:04.284237 27767 raft_consensus.cc:2804] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.284857 27767 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.284338 27462 catalog_manager.cc:5697] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:04.285142 27512 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:04.285952 27760 ts_tablet_manager.cc:1434] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.044s	user 0.013s	sys 0.015s
I20260709 13:10:04.285730 27767 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.286816 27760 tablet_bootstrap.cc:492] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c: Bootstrap starting.
I20260709 13:10:04.287283 27641 raft_consensus.cc:2468] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 1.
I20260709 13:10:04.287750 27787 raft_consensus.cc:2764] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:04.288300 27532 leader_election.cc:304] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:04.289230 27765 raft_consensus.cc:2804] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.289708 27765 raft_consensus.cc:697] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:04.284574 27712 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.290488 27765 consensus_queue.cc:237] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.300710 27532 leader_election.cc:304] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.305840 27803 raft_consensus.cc:2804] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.306301 27761 tablet_bootstrap.cc:492] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:04.306378 27803 raft_consensus.cc:697] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:04.307035 27761 ts_tablet_manager.cc:1403] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.183s	user 0.018s	sys 0.005s
I20260709 13:10:04.307405 27803 consensus_queue.cc:237] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.317463 27761 raft_consensus.cc:359] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.318449 27761 raft_consensus.cc:385] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.318958 27761 raft_consensus.cc:740] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.322217 27761 consensus_queue.cc:260] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.330499 27760 tablet_bootstrap.cc:654] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.330720 27759 tablet_bootstrap.cc:654] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.333156 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
W20260709 13:10:04.335305 27531 leader_election.cc:343] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.335695 27761 ts_tablet_manager.cc:1434] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:10:04.337426 27761 tablet_bootstrap.cc:492] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3: Bootstrap starting.
I20260709 13:10:04.338943 27462 catalog_manager.cc:5697] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 0 to 1, leader changed from <none> to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.338081 27767 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.342783 27767 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:04.344092 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:04.344494 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:04.345293 27567 raft_consensus.cc:2393] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4bd422097eb4ec88f7681a740db6ae3 in current term 1: Already voted for candidate e27053d980d04923a3a74669956e168c in this term.
W20260709 13:10:04.346073 27680 leader_election.cc:343] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.347851 27801 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.348956 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:04.349808 27714 raft_consensus.cc:2393] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e27053d980d04923a3a74669956e168c in current term 1: Already voted for candidate a4bd422097eb4ec88f7681a740db6ae3 in this term.
I20260709 13:10:04.351480 27679 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3; no voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c
I20260709 13:10:04.352221 27532 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e27053d980d04923a3a74669956e168c; no voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.345558 27712 raft_consensus.cc:2468] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 1.
I20260709 13:10:04.353569 27801 raft_consensus.cc:2749] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.353626 27767 raft_consensus.cc:2749] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.356737 27532 leader_election.cc:304] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.357846 27801 raft_consensus.cc:2804] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.358312 27801 raft_consensus.cc:697] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:04.359131 27801 consensus_queue.cc:237] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.364084 27761 tablet_bootstrap.cc:654] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.366616 27787 consensus_queue.cc:1048] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:04.376211 27760 tablet_bootstrap.cc:492] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c: No bootstrap required, opened a new log
I20260709 13:10:04.378705 27760 ts_tablet_manager.cc:1403] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.004s
I20260709 13:10:04.377430 27759 tablet_bootstrap.cc:492] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:04.379328 27759 ts_tablet_manager.cc:1403] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.029s
I20260709 13:10:04.381919 27759 raft_consensus.cc:359] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.383010 27759 raft_consensus.cc:385] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.382341 27462 catalog_manager.cc:5697] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 0 to 1, leader changed from <none> to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.383496 27759 raft_consensus.cc:740] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.384562 27759 consensus_queue.cc:260] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.386910 27761 tablet_bootstrap.cc:492] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3: No bootstrap required, opened a new log
I20260709 13:10:04.384362 27462 catalog_manager.cc:5697] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 0 to 1, leader changed from <none> to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.387504 27761 ts_tablet_manager.cc:1403] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.001s
I20260709 13:10:04.389938 27759 ts_tablet_manager.cc:1434] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:10:04.390376 27761 raft_consensus.cc:359] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.391045 27759 tablet_bootstrap.cc:492] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:04.393853 27760 raft_consensus.cc:359] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.394537 27760 raft_consensus.cc:385] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.394843 27760 raft_consensus.cc:740] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.395506 27760 consensus_queue.cc:260] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.391027 27761 raft_consensus.cc:385] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.397058 27761 raft_consensus.cc:740] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.399518 27761 consensus_queue.cc:260] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.400403 27760 ts_tablet_manager.cc:1434] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:04.406723 27767 raft_consensus.cc:493] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.407512 27767 raft_consensus.cc:515] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.412230 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df1e8722eec47ecb082c3759244ed8e" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:04.412914 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df1e8722eec47ecb082c3759244ed8e" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.414324 27566 raft_consensus.cc:2468] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 0.
W20260709 13:10:04.415122 27680 leader_election.cc:343] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.415891 27767 leader_election.cc:290] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:04.415968 27679 leader_election.cc:304] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.417567 27767 raft_consensus.cc:2804] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.418078 27767 raft_consensus.cc:493] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.418339 27761 ts_tablet_manager.cc:1434] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:10:04.418556 27767 raft_consensus.cc:3060] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.425311 27759 tablet_bootstrap.cc:654] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.427187 27767 raft_consensus.cc:515] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.430583 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df1e8722eec47ecb082c3759244ed8e" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:04.431241 27566 raft_consensus.cc:3060] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.454061 27759 tablet_bootstrap.cc:492] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:04.454136 27566 raft_consensus.cc:2468] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 1.
I20260709 13:10:04.454962 27759 ts_tablet_manager.cc:1403] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.006s
I20260709 13:10:04.455955 27767 leader_election.cc:290] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:04.456943 27679 leader_election.cc:304] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:04.457253 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df1e8722eec47ecb082c3759244ed8e" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:04.458025 27789 raft_consensus.cc:2804] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.458496 27789 raft_consensus.cc:697] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 1 LEADER]: Becoming Leader. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
W20260709 13:10:04.459137 27680 leader_election.cc:343] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:04.459298 27789 consensus_queue.cc:237] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.461318 27759 raft_consensus.cc:359] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.462107 27759 raft_consensus.cc:385] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.462409 27759 raft_consensus.cc:740] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.463555 27791 consensus_queue.cc:1048] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.470738 27759 consensus_queue.cc:260] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.487952 27759 ts_tablet_manager.cc:1434] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.004s
I20260709 13:10:04.489341 27759 tablet_bootstrap.cc:492] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:04.502614 27759 tablet_bootstrap.cc:654] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.504923 27461 catalog_manager.cc:5697] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.520303 27759 tablet_bootstrap.cc:492] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:04.520839 27759 ts_tablet_manager.cc:1403] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 13:10:04.524078 27759 raft_consensus.cc:359] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.524859 27759 raft_consensus.cc:385] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.525221 27759 raft_consensus.cc:740] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.525907 27759 consensus_queue.cc:260] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.528309 27759 ts_tablet_manager.cc:1434] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:04.529306 27759 tablet_bootstrap.cc:492] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:04.534940 27759 tablet_bootstrap.cc:654] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.540812 27759 tablet_bootstrap.cc:492] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:04.541344 27759 ts_tablet_manager.cc:1403] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.005s
I20260709 13:10:04.543263 27759 raft_consensus.cc:359] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.543862 27759 raft_consensus.cc:385] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.544166 27759 raft_consensus.cc:740] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.544807 27759 consensus_queue.cc:260] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.546561 27759 ts_tablet_manager.cc:1434] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:04.547528 27759 tablet_bootstrap.cc:492] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6: Bootstrap starting.
I20260709 13:10:04.551916 27759 tablet_bootstrap.cc:654] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.556556 27759 tablet_bootstrap.cc:492] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6: No bootstrap required, opened a new log
I20260709 13:10:04.557054 27759 ts_tablet_manager.cc:1403] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:04.557168 27801 raft_consensus.cc:493] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.557632 27801 raft_consensus.cc:515] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.559660 27759 raft_consensus.cc:359] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.560328 27759 raft_consensus.cc:385] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.560611 27759 raft_consensus.cc:740] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.560500 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.561460 27759 consensus_queue.cc:260] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.562412 27641 raft_consensus.cc:2468] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 0.
I20260709 13:10:04.564033 27759 ts_tablet_manager.cc:1434] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:04.564239 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.564625 27531 leader_election.cc:304] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:04.564841 27712 raft_consensus.cc:2468] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 0.
I20260709 13:10:04.565503 27803 raft_consensus.cc:2804] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.559679 27801 leader_election.cc:290] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.566522 27803 raft_consensus.cc:493] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.567343 27803 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.575981 27803 raft_consensus.cc:515] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.579150 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:04.579900 27642 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.580340 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:04.581254 27712 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.581442 27789 consensus_queue.cc:1048] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.588886 27712 raft_consensus.cc:2468] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 1.
I20260709 13:10:04.589690 27803 leader_election.cc:290] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.590446 27642 raft_consensus.cc:2468] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 1.
I20260709 13:10:04.591058 27532 leader_election.cc:304] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:04.592676 27803 raft_consensus.cc:2804] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.593474 27803 raft_consensus.cc:697] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:04.594412 27803 consensus_queue.cc:237] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.604961 27767 consensus_queue.cc:1048] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:04.614115 27791 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.614715 27791 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.618947 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.619776 27712 raft_consensus.cc:2393] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aba4e74450e44edf93d6d64c936937d6 in current term 1: Already voted for candidate a4bd422097eb4ec88f7681a740db6ae3 in this term.
I20260709 13:10:04.619832 27791 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.620945 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:04.621754 27567 raft_consensus.cc:2393] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aba4e74450e44edf93d6d64c936937d6 in current term 1: Already voted for candidate e27053d980d04923a3a74669956e168c in this term.
I20260709 13:10:04.620740 27462 catalog_manager.cc:5697] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 0 to 1, leader changed from <none> to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.622812 27605 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6; no voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c
I20260709 13:10:04.623528 27791 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.628325 27791 raft_consensus.cc:2749] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.685853 27803 consensus_queue.cc:1048] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.698299 27798 consensus_queue.cc:1048] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.710173 27798 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.710685 27798 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.713559 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:04.714159 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.714423 27642 raft_consensus.cc:2393] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e27053d980d04923a3a74669956e168c in current term 1: Already voted for candidate aba4e74450e44edf93d6d64c936937d6 in this term.
I20260709 13:10:04.714967 27712 raft_consensus.cc:2393] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e27053d980d04923a3a74669956e168c in current term 1: Already voted for candidate a4bd422097eb4ec88f7681a740db6ae3 in this term.
I20260709 13:10:04.716171 27532 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e27053d980d04923a3a74669956e168c; no voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:04.712790 27798 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.717028 27801 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.723701 27801 raft_consensus.cc:2749] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.728735 27791 raft_consensus.cc:493] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.729290 27791 raft_consensus.cc:515] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.730949 27791 leader_election.cc:290] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.731900 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:04.732136 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.732930 27712 raft_consensus.cc:2393] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aba4e74450e44edf93d6d64c936937d6 in current term 1: Already voted for candidate e27053d980d04923a3a74669956e168c in this term.
I20260709 13:10:04.733980 27607 leader_election.cc:304] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6; no voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c
I20260709 13:10:04.734789 27791 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.740882 27791 raft_consensus.cc:2749] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.744583 27791 raft_consensus.cc:493] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.745126 27791 raft_consensus.cc:515] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.746840 27791 leader_election.cc:290] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.747864 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.747915 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:04.748771 27712 raft_consensus.cc:2393] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aba4e74450e44edf93d6d64c936937d6 in current term 1: Already voted for candidate e27053d980d04923a3a74669956e168c in this term.
I20260709 13:10:04.750011 27607 leader_election.cc:304] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6; no voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c
I20260709 13:10:04.750824 27791 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.758011 27791 raft_consensus.cc:2749] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.812497 27801 consensus_queue.cc:1048] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.827175 27801 consensus_queue.cc:1048] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:04.853983 27791 raft_consensus.cc:493] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.854524 27791 raft_consensus.cc:515] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:04.856385 27801 consensus_queue.cc:1048] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.856757 27791 leader_election.cc:290] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:04.857470 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df1e8722eec47ecb082c3759244ed8e" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:04.858229 27567 raft_consensus.cc:2393] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aba4e74450e44edf93d6d64c936937d6 in current term 1: Already voted for candidate a4bd422097eb4ec88f7681a740db6ae3 in this term.
I20260709 13:10:04.858687 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df1e8722eec47ecb082c3759244ed8e" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:04.860822 27607 leader_election.cc:304] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6; no voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c
I20260709 13:10:04.861580 27791 raft_consensus.cc:3060] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.863413 27801 consensus_queue.cc:1048] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.869875 27791 raft_consensus.cc:2749] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:04.915596 27767 consensus_queue.cc:1048] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.933117 27767 consensus_queue.cc:1048] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:05.014467 27801 consensus_queue.cc:1048] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.026731 27765 consensus_queue.cc:1048] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:05.291599 27512 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:05.858796 27767 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.859254 27767 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:05.860924 27767 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:05.861886 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:05.861967 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6" is_pre_election: true
I20260709 13:10:05.862437 27567 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 1.
I20260709 13:10:05.862473 27642 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 1.
I20260709 13:10:05.863596 27679 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:05.864256 27767 raft_consensus.cc:2804] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:05.864606 27767 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.864856 27767 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.869638 27767 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:05.871498 27767 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 2 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:05.872303 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:05.872895 27567 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.873345 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:05.873831 27642 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.878087 27567 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 2.
I20260709 13:10:05.878652 27642 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 2.
I20260709 13:10:05.879522 27679 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:05.880514 27767 raft_consensus.cc:2804] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:05.881208 27767 raft_consensus.cc:697] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 2 LEADER]: Becoming Leader. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:05.882036 27767 consensus_queue.cc:237] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:05.889364 27464 catalog_manager.cc:5697] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 reported cstate change: term changed from 0 to 2, leader changed from <none> to a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.947111 27837 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.947688 27837 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:05.949587 27837 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:05.950395 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c" is_pre_election: true
I20260709 13:10:05.950636 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3" is_pre_election: true
I20260709 13:10:05.951064 27567 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 1.
I20260709 13:10:05.951189 27714 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 1.
I20260709 13:10:05.952205 27605 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:05.953045 27837 raft_consensus.cc:2804] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:05.953402 27837 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.953747 27837 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.958365 27837 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:05.960078 27837 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:05.961145 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:05.961228 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:05.961656 27567 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.961764 27714 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.966277 27714 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:05.966277 27567 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:05.967558 27605 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:05.968353 27837 raft_consensus.cc:2804] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:05.969413 27837 raft_consensus.cc:697] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:05.970249 27837 consensus_queue.cc:237] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:05.976835 27464 catalog_manager.cc:5697] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 0 to 2, leader changed from <none> to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.269797 27567 raft_consensus.cc:1275] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:06.271276 27767 consensus_queue.cc:1048] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:06.282976 27642 raft_consensus.cc:1275] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:06.284715 27767 consensus_queue.cc:1048] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:06.465663 27567 raft_consensus.cc:1275] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:06.466980 27837 consensus_queue.cc:1048] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:06.477991 27714 raft_consensus.cc:1275] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:06.479851 27837 consensus_queue.cc:1048] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:06.593542 27714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d"
dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
mode: GRACEFUL
new_leader_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:48156
I20260709 13:10:06.594307 27714 raft_consensus.cc:606] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 LEADER]: Received request to transfer leadership to TS e27053d980d04923a3a74669956e168c
I20260709 13:10:06.609634 27641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
mode: GRACEFUL
new_leader_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:45714
I20260709 13:10:06.610232 27641 raft_consensus.cc:606] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 LEADER]: Received request to transfer leadership to TS e27053d980d04923a3a74669956e168c
I20260709 13:10:06.615681 27641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
mode: GRACEFUL
new_leader_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:45714
I20260709 13:10:06.616408 27641 raft_consensus.cc:606] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Received request to transfer leadership to TS e27053d980d04923a3a74669956e168c
I20260709 13:10:06.631304 27567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2"
dest_uuid: "e27053d980d04923a3a74669956e168c"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:10:06.631886 27567 raft_consensus.cc:606] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:06.637868 27714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad"
dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:48156
I20260709 13:10:06.638489 27714 raft_consensus.cc:606] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 2 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:06.644064 27567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d"
dest_uuid: "e27053d980d04923a3a74669956e168c"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:10:06.644749 27567 raft_consensus.cc:606] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:06.650314 27567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b"
dest_uuid: "e27053d980d04923a3a74669956e168c"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:10:06.650876 27567 raft_consensus.cc:606] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:06.911131 27860 raft_consensus.cc:993] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:06.911612 27860 raft_consensus.cc:1081] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 2 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:06.914247 27641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45696
I20260709 13:10:06.914939 27641 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.915309 27641 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.920326 27641 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:06.922462 27641 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 3 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:06.923568 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:06.923687 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:06.924185 27714 raft_consensus.cc:3055] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.924299 27567 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.924492 27714 raft_consensus.cc:740] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:06.925386 27714 consensus_queue.cc:260] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:06.926442 27714 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.929519 27567 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 3.
I20260709 13:10:06.930752 27605 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:06.931053 27714 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 3.
I20260709 13:10:06.931591 27853 raft_consensus.cc:2804] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:06.932101 27853 raft_consensus.cc:697] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 3 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:06.932895 27853 consensus_queue.cc:237] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:06.939222 27462 catalog_manager.cc:5697] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 2 to 3, leader changed from a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.973445 27861 raft_consensus.cc:993] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: : Instructing follower e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:06.973922 27860 raft_consensus.cc:1081] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 LEADER]: Signalling peer e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:06.975553 27567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d"
dest_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:35576
I20260709 13:10:06.976167 27567 raft_consensus.cc:493] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.976543 27567 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.979003 27852 raft_consensus.cc:993] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6: : Instructing follower e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:06.979528 27853 raft_consensus.cc:1081] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Signalling peer e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:06.981171 27566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c"
dest_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:35566
I20260709 13:10:06.981637 27566 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.981921 27566 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.982734 27567 raft_consensus.cc:515] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:06.984993 27567 leader_election.cc:290] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 2 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:06.985771 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:06.986338 27641 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.987035 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:06.987596 27714 raft_consensus.cc:3055] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:06.988369 27714 raft_consensus.cc:740] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:06.989243 27566 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:06.990314 27714 consensus_queue.cc:260] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:06.991040 27855 raft_consensus.cc:993] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:06.991474 27566 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 3 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:06.991559 27714 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.993065 27641 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 2.
I20260709 13:10:06.993319 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:06.991490 27855 raft_consensus.cc:1081] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:06.993938 27712 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.996840 27642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45710
I20260709 13:10:06.996968 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:06.997475 27642 raft_consensus.cc:493] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.997527 27641 raft_consensus.cc:3055] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.997956 27642 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.998175 27641 raft_consensus.cc:740] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:06.999140 27531 leader_election.cc:304] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:07.000051 27855 raft_consensus.cc:2804] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.000496 27714 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 2.
I20260709 13:10:07.000761 27712 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 3.
I20260709 13:10:07.001253 27855 raft_consensus.cc:697] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:06.999119 27641 consensus_queue.cc:260] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.002446 27532 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:07.002144 27855 consensus_queue.cc:237] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.003307 27801 raft_consensus.cc:2804] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:07.003484 27641 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.005074 27642 raft_consensus.cc:515] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.007668 27642 leader_election.cc:290] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:07.008436 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:07.009096 27566 raft_consensus.cc:3055] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.009430 27566 raft_consensus.cc:740] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:07.010237 27566 consensus_queue.cc:260] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.011463 27566 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.011538 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:07.011811 27641 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 3.
I20260709 13:10:07.012176 27714 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.013746 27801 raft_consensus.cc:697] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:07.014608 27801 consensus_queue.cc:237] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.019526 27566 raft_consensus.cc:2468] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:07.020797 27605 leader_election.cc:304] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:07.020635 27462 catalog_manager.cc:5697] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 1 to 2, leader changed from a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3) to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 2 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.022167 27852 raft_consensus.cc:2804] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.022104 27714 raft_consensus.cc:2468] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:07.024364 27853 raft_consensus.cc:993] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6: : Instructing follower e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:07.024783 27852 raft_consensus.cc:697] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:07.025031 27853 raft_consensus.cc:1081] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 LEADER]: Signalling peer e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:07.025832 27852 consensus_queue.cc:237] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.027082 27566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a"
dest_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:35566
I20260709 13:10:07.027669 27566 raft_consensus.cc:493] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.028048 27566 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.035909 27566 raft_consensus.cc:515] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.037463 27464 catalog_manager.cc:5697] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 1 to 2, leader changed from e27053d980d04923a3a74669956e168c (127.26.202.1) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.039330 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:07.039568 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:07.040023 27641 raft_consensus.cc:3055] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.040186 27714 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.040488 27641 raft_consensus.cc:740] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:07.041433 27641 consensus_queue.cc:260] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.042619 27641 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.042341 27462 catalog_manager.cc:5697] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 2 to 3, leader changed from aba4e74450e44edf93d6d64c936937d6 (127.26.202.2) to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 3 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.045414 27566 leader_election.cc:290] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 2 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:07.047679 27801 raft_consensus.cc:993] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:07.048178 27801 raft_consensus.cc:1081] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:07.048390 27714 raft_consensus.cc:2468] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 2.
I20260709 13:10:07.049770 27532 leader_election.cc:304] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:07.050215 27642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45710
I20260709 13:10:07.050905 27642 raft_consensus.cc:493] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.051369 27642 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.053263 27865 raft_consensus.cc:2804] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.053846 27865 raft_consensus.cc:697] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:07.054634 27641 raft_consensus.cc:2468] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 2.
I20260709 13:10:07.055080 27865 consensus_queue.cc:237] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.062937 27642 raft_consensus.cc:515] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.067152 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:07.067952 27566 raft_consensus.cc:3055] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.068360 27566 raft_consensus.cc:740] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:07.068491 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:07.069183 27714 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.069409 27566 consensus_queue.cc:260] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.070716 27566 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.067241 27642 leader_election.cc:290] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:07.073642 27462 catalog_manager.cc:5697] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 1 to 2, leader changed from aba4e74450e44edf93d6d64c936937d6 (127.26.202.2) to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 2 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.077579 27714 raft_consensus.cc:2468] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:07.078114 27566 raft_consensus.cc:2468] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:07.079080 27607 leader_election.cc:304] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: 
I20260709 13:10:07.079967 27852 raft_consensus.cc:2804] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.080634 27852 raft_consensus.cc:697] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:07.081570 27852 consensus_queue.cc:237] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.090101 27855 raft_consensus.cc:993] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:07.089350 27462 catalog_manager.cc:5697] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 1 to 2, leader changed from e27053d980d04923a3a74669956e168c (127.26.202.1) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.090575 27855 raft_consensus.cc:1081] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:07.092118 27642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45710
I20260709 13:10:07.092571 27642 raft_consensus.cc:493] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.092952 27642 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.098407 27642 raft_consensus.cc:515] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.099982 27642 leader_election.cc:290] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:07.101083 27714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:07.100996 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:07.101787 27714 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.101806 27566 raft_consensus.cc:3055] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.102418 27566 raft_consensus.cc:740] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:07.103322 27566 consensus_queue.cc:260] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.104665 27566 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.109782 27714 raft_consensus.cc:2468] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:07.111099 27607 leader_election.cc:304] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: 
I20260709 13:10:07.111889 27852 raft_consensus.cc:2804] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.111884 27566 raft_consensus.cc:2468] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:07.112597 27852 raft_consensus.cc:697] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:07.113567 27852 consensus_queue.cc:237] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:07.120805 27462 catalog_manager.cc:5697] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 1 to 2, leader changed from e27053d980d04923a3a74669956e168c (127.26.202.1) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.394587 27566 raft_consensus.cc:1275] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:07.395928 27852 consensus_queue.cc:1048] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.398355 27642 raft_consensus.cc:1275] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:07.399739 27865 consensus_queue.cc:1048] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.412721 27714 raft_consensus.cc:1275] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:07.414685 27852 consensus_queue.cc:1048] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.415668 27714 raft_consensus.cc:1275] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:07.420928 27855 consensus_queue.cc:1048] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:07.422782 27712 raft_consensus.cc:1275] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.428030 27855 consensus_queue.cc:1048] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:07.429203 27716 raft_consensus.cc:1275] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.431921 27867 consensus_queue.cc:1048] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.443635 27642 raft_consensus.cc:1275] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.446427 27566 raft_consensus.cc:1275] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.446481 27865 consensus_queue.cc:1048] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:07.448163 27853 consensus_queue.cc:1048] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.624296 27712 raft_consensus.cc:1275] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.625962 27865 consensus_queue.cc:1048] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.634832 27642 raft_consensus.cc:1275] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.636462 27865 consensus_queue.cc:1048] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.645718 27566 raft_consensus.cc:1275] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.647704 27853 consensus_queue.cc:1048] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.648257 27712 raft_consensus.cc:1275] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.649757 27853 consensus_queue.cc:1048] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.660984 27566 raft_consensus.cc:1275] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.662467 27868 consensus_queue.cc:1048] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:07.674595 27712 raft_consensus.cc:1275] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:07.676260 27853 consensus_queue.cc:1048] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.687966 27432 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:10:09.688894 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:09.712430 27641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
mode: GRACEFUL
new_leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
 from {username='slave'} at 127.0.0.1:45720
I20260709 13:10:09.713119 27641 raft_consensus.cc:606] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 3 LEADER]: Received request to transfer leadership to TS a4bd422097eb4ec88f7681a740db6ae3
I20260709 13:10:09.724735 27567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d"
dest_uuid: "e27053d980d04923a3a74669956e168c"
mode: GRACEFUL
new_leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
 from {username='slave'} at 127.0.0.1:35602
I20260709 13:10:09.725379 27567 raft_consensus.cc:606] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Received request to transfer leadership to TS a4bd422097eb4ec88f7681a740db6ae3
I20260709 13:10:09.726759 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:09.727246 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:09.841791 27865 raft_consensus.cc:993] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c: : Instructing follower a4bd422097eb4ec88f7681a740db6ae3 to start an election
I20260709 13:10:09.842312 27895 raft_consensus.cc:1081] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Signalling peer a4bd422097eb4ec88f7681a740db6ae3 to start an election
I20260709 13:10:09.844256 27716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d"
dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:10:09.844931 27716 raft_consensus.cc:493] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.845280 27716 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.848225 27891 raft_consensus.cc:993] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6: : Instructing follower a4bd422097eb4ec88f7681a740db6ae3 to start an election
I20260709 13:10:09.848886 27867 raft_consensus.cc:1081] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 3 LEADER]: Signalling peer a4bd422097eb4ec88f7681a740db6ae3 to start an election
I20260709 13:10:09.850422 27712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad"
dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
 from {username='slave'} at 127.0.0.1:48130
I20260709 13:10:09.850993 27712 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.851380 27712 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.851491 27716 raft_consensus.cc:515] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:09.854369 27567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:09.854693 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:09.854943 27567 raft_consensus.cc:3055] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:09.855284 27567 raft_consensus.cc:740] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:09.855320 27641 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.856129 27567 consensus_queue.cc:260] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:09.856895 27567 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:09.858325 27712 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:09.854131 27716 leader_election.cc:290] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 3 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:09.861610 27712 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 4 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:09.861804 27566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:09.862399 27566 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.862824 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:09.863402 27642 raft_consensus.cc:3055] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:09.863669 27642 raft_consensus.cc:740] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:09.864298 27567 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 3.
I20260709 13:10:09.864363 27642 consensus_queue.cc:260] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:09.865522 27641 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 3.
I20260709 13:10:09.865849 27642 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:09.865880 27679 leader_election.cc:304] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:09.869274 27860 raft_consensus.cc:2804] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:09.870222 27566 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 4.
I20260709 13:10:09.872054 27860 raft_consensus.cc:697] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 LEADER]: Becoming Leader. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:09.872035 27679 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:09.873699 27896 raft_consensus.cc:2804] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:09.873603 27860 consensus_queue.cc:237] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:09.875272 27896 raft_consensus.cc:697] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 4 LEADER]: Becoming Leader. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:09.876235 27896 consensus_queue.cc:237] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:09.877082 27642 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 4.
I20260709 13:10:09.882997 27461 catalog_manager.cc:5697] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 reported cstate change: term changed from 2 to 3, leader changed from e27053d980d04923a3a74669956e168c (127.26.202.1) to a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.900668 27461 catalog_manager.cc:5697] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 reported cstate change: term changed from 3 to 4, leader changed from aba4e74450e44edf93d6d64c936937d6 (127.26.202.2) to a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3). New cstate: current_term: 4 leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.263275 27566 raft_consensus.cc:1275] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:10.264757 27896 consensus_queue.cc:1048] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.268627 27567 raft_consensus.cc:1275] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:10.270645 27896 consensus_queue.cc:1048] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:10.284204 27642 raft_consensus.cc:1275] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:10.288446 27897 consensus_queue.cc:1048] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:10.300562 27642 raft_consensus.cc:1275] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:10.302234 27908 consensus_queue.cc:1048] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.728722 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:10.745546 27565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c"
dest_uuid: "e27053d980d04923a3a74669956e168c"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:10:10.746240 27565 raft_consensus.cc:606] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:10.752380 27712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d"
dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:48156
I20260709 13:10:10.752861 27712 raft_consensus.cc:606] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:10.758977 27565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a"
dest_uuid: "e27053d980d04923a3a74669956e168c"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:10:10.759511 27565 raft_consensus.cc:606] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:10.764950 27565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c"
dest_uuid: "e27053d980d04923a3a74669956e168c"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:35586
I20260709 13:10:10.765527 27565 raft_consensus.cc:606] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:10.775650 27712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad"
dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
mode: GRACEFUL
new_leader_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:48156
I20260709 13:10:10.776335 27712 raft_consensus.cc:606] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 4 LEADER]: Received request to transfer leadership to TS aba4e74450e44edf93d6d64c936937d6
I20260709 13:10:10.846585 27913 raft_consensus.cc:993] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:10.847375 27895 raft_consensus.cc:1081] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:10.849201 27642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45710
I20260709 13:10:10.849653 27642 raft_consensus.cc:493] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:10.849937 27642 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:10.855825 27642 raft_consensus.cc:515] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:10.857820 27642 leader_election.cc:290] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:10.858911 27565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:10.859093 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:10.859778 27565 raft_consensus.cc:3055] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:10.859860 27716 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:10.860205 27565 raft_consensus.cc:740] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:10.861343 27565 consensus_queue.cc:260] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:10.862826 27565 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:10.867905 27716 raft_consensus.cc:2468] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:10.869645 27607 leader_election.cc:304] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: 
I20260709 13:10:10.870540 27891 raft_consensus.cc:2804] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:10.870628 27565 raft_consensus.cc:2468] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 2.
I20260709 13:10:10.872031 27891 raft_consensus.cc:697] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:10.873065 27891 consensus_queue.cc:237] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:10.880717 27464 catalog_manager.cc:5697] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 1 to 2, leader changed from e27053d980d04923a3a74669956e168c (127.26.202.1) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.918433 27913 raft_consensus.cc:993] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:10.918959 27895 raft_consensus.cc:1081] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:10.920858 27642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45710
I20260709 13:10:10.921388 27642 raft_consensus.cc:493] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:10.921671 27642 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.926477 27642 raft_consensus.cc:515] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:10.928404 27642 leader_election.cc:290] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 3 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:10.929284 27565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:10.929541 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fdd0e61af473d9d0cbd3334310f2a" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:10.929896 27565 raft_consensus.cc:3055] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:10.930127 27716 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.930261 27565 raft_consensus.cc:740] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:10.931149 27565 consensus_queue.cc:260] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:10.932190 27565 raft_consensus.cc:3060] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:10.935328 27716 raft_consensus.cc:2468] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 3.
I20260709 13:10:10.936627 27607 leader_election.cc:304] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: 
I20260709 13:10:10.937592 27891 raft_consensus.cc:2804] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:10.938145 27565 raft_consensus.cc:2468] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 3.
I20260709 13:10:10.938418 27891 raft_consensus.cc:697] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 3 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:10.939664 27891 consensus_queue.cc:237] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:10.947657 27464 catalog_manager.cc:5697] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 2 to 3, leader changed from e27053d980d04923a3a74669956e168c (127.26.202.1) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.037674 27913 raft_consensus.cc:993] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:11.038137 27895 raft_consensus.cc:1081] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:11.039649 27642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45710
I20260709 13:10:11.040174 27642 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.040475 27642 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.044646 27642 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.046249 27642 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 4 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:11.047163 27565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:11.047602 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:11.047771 27565 raft_consensus.cc:3055] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:11.048115 27565 raft_consensus.cc:740] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:11.048175 27716 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.049103 27565 consensus_queue.cc:260] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.050359 27565 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.056272 27716 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 4.
I20260709 13:10:11.057600 27607 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, aba4e74450e44edf93d6d64c936937d6; no voters: 
I20260709 13:10:11.058163 27565 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 4.
I20260709 13:10:11.058532 27891 raft_consensus.cc:2804] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:11.059345 27891 raft_consensus.cc:697] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 4 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:11.060086 27891 consensus_queue.cc:237] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.066886 27464 catalog_manager.cc:5697] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 3 to 4, leader changed from e27053d980d04923a3a74669956e168c (127.26.202.1) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 4 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.266360 27565 raft_consensus.cc:1275] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:11.267729 27891 consensus_queue.cc:1048] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:11.277891 27716 raft_consensus.cc:1275] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:11.279807 27915 consensus_queue.cc:1048] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:11.289937 27908 raft_consensus.cc:993] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:11.290781 27927 raft_consensus.cc:1081] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 4 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:11.292897 27642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45696
I20260709 13:10:11.293390 27642 raft_consensus.cc:493] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.293710 27642 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.298667 27642 raft_consensus.cc:515] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.301169 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:11.301620 27565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f83cde8815c483c9a3f62c250fd00ad" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:11.301754 27716 raft_consensus.cc:3055] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:11.302138 27716 raft_consensus.cc:740] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:11.302184 27565 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.303403 27716 consensus_queue.cc:260] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.304395 27716 raft_consensus.cc:3060] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.307438 27565 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 5.
I20260709 13:10:11.300567 27642 leader_election.cc:290] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 5 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:11.309072 27605 leader_election.cc:304] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:11.309634 27716 raft_consensus.cc:2468] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 5.
I20260709 13:10:11.309894 27915 raft_consensus.cc:2804] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:11.310390 27915 raft_consensus.cc:697] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 5 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:11.311251 27915 consensus_queue.cc:237] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.317481 27464 catalog_manager.cc:5697] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 4 to 5, leader changed from a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 5 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.334455 27565 raft_consensus.cc:1275] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:11.336004 27928 raft_consensus.cc:993] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: : Instructing follower aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:11.335985 27915 consensus_queue.cc:1048] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.336624 27927 raft_consensus.cc:1081] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 LEADER]: Signalling peer aba4e74450e44edf93d6d64c936937d6 to start an election
I20260709 13:10:11.338457 27642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
 from {username='slave'} at 127.0.0.1:45696
I20260709 13:10:11.338900 27642 raft_consensus.cc:493] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.339684 27642 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.347218 27716 raft_consensus.cc:1275] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:11.347214 27642 raft_consensus.cc:515] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.349121 27915 consensus_queue.cc:1048] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.356346 27642 leader_election.cc:290] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 4 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:11.356555 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:11.357177 27712 raft_consensus.cc:3055] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:11.357491 27712 raft_consensus.cc:740] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:11.358273 27712 consensus_queue.cc:260] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.358358 27565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d16b6bae61c4af09a4f9735c5ae249d" candidate_uuid: "aba4e74450e44edf93d6d64c936937d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:11.359009 27565 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.359146 27712 raft_consensus.cc:3060] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:11.366397 27565 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 4.
I20260709 13:10:11.367820 27712 raft_consensus.cc:2468] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba4e74450e44edf93d6d64c936937d6 in term 4.
I20260709 13:10:11.368021 27605 leader_election.cc:304] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba4e74450e44edf93d6d64c936937d6, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:11.368943 27891 raft_consensus.cc:2804] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:11.369468 27891 raft_consensus.cc:697] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 4 LEADER]: Becoming Leader. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:11.370357 27891 consensus_queue.cc:237] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:11.381989 27462 catalog_manager.cc:5697] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 reported cstate change: term changed from 3 to 4, leader changed from a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3) to aba4e74450e44edf93d6d64c936937d6 (127.26.202.2). New cstate: current_term: 4 leader_uuid: "aba4e74450e44edf93d6d64c936937d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.595863 27716 raft_consensus.cc:1275] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:11.597414 27891 consensus_queue.cc:1048] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.607700 27565 raft_consensus.cc:1275] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:11.609176 27891 consensus_queue.cc:1048] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.713542 27716 raft_consensus.cc:1275] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 5 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:11.714957 27891 consensus_queue.cc:1048] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.724797 27565 raft_consensus.cc:1275] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 5 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:11.726722 27891 consensus_queue.cc:1048] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.899542 27716 raft_consensus.cc:1275] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:11.900928 27914 consensus_queue.cc:1048] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.911545 27565 raft_consensus.cc:1275] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Refusing update from remote peer aba4e74450e44edf93d6d64c936937d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:11.913429 27914 consensus_queue.cc:1048] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:13.788826 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:13.798055 27642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
mode: GRACEFUL
new_leader_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:45720
I20260709 13:10:13.798717 27642 raft_consensus.cc:606] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Received request to transfer leadership to TS e27053d980d04923a3a74669956e168c
I20260709 13:10:13.801816 27642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
mode: GRACEFUL
new_leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
 from {username='slave'} at 127.0.0.1:45720
I20260709 13:10:13.802390 27642 raft_consensus.cc:606] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Received request to transfer leadership to TS a4bd422097eb4ec88f7681a740db6ae3
I20260709 13:10:13.805667 27642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
mode: GRACEFUL
new_leader_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:45720
I20260709 13:10:13.806327 27642 raft_consensus.cc:606] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Received request to transfer leadership to TS e27053d980d04923a3a74669956e168c
I20260709 13:10:13.809140 27642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
mode: GRACEFUL
new_leader_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:45720
I20260709 13:10:13.809597 27642 raft_consensus.cc:606] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Received request to transfer leadership to TS e27053d980d04923a3a74669956e168c
I20260709 13:10:13.811774 27642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c"
dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
mode: GRACEFUL
new_leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
 from {username='slave'} at 127.0.0.1:45720
I20260709 13:10:13.812281 27642 raft_consensus.cc:606] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 4 LEADER]: Received request to transfer leadership to TS a4bd422097eb4ec88f7681a740db6ae3
I20260709 13:10:13.813238 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:13.813639 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:13.918875 27940 raft_consensus.cc:993] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6: : Instructing follower e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:13.919404 27914 raft_consensus.cc:1081] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Signalling peer e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:13.920912 27565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c"
dest_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:35566
I20260709 13:10:13.921452 27565 raft_consensus.cc:493] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.921757 27565 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.926666 27565 raft_consensus.cc:515] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:13.928308 27565 leader_election.cc:290] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 3 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:13.929549 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:13.929442 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6282f8aefbfb4ecabb4528c187b1590c" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:13.930109 27642 raft_consensus.cc:3055] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:13.930161 27712 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.930342 27642 raft_consensus.cc:740] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:13.931000 27642 consensus_queue.cc:260] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:13.931789 27642 raft_consensus.cc:3060] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.935669 27712 raft_consensus.cc:2468] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 3.
I20260709 13:10:13.936354 27642 raft_consensus.cc:2468] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 3.
I20260709 13:10:13.937058 27532 leader_election.cc:304] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:13.938726 27941 raft_consensus.cc:2804] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:13.939958 27941 raft_consensus.cc:697] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:13.940692 27941 consensus_queue.cc:237] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:13.947924 27462 catalog_manager.cc:5697] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 2 to 3, leader changed from aba4e74450e44edf93d6d64c936937d6 (127.26.202.2) to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 3 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.952860 27940 raft_consensus.cc:993] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6: : Instructing follower e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:13.953501 27914 raft_consensus.cc:1081] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Signalling peer e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:13.955344 27565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b"
dest_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:35566
I20260709 13:10:13.956058 27565 raft_consensus.cc:493] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.956544 27565 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.962921 27565 raft_consensus.cc:515] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:13.965378 27565 leader_election.cc:290] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 3 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:13.965935 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:13.965935 27712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1681a4bbbdc4c7281410ec0cd1de69b" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:13.966622 27642 raft_consensus.cc:3055] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:13.966919 27642 raft_consensus.cc:740] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:13.966969 27712 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.967738 27642 consensus_queue.cc:260] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:13.968847 27642 raft_consensus.cc:3060] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.973305 27712 raft_consensus.cc:2468] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 3.
I20260709 13:10:13.974769 27642 raft_consensus.cc:2468] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 3.
I20260709 13:10:13.974603 27532 leader_election.cc:304] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:13.975745 27941 raft_consensus.cc:2804] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:13.976092 27941 raft_consensus.cc:697] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:13.976826 27941 consensus_queue.cc:237] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:13.983191 27462 catalog_manager.cc:5697] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 2 to 3, leader changed from aba4e74450e44edf93d6d64c936937d6 (127.26.202.2) to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 3 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.047909 27940 raft_consensus.cc:993] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6: : Instructing follower a4bd422097eb4ec88f7681a740db6ae3 to start an election
I20260709 13:10:14.048388 27940 raft_consensus.cc:1081] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 4 LEADER]: Signalling peer a4bd422097eb4ec88f7681a740db6ae3 to start an election
I20260709 13:10:14.049865 27712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c"
dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
 from {username='slave'} at 127.0.0.1:48130
I20260709 13:10:14.050431 27712 raft_consensus.cc:493] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.050717 27712 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.056075 27940 raft_consensus.cc:993] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6: : Instructing follower a4bd422097eb4ec88f7681a740db6ae3 to start an election
I20260709 13:10:14.056648 27940 raft_consensus.cc:1081] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Signalling peer a4bd422097eb4ec88f7681a740db6ae3 to start an election
I20260709 13:10:14.057114 27712 raft_consensus.cc:515] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.058589 27716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2"
dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
 from {username='slave'} at 127.0.0.1:48130
I20260709 13:10:14.059041 27712 leader_election.cc:290] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 5 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:14.059213 27716 raft_consensus.cc:493] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.059760 27716 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.060148 27565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:14.060189 27642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8958409c0d6450bbbdcb3f154def62c" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:14.060873 27565 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.061123 27642 raft_consensus.cc:3055] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:14.061513 27642 raft_consensus.cc:740] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:14.062285 27642 consensus_queue.cc:260] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.063421 27642 raft_consensus.cc:3060] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:14.066150 27565 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 5.
I20260709 13:10:14.066870 27716 raft_consensus.cc:515] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.067584 27679 leader_election.cc:304] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:14.068475 27927 raft_consensus.cc:2804] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:14.070158 27716 leader_election.cc:290] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 3 election: Requested vote from peers e27053d980d04923a3a74669956e168c (127.26.202.1:37801), aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121)
I20260709 13:10:14.070255 27565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e27053d980d04923a3a74669956e168c"
I20260709 13:10:14.070981 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8c56bc3dd24c5dbd0c6573db7aa2d2" candidate_uuid: "a4bd422097eb4ec88f7681a740db6ae3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:14.071197 27565 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.071452 27642 raft_consensus.cc:2468] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 5.
I20260709 13:10:14.071560 27641 raft_consensus.cc:3055] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.071967 27641 raft_consensus.cc:740] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:14.072731 27641 consensus_queue.cc:260] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.073768 27927 raft_consensus.cc:697] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 5 LEADER]: Becoming Leader. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:14.074070 27641 raft_consensus.cc:3060] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.074873 27927 consensus_queue.cc:237] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.079186 27565 raft_consensus.cc:2468] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 3.
I20260709 13:10:14.079922 27641 raft_consensus.cc:2468] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4bd422097eb4ec88f7681a740db6ae3 in term 3.
I20260709 13:10:14.080533 27679 leader_election.cc:304] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:14.081563 27927 raft_consensus.cc:2804] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.082245 27927 raft_consensus.cc:697] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 3 LEADER]: Becoming Leader. State: Replica: a4bd422097eb4ec88f7681a740db6ae3, State: Running, Role: LEADER
I20260709 13:10:14.083214 27927 consensus_queue.cc:237] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.085721 27462 catalog_manager.cc:5697] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 reported cstate change: term changed from 4 to 5, leader changed from aba4e74450e44edf93d6d64c936937d6 (127.26.202.2) to a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3). New cstate: current_term: 5 leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.098992 27462 catalog_manager.cc:5697] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 reported cstate change: term changed from 2 to 3, leader changed from aba4e74450e44edf93d6d64c936937d6 (127.26.202.2) to a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "a4bd422097eb4ec88f7681a740db6ae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.142201 27949 raft_consensus.cc:993] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6: : Instructing follower e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:14.142738 27914 raft_consensus.cc:1081] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Signalling peer e27053d980d04923a3a74669956e168c to start an election
I20260709 13:10:14.144241 27565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d"
dest_uuid: "e27053d980d04923a3a74669956e168c"
 from {username='slave'} at 127.0.0.1:35566
I20260709 13:10:14.144712 27565 raft_consensus.cc:493] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.145026 27565 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.149066 27565 raft_consensus.cc:515] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.150470 27565 leader_election.cc:290] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 3 election: Requested vote from peers aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121), a4bd422097eb4ec88f7681a740db6ae3 (127.26.202.3:40231)
I20260709 13:10:14.151530 27641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aba4e74450e44edf93d6d64c936937d6"
I20260709 13:10:14.151533 27716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd058761c7a45e1bf9a46b4c430eb9d" candidate_uuid: "e27053d980d04923a3a74669956e168c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a4bd422097eb4ec88f7681a740db6ae3"
I20260709 13:10:14.152293 27641 raft_consensus.cc:3055] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.152356 27716 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.152789 27641 raft_consensus.cc:740] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aba4e74450e44edf93d6d64c936937d6, State: Running, Role: LEADER
I20260709 13:10:14.153666 27641 consensus_queue.cc:260] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.154870 27641 raft_consensus.cc:3060] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.159610 27716 raft_consensus.cc:2468] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 3.
I20260709 13:10:14.161098 27532 leader_election.cc:304] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4bd422097eb4ec88f7681a740db6ae3, e27053d980d04923a3a74669956e168c; no voters: 
I20260709 13:10:14.161849 27641 raft_consensus.cc:2468] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27053d980d04923a3a74669956e168c in term 3.
I20260709 13:10:14.161955 27941 raft_consensus.cc:2804] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.162550 27941 raft_consensus.cc:697] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Becoming Leader. State: Replica: e27053d980d04923a3a74669956e168c, State: Running, Role: LEADER
I20260709 13:10:14.163437 27941 consensus_queue.cc:237] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } }
I20260709 13:10:14.170163 27462 catalog_manager.cc:5697] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c reported cstate change: term changed from 2 to 3, leader changed from aba4e74450e44edf93d6d64c936937d6 (127.26.202.2) to e27053d980d04923a3a74669956e168c (127.26.202.1). New cstate: current_term: 3 leader_uuid: "e27053d980d04923a3a74669956e168c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.397050 27641 raft_consensus.cc:1275] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.398471 27941 consensus_queue.cc:1048] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.409408 27716 raft_consensus.cc:1275] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.411280 27941 consensus_queue.cc:1048] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.411684 27642 raft_consensus.cc:1275] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.415442 27956 consensus_queue.cc:1048] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.428915 27716 raft_consensus.cc:1275] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.430550 27941 consensus_queue.cc:1048] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.501236 27565 raft_consensus.cc:1275] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 5 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:14.503412 27927 consensus_queue.cc:1048] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.514218 27641 raft_consensus.cc:1275] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 5 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:14.516777 27927 consensus_queue.cc:1048] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:14.550379 27641 raft_consensus.cc:1275] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.551677 27964 consensus_queue.cc:1048] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.552052 27716 raft_consensus.cc:1275] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.553285 27941 consensus_queue.cc:1048] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4bd422097eb4ec88f7681a740db6ae3" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.563030 27565 raft_consensus.cc:1275] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Refusing update from remote peer a4bd422097eb4ec88f7681a740db6ae3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.564471 27964 consensus_queue.cc:1048] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27053d980d04923a3a74669956e168c" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.564885 27642 raft_consensus.cc:1275] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Refusing update from remote peer e27053d980d04923a3a74669956e168c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.566329 27956 consensus_queue.cc:1048] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba4e74450e44edf93d6d64c936937d6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.814493 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.820235 27432 tablet_server.cc:179] TabletServer@127.26.202.1:0 shutting down...
I20260709 13:10:14.854651 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:14.855618 27432 tablet_replica.cc:333] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.856606 27432 raft_consensus.cc:2243] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.857314 27432 raft_consensus.cc:2272] T e8958409c0d6450bbbdcb3f154def62c P e27053d980d04923a3a74669956e168c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.860319 27432 tablet_replica.cc:333] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.860996 27432 raft_consensus.cc:2243] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.861476 27432 raft_consensus.cc:2272] T 4df1e8722eec47ecb082c3759244ed8e P e27053d980d04923a3a74669956e168c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.863171 27432 tablet_replica.cc:333] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.863700 27432 raft_consensus.cc:2243] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.864436 27432 raft_consensus.cc:2272] T a1681a4bbbdc4c7281410ec0cd1de69b P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.866627 27432 tablet_replica.cc:333] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.867143 27432 raft_consensus.cc:2243] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.867534 27432 raft_consensus.cc:2272] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.869750 27432 tablet_replica.cc:333] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.870365 27432 raft_consensus.cc:2243] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.871104 27432 raft_consensus.cc:2272] T 6282f8aefbfb4ecabb4528c187b1590c P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.873265 27432 tablet_replica.cc:333] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.873703 27432 raft_consensus.cc:2243] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.874049 27432 raft_consensus.cc:2272] T cb2fdd0e61af473d9d0cbd3334310f2a P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.875573 27432 tablet_replica.cc:333] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.876040 27432 raft_consensus.cc:2243] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.876731 27432 raft_consensus.cc:2272] T bfd058761c7a45e1bf9a46b4c430eb9d P e27053d980d04923a3a74669956e168c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.878877 27432 tablet_replica.cc:333] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.879400 27432 raft_consensus.cc:2243] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.879827 27432 raft_consensus.cc:2272] T 1f83cde8815c483c9a3f62c250fd00ad P e27053d980d04923a3a74669956e168c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.881408 27432 tablet_replica.cc:333] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c: stopping tablet replica
I20260709 13:10:14.881816 27432 raft_consensus.cc:2243] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.882170 27432 raft_consensus.cc:2272] T 2d16b6bae61c4af09a4f9735c5ae249d P e27053d980d04923a3a74669956e168c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.982147 27432 tablet_server.cc:196] TabletServer@127.26.202.1:0 shutdown complete.
I20260709 13:10:15.004591 27432 tablet_server.cc:179] TabletServer@127.26.202.2:0 shutting down...
I20260709 13:10:15.034258 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:15.035053 27432 tablet_replica.cc:333] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.036008 27432 raft_consensus.cc:2243] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.036514 27432 raft_consensus.cc:2272] T a1681a4bbbdc4c7281410ec0cd1de69b P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.039340 27432 tablet_replica.cc:333] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.039870 27432 raft_consensus.cc:2243] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.040287 27432 raft_consensus.cc:2272] T 4df1e8722eec47ecb082c3759244ed8e P aba4e74450e44edf93d6d64c936937d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.041996 27432 tablet_replica.cc:333] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.042546 27432 raft_consensus.cc:2243] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.042927 27432 raft_consensus.cc:2272] T bfd058761c7a45e1bf9a46b4c430eb9d P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.044864 27432 tablet_replica.cc:333] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.045387 27432 raft_consensus.cc:2243] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.045807 27432 raft_consensus.cc:2272] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.047753 27432 tablet_replica.cc:333] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.048247 27432 raft_consensus.cc:2243] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.048640 27432 raft_consensus.cc:2272] T 6282f8aefbfb4ecabb4528c187b1590c P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.050788 27432 tablet_replica.cc:333] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.051266 27432 raft_consensus.cc:2243] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.052453 27432 raft_consensus.cc:2272] T cb2fdd0e61af473d9d0cbd3334310f2a P aba4e74450e44edf93d6d64c936937d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.054397 27432 tablet_replica.cc:333] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.054890 27432 raft_consensus.cc:2243] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.055570 27432 raft_consensus.cc:2272] T 1f83cde8815c483c9a3f62c250fd00ad P aba4e74450e44edf93d6d64c936937d6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.057205 27432 tablet_replica.cc:333] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.057677 27432 raft_consensus.cc:2243] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.058348 27432 raft_consensus.cc:2272] T 2d16b6bae61c4af09a4f9735c5ae249d P aba4e74450e44edf93d6d64c936937d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.059903 27432 tablet_replica.cc:333] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6: stopping tablet replica
I20260709 13:10:15.060387 27432 raft_consensus.cc:2243] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.060771 27432 raft_consensus.cc:2272] T e8958409c0d6450bbbdcb3f154def62c P aba4e74450e44edf93d6d64c936937d6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.090350 27432 tablet_server.cc:196] TabletServer@127.26.202.2:0 shutdown complete.
W20260709 13:10:15.090638 27679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.202.1:37801: connect: Connection refused (error 111)
W20260709 13:10:15.094743 27679 consensus_peers.cc:597] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 -> Peer e27053d980d04923a3a74669956e168c (127.26.202.1:37801): Couldn't send request to peer e27053d980d04923a3a74669956e168c. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:37801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.108421 27432 tablet_server.cc:179] TabletServer@127.26.202.3:0 shutting down...
W20260709 13:10:15.129544 27680 consensus_peers.cc:597] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 -> Peer aba4e74450e44edf93d6d64c936937d6 (127.26.202.2:39121): Couldn't send request to peer aba4e74450e44edf93d6d64c936937d6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:15.140468 27679 consensus_peers.cc:597] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 -> Peer e27053d980d04923a3a74669956e168c (127.26.202.1:37801): Couldn't send request to peer e27053d980d04923a3a74669956e168c. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:37801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.141690 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:15.142551 27432 tablet_replica.cc:333] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
W20260709 13:10:15.143460 27679 consensus_peers.cc:597] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 -> Peer e27053d980d04923a3a74669956e168c (127.26.202.1:37801): Couldn't send request to peer e27053d980d04923a3a74669956e168c. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:37801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.143605 27432 raft_consensus.cc:2243] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.144577 27432 raft_consensus.cc:2272] T 4df1e8722eec47ecb082c3759244ed8e P a4bd422097eb4ec88f7681a740db6ae3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.146426 27432 tablet_replica.cc:333] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
I20260709 13:10:15.146987 27432 raft_consensus.cc:2243] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.147578 27432 raft_consensus.cc:2272] T a1681a4bbbdc4c7281410ec0cd1de69b P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.149667 27432 tablet_replica.cc:333] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
I20260709 13:10:15.150144 27432 raft_consensus.cc:2243] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.150808 27432 raft_consensus.cc:2272] T 6b8c56bc3dd24c5dbd0c6573db7aa2d2 P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.152590 27432 tablet_replica.cc:333] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
I20260709 13:10:15.153154 27432 raft_consensus.cc:2243] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.153522 27432 raft_consensus.cc:2272] T bfd058761c7a45e1bf9a46b4c430eb9d P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.155218 27432 tablet_replica.cc:333] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
I20260709 13:10:15.155659 27432 raft_consensus.cc:2243] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.155977 27432 raft_consensus.cc:2272] T 6282f8aefbfb4ecabb4528c187b1590c P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.157835 27432 tablet_replica.cc:333] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
I20260709 13:10:15.158278 27432 raft_consensus.cc:2243] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.158610 27432 raft_consensus.cc:2272] T cb2fdd0e61af473d9d0cbd3334310f2a P a4bd422097eb4ec88f7681a740db6ae3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.160120 27432 tablet_replica.cc:333] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
I20260709 13:10:15.160625 27432 raft_consensus.cc:2243] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.160969 27432 raft_consensus.cc:2272] T 1f83cde8815c483c9a3f62c250fd00ad P a4bd422097eb4ec88f7681a740db6ae3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.162468 27432 tablet_replica.cc:333] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
I20260709 13:10:15.162849 27432 raft_consensus.cc:2243] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.163208 27432 raft_consensus.cc:2272] T 2d16b6bae61c4af09a4f9735c5ae249d P a4bd422097eb4ec88f7681a740db6ae3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.164661 27432 tablet_replica.cc:333] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3: stopping tablet replica
I20260709 13:10:15.165176 27432 raft_consensus.cc:2243] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.165813 27432 raft_consensus.cc:2272] T e8958409c0d6450bbbdcb3f154def62c P a4bd422097eb4ec88f7681a740db6ae3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.192981 27432 tablet_server.cc:196] TabletServer@127.26.202.3:0 shutdown complete.
I20260709 13:10:15.225652 27432 master.cc:562] Master@127.26.202.62:46781 shutting down...
I20260709 13:10:15.460770 27432 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:15.461411 27432 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.461711 27432 tablet_replica.cc:333] T 00000000000000000000000000000000 P d6da5484e88948e3b51f0856d5b92503: stopping tablet replica
I20260709 13:10:15.483132 27432 master.cc:584] Master@127.26.202.62:46781 shutdown complete.
a4bd422097eb4ec88f7681a740db6ae3  1
aba4e74450e44edf93d6d64c936937d6  4
e27053d980d04923a3a74669956e168c  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14938 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:10:15.526679 27432 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.202.62:45925
I20260709 13:10:15.527832 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:15.534432 27973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.534474 27974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.535310 27976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.536384 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:15.537680 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:15.537861 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:15.538056 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602615538025 us; error 0 us; skew 500 ppm
I20260709 13:10:15.538590 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:15.541416 27432 webserver.cc:533] Webserver started at http://127.26.202.62:33731/ using document root <none> and password file <none>
I20260709 13:10:15.541968 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:15.542150 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:15.542459 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:15.543606 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/master-0-root/instance:
uuid: "3a5fe5a559484ceca80f4bddf62a1fcb"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-008w"
I20260709 13:10:15.549108 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:10:15.554032 27981 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.555188 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:15.555876 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/master-0-root
uuid: "3a5fe5a559484ceca80f4bddf62a1fcb"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-008w"
I20260709 13:10:15.556360 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:15.576170 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:15.577477 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:15.618153 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.62:45925
I20260709 13:10:15.618278 28032 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.62:45925 every 8 connection(s)
I20260709 13:10:15.622232 28033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.632503 28033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb: Bootstrap starting.
I20260709 13:10:15.637645 28033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.642171 28033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb: No bootstrap required, opened a new log
I20260709 13:10:15.644272 28033 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5fe5a559484ceca80f4bddf62a1fcb" member_type: VOTER }
I20260709 13:10:15.644675 28033 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.644861 28033 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a5fe5a559484ceca80f4bddf62a1fcb, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.645363 28033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5fe5a559484ceca80f4bddf62a1fcb" member_type: VOTER }
I20260709 13:10:15.645772 28033 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:15.645958 28033 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:15.646168 28033 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.650063 28033 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5fe5a559484ceca80f4bddf62a1fcb" member_type: VOTER }
I20260709 13:10:15.650527 28033 leader_election.cc:304] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a5fe5a559484ceca80f4bddf62a1fcb; no voters: 
I20260709 13:10:15.651558 28033 leader_election.cc:290] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:15.651943 28036 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.653365 28036 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 1 LEADER]: Becoming Leader. State: Replica: 3a5fe5a559484ceca80f4bddf62a1fcb, State: Running, Role: LEADER
I20260709 13:10:15.654062 28036 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5fe5a559484ceca80f4bddf62a1fcb" member_type: VOTER }
I20260709 13:10:15.654484 28033 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:15.659224 28037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a5fe5a559484ceca80f4bddf62a1fcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5fe5a559484ceca80f4bddf62a1fcb" member_type: VOTER } }
I20260709 13:10:15.659205 28038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a5fe5a559484ceca80f4bddf62a1fcb. Latest consensus state: current_term: 1 leader_uuid: "3a5fe5a559484ceca80f4bddf62a1fcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5fe5a559484ceca80f4bddf62a1fcb" member_type: VOTER } }
I20260709 13:10:15.660199 28037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:15.660245 28038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:15.665570 28043 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:15.670542 28043 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:15.672770 27432 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:15.679513 28043 catalog_manager.cc:1383] Generated new cluster ID: 3a14319f1440458782e8eee4d391c596
I20260709 13:10:15.679844 28043 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:15.693593 28043 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:15.694834 28043 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:15.708549 28043 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb: Generated new TSK 0
I20260709 13:10:15.709386 28043 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:15.739585 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:15.745951 28054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.746981 28055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.748503 28057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.749392 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:15.750277 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:15.750494 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:15.750665 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602615750642 us; error 0 us; skew 500 ppm
I20260709 13:10:15.751159 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:15.753573 27432 webserver.cc:533] Webserver started at http://127.26.202.1:35553/ using document root <none> and password file <none>
I20260709 13:10:15.754077 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:15.754280 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:15.754545 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:15.755632 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-0-root/instance:
uuid: "daf040ae8e6e4c97961e4091eecd217b"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-008w"
I20260709 13:10:15.760471 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:10:15.763860 28062 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.764780 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:15.765193 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "daf040ae8e6e4c97961e4091eecd217b"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-008w"
I20260709 13:10:15.765468 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:15.780813 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:15.782269 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:15.783835 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:15.786387 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:15.786630 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.786888 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:15.787097 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.830363 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:33821
I20260709 13:10:15.830524 28124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:33821 every 8 connection(s)
I20260709 13:10:15.835498 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:15.843937 28129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.845147 28130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.852346 27432 server_base.cc:1061] running on GCE node
W20260709 13:10:15.855646 28132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.857585 28125 heartbeater.cc:344] Connected to a master server at 127.26.202.62:45925
I20260709 13:10:15.857811 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:15.858008 28125 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:15.858137 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:15.858441 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602615858425 us; error 0 us; skew 500 ppm
I20260709 13:10:15.859005 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:15.858940 28125 heartbeater.cc:507] Master 127.26.202.62:45925 requested a full tablet report, sending...
I20260709 13:10:15.861471 27998 ts_manager.cc:194] Registered new tserver with Master: daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821)
I20260709 13:10:15.861794 27432 webserver.cc:533] Webserver started at http://127.26.202.2:35579/ using document root <none> and password file <none>
I20260709 13:10:15.862526 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:15.862818 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:15.863159 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:15.864163 27998 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55010
I20260709 13:10:15.864820 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-1-root/instance:
uuid: "902d2150c00848cfa7a0678a216cdccd"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-008w"
I20260709 13:10:15.870227 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:10:15.873977 28137 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.875204 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:15.875758 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-1-root
uuid: "902d2150c00848cfa7a0678a216cdccd"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-008w"
I20260709 13:10:15.876047 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:15.900890 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:15.902138 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:15.903644 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:15.905931 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:15.906174 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.906420 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:15.906591 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.952419 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.2:32829
I20260709 13:10:15.952541 28199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.2:32829 every 8 connection(s)
I20260709 13:10:15.957917 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:15.966080 28204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.966094 28203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.969761 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:15.970248 28200 heartbeater.cc:344] Connected to a master server at 127.26.202.62:45925
I20260709 13:10:15.970595 28200 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:15.970568 28206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.971639 28200 heartbeater.cc:507] Master 127.26.202.62:45925 requested a full tablet report, sending...
I20260709 13:10:15.971699 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:15.971987 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:15.972179 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602615972159 us; error 0 us; skew 500 ppm
I20260709 13:10:15.972754 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:15.974371 27998 ts_manager.cc:194] Registered new tserver with Master: 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:15.975435 27432 webserver.cc:533] Webserver started at http://127.26.202.3:37251/ using document root <none> and password file <none>
I20260709 13:10:15.975921 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:15.975917 27998 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55022
I20260709 13:10:15.976207 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:15.976560 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:15.977890 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-2-root/instance:
uuid: "f7a25393f941485683305e8565b68c1e"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-008w"
I20260709 13:10:15.982388 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:15.986049 28211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.986979 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:10:15.987248 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-2-root
uuid: "f7a25393f941485683305e8565b68c1e"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-008w"
I20260709 13:10:15.987495 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602600408833-27432-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:16.017727 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:16.018862 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:16.020330 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:16.022758 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:16.022941 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:16.023257 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:16.023416 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:16.066236 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.3:45761
I20260709 13:10:16.066373 28273 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.3:45761 every 8 connection(s)
I20260709 13:10:16.081173 28274 heartbeater.cc:344] Connected to a master server at 127.26.202.62:45925
I20260709 13:10:16.081615 28274 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:16.082454 28274 heartbeater.cc:507] Master 127.26.202.62:45925 requested a full tablet report, sending...
I20260709 13:10:16.084549 27998 ts_manager.cc:194] Registered new tserver with Master: f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.085137 27432 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01514869s
I20260709 13:10:16.086086 27998 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55030
I20260709 13:10:16.111588 27998 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55046:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:16.114645 27998 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:16.189713 28165 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0f6ecbe6494aeba49e952004f26d5f (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:16.191273 28165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0f6ecbe6494aeba49e952004f26d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.192457 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4e729927824e469a1801236a925d07 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:16.194018 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4e729927824e469a1801236a925d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.196533 28090 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0f6ecbe6494aeba49e952004f26d5f (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:16.198077 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0f6ecbe6494aeba49e952004f26d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.198740 28087 tablet_service.cc:1511] Processing CreateTablet for tablet 409ca5efa2814111a9b9253b0a9737cf (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:16.200275 28087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409ca5efa2814111a9b9253b0a9737cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.203048 28163 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4e6625af2f4a61ac35726996130288 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:16.203483 28088 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4e6625af2f4a61ac35726996130288 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:16.204618 28163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4e6625af2f4a61ac35726996130288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.206429 28089 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4e729927824e469a1801236a925d07 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:16.208714 28088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4e6625af2f4a61ac35726996130288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.210737 28162 tablet_service.cc:1511] Processing CreateTablet for tablet 409ca5efa2814111a9b9253b0a9737cf (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:16.212613 28162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409ca5efa2814111a9b9253b0a9737cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.213383 28089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4e729927824e469a1801236a925d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.218029 28289 tablet_bootstrap.cc:492] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.242864 28163 tablet_service.cc:1511] Processing CreateTablet for tablet e4f1195d08a94750b4f48dc0f64380ca (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:16.244279 28163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f1195d08a94750b4f48dc0f64380ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.244177 28086 tablet_service.cc:1511] Processing CreateTablet for tablet e4f1195d08a94750b4f48dc0f64380ca (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:16.245808 28086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f1195d08a94750b4f48dc0f64380ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.249528 28088 tablet_service.cc:1511] Processing CreateTablet for tablet fb91a46e19b74da399aac13c512d1546 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:16.250872 28165 tablet_service.cc:1511] Processing CreateTablet for tablet fb91a46e19b74da399aac13c512d1546 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:16.266034 28165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb91a46e19b74da399aac13c512d1546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.266757 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 46ae2a73cdb74a7fbfb51323802b09af (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:16.268263 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ae2a73cdb74a7fbfb51323802b09af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.268148 28234 tablet_service.cc:1511] Processing CreateTablet for tablet fb91a46e19b74da399aac13c512d1546 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:16.252035 28290 tablet_bootstrap.cc:492] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.270057 28234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb91a46e19b74da399aac13c512d1546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.252568 28289 tablet_bootstrap.cc:654] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.252327 28239 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0f6ecbe6494aeba49e952004f26d5f (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:16.274549 28239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0f6ecbe6494aeba49e952004f26d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.255189 28238 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4e729927824e469a1801236a925d07 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:16.277912 28238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4e729927824e469a1801236a925d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.279745 28163 tablet_service.cc:1511] Processing CreateTablet for tablet a1b18b3a459c47d1b67f344cf02d126b (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:16.257786 28237 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4e6625af2f4a61ac35726996130288 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:16.281226 28163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b18b3a459c47d1b67f344cf02d126b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.282021 28237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4e6625af2f4a61ac35726996130288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.259301 28161 tablet_service.cc:1511] Processing CreateTablet for tablet 59374436d3444d38b88af758d517398c (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:16.284996 28161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59374436d3444d38b88af758d517398c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.286022 28290 tablet_bootstrap.cc:654] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.260473 28236 tablet_service.cc:1511] Processing CreateTablet for tablet 409ca5efa2814111a9b9253b0a9737cf (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:16.290164 28236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409ca5efa2814111a9b9253b0a9737cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.291837 28088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb91a46e19b74da399aac13c512d1546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.262722 28162 tablet_service.cc:1511] Processing CreateTablet for tablet f7fabafc658f4e4e8049b5d1b2d3d983 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:16.263129 28235 tablet_service.cc:1511] Processing CreateTablet for tablet e4f1195d08a94750b4f48dc0f64380ca (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:16.294217 28235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f1195d08a94750b4f48dc0f64380ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.297833 28162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fabafc658f4e4e8049b5d1b2d3d983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.316123 28233 tablet_service.cc:1511] Processing CreateTablet for tablet 59374436d3444d38b88af758d517398c (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:16.318125 28233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59374436d3444d38b88af758d517398c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.326192 28088 tablet_service.cc:1511] Processing CreateTablet for tablet 59374436d3444d38b88af758d517398c (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:16.328125 28088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59374436d3444d38b88af758d517398c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.331369 28087 tablet_service.cc:1511] Processing CreateTablet for tablet f7fabafc658f4e4e8049b5d1b2d3d983 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:16.332715 28087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fabafc658f4e4e8049b5d1b2d3d983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.336098 28232 tablet_service.cc:1511] Processing CreateTablet for tablet f7fabafc658f4e4e8049b5d1b2d3d983 (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:16.338981 28086 tablet_service.cc:1511] Processing CreateTablet for tablet 46ae2a73cdb74a7fbfb51323802b09af (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:16.340338 28086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ae2a73cdb74a7fbfb51323802b09af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.344036 28231 tablet_service.cc:1511] Processing CreateTablet for tablet 46ae2a73cdb74a7fbfb51323802b09af (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:16.347824 28089 tablet_service.cc:1511] Processing CreateTablet for tablet a1b18b3a459c47d1b67f344cf02d126b (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:16.349288 28089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b18b3a459c47d1b67f344cf02d126b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.350023 28231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ae2a73cdb74a7fbfb51323802b09af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.356426 28232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fabafc658f4e4e8049b5d1b2d3d983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.363593 28230 tablet_service.cc:1511] Processing CreateTablet for tablet a1b18b3a459c47d1b67f344cf02d126b (DEFAULT_TABLE table=test-workload [id=77ac2947fbe2412fab16a849c7a0ccc5]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:16.364974 28230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1b18b3a459c47d1b67f344cf02d126b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.366506 28289 tablet_bootstrap.cc:492] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:16.367049 28289 ts_tablet_manager.cc:1403] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.149s	user 0.004s	sys 0.015s
I20260709 13:10:16.369992 28289 raft_consensus.cc:359] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.370797 28289 raft_consensus.cc:385] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.371143 28289 raft_consensus.cc:740] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.371996 28289 consensus_queue.cc:260] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.376776 28293 tablet_bootstrap.cc:492] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:16.382058 28290 tablet_bootstrap.cc:492] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.382603 28290 ts_tablet_manager.cc:1403] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.154s	user 0.033s	sys 0.020s
I20260709 13:10:16.385546 28290 raft_consensus.cc:359] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.386366 28200 heartbeater.cc:499] Master 127.26.202.62:45925 was elected leader, sending a full tablet report...
I20260709 13:10:16.386590 28290 raft_consensus.cc:385] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.386962 28290 raft_consensus.cc:740] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.387809 28289 ts_tablet_manager.cc:1434] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 13:10:16.387864 28290 consensus_queue.cc:260] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.388852 28289 tablet_bootstrap.cc:492] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.395500 28290 ts_tablet_manager.cc:1434] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.006s
I20260709 13:10:16.395560 28289 tablet_bootstrap.cc:654] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.399330 28125 heartbeater.cc:499] Master 127.26.202.62:45925 was elected leader, sending a full tablet report...
I20260709 13:10:16.402779 28290 tablet_bootstrap.cc:492] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.411041 28290 tablet_bootstrap.cc:654] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.404946 28293 tablet_bootstrap.cc:654] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.416975 28289 tablet_bootstrap.cc:492] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:16.417500 28289 ts_tablet_manager.cc:1403] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.006s
I20260709 13:10:16.420271 28289 raft_consensus.cc:359] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.421053 28289 raft_consensus.cc:385] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.421360 28289 raft_consensus.cc:740] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.423117 28289 consensus_queue.cc:260] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.424256 28293 tablet_bootstrap.cc:492] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:16.424765 28293 ts_tablet_manager.cc:1403] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.003s
I20260709 13:10:16.425902 28289 ts_tablet_manager.cc:1434] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:16.426975 28289 tablet_bootstrap.cc:492] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.427554 28290 tablet_bootstrap.cc:492] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.428117 28290 ts_tablet_manager.cc:1403] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.001s
I20260709 13:10:16.427850 28293 raft_consensus.cc:359] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.428747 28293 raft_consensus.cc:385] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.429306 28293 raft_consensus.cc:740] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.430353 28293 consensus_queue.cc:260] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.431614 28290 raft_consensus.cc:359] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.432478 28290 raft_consensus.cc:385] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.432860 28290 raft_consensus.cc:740] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.434015 28289 tablet_bootstrap.cc:654] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.433743 28290 consensus_queue.cc:260] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.436328 28290 ts_tablet_manager.cc:1434] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:10:16.437529 28290 tablet_bootstrap.cc:492] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.442307 28294 raft_consensus.cc:493] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.442866 28294 raft_consensus.cc:515] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.445248 28290 tablet_bootstrap.cc:654] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.445813 28294 leader_election.cc:290] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.452811 28274 heartbeater.cc:499] Master 127.26.202.62:45925 was elected leader, sending a full tablet report...
I20260709 13:10:16.453496 28293 ts_tablet_manager.cc:1434] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.028s	user 0.020s	sys 0.008s
I20260709 13:10:16.454542 28293 tablet_bootstrap.cc:492] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:16.461946 28293 tablet_bootstrap.cc:654] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.480749 28289 tablet_bootstrap.cc:492] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:16.481695 28289 ts_tablet_manager.cc:1403] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.004s
I20260709 13:10:16.487473 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4e6625af2f4a61ac35726996130288" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b" is_pre_election: true
I20260709 13:10:16.488497 28100 raft_consensus.cc:2468] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 0.
I20260709 13:10:16.490656 28289 raft_consensus.cc:359] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.491472 28289 raft_consensus.cc:385] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.491863 28289 raft_consensus.cc:740] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.492782 28290 tablet_bootstrap.cc:492] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.493360 28290 ts_tablet_manager.cc:1403] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.036s
I20260709 13:10:16.493122 28293 tablet_bootstrap.cc:492] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:16.495687 28293 ts_tablet_manager.cc:1403] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.041s	user 0.029s	sys 0.009s
I20260709 13:10:16.496510 28290 raft_consensus.cc:359] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.497351 28290 raft_consensus.cc:385] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.497741 28290 raft_consensus.cc:740] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.492774 28289 consensus_queue.cc:260] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.497143 28139 leader_election.cc:304] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:16.498525 28293 raft_consensus.cc:359] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.499253 28293 raft_consensus.cc:385] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.498811 28290 consensus_queue.cc:260] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.499563 28293 raft_consensus.cc:740] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.500344 28293 consensus_queue.cc:260] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.501467 28290 ts_tablet_manager.cc:1434] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:16.502637 28293 ts_tablet_manager.cc:1434] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:16.502517 28290 tablet_bootstrap.cc:492] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.503800 28293 tablet_bootstrap.cc:492] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:16.507815 28294 raft_consensus.cc:2804] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.508260 28294 raft_consensus.cc:493] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.508641 28294 raft_consensus.cc:3060] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.509809 28293 tablet_bootstrap.cc:654] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.510003 28290 tablet_bootstrap.cc:654] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.514976 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4e6625af2f4a61ac35726996130288" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
W20260709 13:10:16.516800 28139 leader_election.cc:343] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7a25393f941485683305e8565b68c1e (127.26.202.3:45761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.519726 28289 ts_tablet_manager.cc:1434] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:10:16.523413 28294 raft_consensus.cc:515] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.536475 28289 tablet_bootstrap.cc:492] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.543083 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4e6625af2f4a61ac35726996130288" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:16.543807 28100 raft_consensus.cc:3060] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.545435 28290 tablet_bootstrap.cc:492] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.545559 28289 tablet_bootstrap.cc:654] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.546059 28290 ts_tablet_manager.cc:1403] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.025s
I20260709 13:10:16.546299 28293 tablet_bootstrap.cc:492] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:16.546912 28293 ts_tablet_manager.cc:1403] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.016s
I20260709 13:10:16.549396 28290 raft_consensus.cc:359] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.550310 28290 raft_consensus.cc:385] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.550810 28290 raft_consensus.cc:740] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.550312 28293 raft_consensus.cc:359] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.552668 28100 raft_consensus.cc:2468] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 1.
I20260709 13:10:16.552973 28293 raft_consensus.cc:385] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.553529 28293 raft_consensus.cc:740] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.554749 28139 leader_election.cc:304] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:16.554688 28293 consensus_queue.cc:260] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.556540 28290 consensus_queue.cc:260] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.559549 28308 raft_consensus.cc:493] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.560115 28290 ts_tablet_manager.cc:1434] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:16.560071 28308 raft_consensus.cc:515] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.561712 28290 tablet_bootstrap.cc:492] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.562402 28308 leader_election.cc:290] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.562994 28308 raft_consensus.cc:2804] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.563429 28308 raft_consensus.cc:697] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:16.564390 28308 consensus_queue.cc:237] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.571628 28293 ts_tablet_manager.cc:1434] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:10:16.572875 28293 tablet_bootstrap.cc:492] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:16.586325 28293 tablet_bootstrap.cc:654] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.586566 27998 catalog_manager.cc:5697] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 0 to 1, leader changed from <none> to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 1 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.591182 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4e6625af2f4a61ac35726996130288" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:16.592025 28290 tablet_bootstrap.cc:654] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.603628 28099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0f6ecbe6494aeba49e952004f26d5f" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b" is_pre_election: true
I20260709 13:10:16.604398 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0f6ecbe6494aeba49e952004f26d5f" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:16.604645 28099 raft_consensus.cc:2468] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 0.
I20260709 13:10:16.605309 28249 raft_consensus.cc:2468] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 0.
I20260709 13:10:16.607275 28139 leader_election.cc:304] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:16.608366 28308 raft_consensus.cc:2804] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:16.608498 28139 leader_election.cc:343] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f7a25393f941485683305e8565b68c1e (127.26.202.3:45761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.608775 28308 raft_consensus.cc:493] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.609187 28308 raft_consensus.cc:3060] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.557803 28294 leader_election.cc:290] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.613821 28293 tablet_bootstrap.cc:492] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:16.614423 28293 ts_tablet_manager.cc:1403] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.003s
I20260709 13:10:16.615460 28290 tablet_bootstrap.cc:492] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.615734 28289 tablet_bootstrap.cc:492] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:16.616052 28290 ts_tablet_manager.cc:1403] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.007s
I20260709 13:10:16.616232 28289 ts_tablet_manager.cc:1403] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.080s	user 0.029s	sys 0.038s
I20260709 13:10:16.617262 28308 raft_consensus.cc:515] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.617447 28293 raft_consensus.cc:359] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.618327 28293 raft_consensus.cc:385] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.618655 28293 raft_consensus.cc:740] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.619395 28289 raft_consensus.cc:359] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.619558 28293 consensus_queue.cc:260] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.620180 28289 raft_consensus.cc:385] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.619699 28290 raft_consensus.cc:359] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.620442 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0f6ecbe6494aeba49e952004f26d5f" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:16.620785 28290 raft_consensus.cc:385] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.620638 28289 raft_consensus.cc:740] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.621349 28100 raft_consensus.cc:3060] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.621749 28308 leader_election.cc:290] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.622560 28289 consensus_queue.cc:260] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.623088 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0f6ecbe6494aeba49e952004f26d5f" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:16.623682 28249 raft_consensus.cc:3060] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.625260 28289 ts_tablet_manager.cc:1434] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:10:16.628710 28100 raft_consensus.cc:2468] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 1.
I20260709 13:10:16.629710 28289 tablet_bootstrap.cc:492] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.621347 28290 raft_consensus.cc:740] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.630221 28139 leader_election.cc:304] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:16.631197 28308 raft_consensus.cc:2804] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.630803 28290 consensus_queue.cc:260] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.631994 28308 raft_consensus.cc:697] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:16.633050 28308 consensus_queue.cc:237] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.633996 28293 ts_tablet_manager.cc:1434] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:10:16.636211 28290 ts_tablet_manager.cc:1434] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:10:16.637315 28290 tablet_bootstrap.cc:492] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.637614 28289 tablet_bootstrap.cc:654] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.639683 28293 tablet_bootstrap.cc:492] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:16.643117 28295 raft_consensus.cc:493] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.643610 28295 raft_consensus.cc:515] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.645193 28249 raft_consensus.cc:2468] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 1.
I20260709 13:10:16.648521 28295 leader_election.cc:290] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.655488 28293 tablet_bootstrap.cc:654] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.661139 28290 tablet_bootstrap.cc:654] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.668284 28289 tablet_bootstrap.cc:492] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
W20260709 13:10:16.668751 28046 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:16.668901 28289 ts_tablet_manager.cc:1403] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.016s
I20260709 13:10:16.672658 28290 tablet_bootstrap.cc:492] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.672444 28289 raft_consensus.cc:359] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.673236 28290 ts_tablet_manager.cc:1403] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 13:10:16.673318 28289 raft_consensus.cc:385] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.673748 28289 raft_consensus.cc:740] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.674927 28289 consensus_queue.cc:260] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.678335 28289 ts_tablet_manager.cc:1434] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:16.679462 28289 tablet_bootstrap.cc:492] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.681795 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:16.682549 28249 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:16.683761 28064 leader_election.cc:304] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:16.684460 28299 raft_consensus.cc:493] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.684707 28295 raft_consensus.cc:2804] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.685202 28295 raft_consensus.cc:493] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.676748 28290 raft_consensus.cc:359] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.685614 28295 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.685472 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd" is_pre_election: true
I20260709 13:10:16.686189 28175 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:16.687744 28293 tablet_bootstrap.cc:492] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:16.688287 28293 ts_tablet_manager.cc:1403] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.011s
I20260709 13:10:16.684945 28299 raft_consensus.cc:515] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.690392 28289 tablet_bootstrap.cc:654] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.691716 28293 raft_consensus.cc:359] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.692560 28293 raft_consensus.cc:385] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.692896 28293 raft_consensus.cc:740] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.692943 28295 raft_consensus.cc:515] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.693783 28290 raft_consensus.cc:385] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.683918 27998 catalog_manager.cc:5697] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 0 to 1, leader changed from <none> to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 1 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.695214 28295 leader_election.cc:290] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.696314 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:16.696808 28175 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.697108 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:16.697991 28249 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.701685 28299 leader_election.cc:290] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:16.701957 28175 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:16.701961 28293 consensus_queue.cc:260] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.703035 28308 raft_consensus.cc:493] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.694195 28290 raft_consensus.cc:740] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.704698 28290 consensus_queue.cc:260] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.705694 28293 ts_tablet_manager.cc:1434] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.009s
I20260709 13:10:16.706043 28063 leader_election.cc:304] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:16.703522 28308 raft_consensus.cc:515] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.710304 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4e729927824e469a1801236a925d07" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b" is_pre_election: true
I20260709 13:10:16.711167 28100 raft_consensus.cc:2468] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 0.
I20260709 13:10:16.716626 28139 leader_election.cc:304] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:16.717075 28249 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:16.717666 28307 raft_consensus.cc:2804] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.718079 28307 raft_consensus.cc:493] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.718402 28307 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.725759 28293 tablet_bootstrap.cc:492] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:16.727190 28308 leader_election.cc:290] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.731495 28307 raft_consensus.cc:515] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.734627 28295 raft_consensus.cc:493] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.735284 28295 raft_consensus.cc:515] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.738860 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4e729927824e469a1801236a925d07" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:16.739734 28249 raft_consensus.cc:2468] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 0.
I20260709 13:10:16.741958 28289 tablet_bootstrap.cc:492] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:16.742507 28289 ts_tablet_manager.cc:1403] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.007s
I20260709 13:10:16.742763 28323 raft_consensus.cc:493] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.743295 28323 raft_consensus.cc:515] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.743762 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd" is_pre_election: true
I20260709 13:10:16.744696 28175 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:16.745992 28289 raft_consensus.cc:359] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.746635 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd" is_pre_election: true
I20260709 13:10:16.747047 28289 raft_consensus.cc:385] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.747399 28289 raft_consensus.cc:740] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.748054 28063 leader_election.cc:304] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:16.748279 28289 consensus_queue.cc:260] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
W20260709 13:10:16.749182 28063 leader_election.cc:343] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.750662 28322 raft_consensus.cc:2804] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.750896 28289 ts_tablet_manager.cc:1434] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:10:16.751910 28289 tablet_bootstrap.cc:492] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.756032 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd" is_pre_election: true
I20260709 13:10:16.756723 28323 leader_election.cc:290] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.757283 28323 raft_consensus.cc:2804] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.757614 28323 raft_consensus.cc:493] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.757949 28323 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.758119 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:16.758843 28248 raft_consensus.cc:2468] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:16.760210 28064 leader_election.cc:304] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 902d2150c00848cfa7a0678a216cdccd
I20260709 13:10:16.761323 28293 tablet_bootstrap.cc:654] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:16.761981 28212 leader_election.cc:343] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.766782 28307 leader_election.cc:290] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.769227 28295 leader_election.cc:290] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.770144 28295 raft_consensus.cc:2804] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.770612 28295 raft_consensus.cc:493] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.771049 28295 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.771492 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4e729927824e469a1801236a925d07" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:16.772297 28100 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.774001 28289 tablet_bootstrap.cc:654] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.776796 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:16.778344 28248 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:16.778611 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4e729927824e469a1801236a925d07" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:16.783042 28249 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.788058 28099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b" is_pre_election: true
I20260709 13:10:16.791934 28323 raft_consensus.cc:515] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.793864 28322 raft_consensus.cc:697] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:16.794307 28307 raft_consensus.cc:493] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.794797 28322 consensus_queue.cc:237] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.794943 28307 raft_consensus.cc:515] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.795888 28295 raft_consensus.cc:515] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.797237 28099 raft_consensus.cc:2393] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7a25393f941485683305e8565b68c1e in current term 1: Already voted for candidate daf040ae8e6e4c97961e4091eecd217b in this term.
I20260709 13:10:16.798053 28295 leader_election.cc:290] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.798866 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:16.799566 28323 leader_election.cc:290] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
W20260709 13:10:16.800529 28063 leader_election.cc:343] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.801196 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:16.801697 28174 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.802805 28307 leader_election.cc:290] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.803503 28290 ts_tablet_manager.cc:1434] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.130s	user 0.032s	sys 0.027s
I20260709 13:10:16.804008 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:16.804554 28290 tablet_bootstrap.cc:492] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
W20260709 13:10:16.805578 28139 leader_election.cc:343] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7a25393f941485683305e8565b68c1e (127.26.202.3:45761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.806545 28100 raft_consensus.cc:2468] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 1.
I20260709 13:10:16.810496 28289 tablet_bootstrap.cc:492] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:16.811097 28289 ts_tablet_manager.cc:1403] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.059s	user 0.003s	sys 0.011s
I20260709 13:10:16.810997 28213 leader_election.cc:304] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7a25393f941485683305e8565b68c1e; no voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:16.811702 28249 raft_consensus.cc:2468] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 1.
I20260709 13:10:16.812301 28299 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.812883 28290 tablet_bootstrap.cc:654] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.814756 28289 raft_consensus.cc:359] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.815563 28289 raft_consensus.cc:385] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.815927 28289 raft_consensus.cc:740] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.816710 28289 consensus_queue.cc:260] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.818168 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:16.818337 28139 leader_election.cc:304] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:16.818745 28248 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.822144 28299 raft_consensus.cc:2749] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.823083 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:16.826040 28307 raft_consensus.cc:2804] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.826354 28290 tablet_bootstrap.cc:492] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.826300 28248 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:16.827018 28290 ts_tablet_manager.cc:1403] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 13:10:16.827310 28307 raft_consensus.cc:697] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:16.827880 28064 leader_election.cc:304] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:16.828794 28321 raft_consensus.cc:2804] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.829308 28321 raft_consensus.cc:697] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:16.830276 28289 ts_tablet_manager.cc:1434] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:10:16.808784 28174 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:16.830341 28290 raft_consensus.cc:359] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.831200 28290 raft_consensus.cc:385] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.828176 28307 consensus_queue.cc:237] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.831524 28290 raft_consensus.cc:740] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.831748 28289 tablet_bootstrap.cc:492] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.830271 28321 consensus_queue.cc:237] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.832559 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b" is_pre_election: true
I20260709 13:10:16.832366 28290 consensus_queue.cc:260] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
W20260709 13:10:16.834144 28139 leader_election.cc:343] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.834575 28139 leader_election.cc:304] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd; no voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e
I20260709 13:10:16.835129 28249 raft_consensus.cc:2468] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:16.835253 28290 ts_tablet_manager.cc:1434] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:10:16.837059 28308 raft_consensus.cc:2749] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.838236 28064 leader_election.cc:304] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 902d2150c00848cfa7a0678a216cdccd
I20260709 13:10:16.839215 28290 tablet_bootstrap.cc:492] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.839372 28323 raft_consensus.cc:2804] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.840178 28323 raft_consensus.cc:697] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:16.841064 28323 consensus_queue.cc:237] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.845158 27998 catalog_manager.cc:5697] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 0 to 1, leader changed from <none> to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 1 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.846331 28290 tablet_bootstrap.cc:654] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.846410 28289 tablet_bootstrap.cc:654] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.841751 28293 tablet_bootstrap.cc:492] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:16.864750 28293 ts_tablet_manager.cc:1403] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.139s	user 0.006s	sys 0.011s
I20260709 13:10:16.880621 27998 catalog_manager.cc:5697] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 0 to 1, leader changed from <none> to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 1 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.889858 28293 raft_consensus.cc:359] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.893565 28293 raft_consensus.cc:385] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.894028 28293 raft_consensus.cc:740] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.899245 28293 consensus_queue.cc:260] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.901063 28290 tablet_bootstrap.cc:492] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.901533 28290 ts_tablet_manager.cc:1403] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.033s
I20260709 13:10:16.901690 28293 ts_tablet_manager.cc:1434] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:10:16.904243 28290 raft_consensus.cc:359] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.904702 28289 tablet_bootstrap.cc:492] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:16.904979 28290 raft_consensus.cc:385] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.905331 28290 raft_consensus.cc:740] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.905438 28289 ts_tablet_manager.cc:1403] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.037s
I20260709 13:10:16.904610 27996 catalog_manager.cc:5697] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 0 to 1, leader changed from <none> to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 1 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.906045 28290 consensus_queue.cc:260] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.907125 28293 tablet_bootstrap.cc:492] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:16.908252 28290 ts_tablet_manager.cc:1434] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:10:16.909186 28290 tablet_bootstrap.cc:492] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.911823 27996 catalog_manager.cc:5697] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 0 to 1, leader changed from <none> to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 1 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.912740 28289 raft_consensus.cc:359] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.913651 28289 raft_consensus.cc:385] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.913985 28293 tablet_bootstrap.cc:654] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.914041 28289 raft_consensus.cc:740] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.914768 28290 tablet_bootstrap.cc:654] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.915228 28289 consensus_queue.cc:260] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.918743 28289 ts_tablet_manager.cc:1434] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:16.920030 28289 tablet_bootstrap.cc:492] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.934262 28289 tablet_bootstrap.cc:654] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.936393 28293 tablet_bootstrap.cc:492] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:16.937036 28293 ts_tablet_manager.cc:1403] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.006s
I20260709 13:10:16.939107 28290 tablet_bootstrap.cc:492] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:16.939635 28290 ts_tablet_manager.cc:1403] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.020s
I20260709 13:10:16.940716 28293 raft_consensus.cc:359] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.941720 28293 raft_consensus.cc:385] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.942121 28293 raft_consensus.cc:740] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.942795 28290 raft_consensus.cc:359] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.943619 28290 raft_consensus.cc:385] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.944016 28290 raft_consensus.cc:740] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.943802 28293 consensus_queue.cc:260] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.945124 28290 consensus_queue.cc:260] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.945644 28289 tablet_bootstrap.cc:492] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:16.946343 28289 ts_tablet_manager.cc:1403] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.001s
I20260709 13:10:16.946807 28293 ts_tablet_manager.cc:1434] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:10:16.947840 28290 ts_tablet_manager.cc:1434] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:16.948906 28290 tablet_bootstrap.cc:492] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b: Bootstrap starting.
I20260709 13:10:16.949244 28289 raft_consensus.cc:359] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.949999 28289 raft_consensus.cc:385] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.950309 28289 raft_consensus.cc:740] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.947923 28293 tablet_bootstrap.cc:492] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:16.951442 28289 consensus_queue.cc:260] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.954171 28289 ts_tablet_manager.cc:1434] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:16.955201 28289 tablet_bootstrap.cc:492] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd: Bootstrap starting.
I20260709 13:10:16.955283 28290 tablet_bootstrap.cc:654] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.959810 28293 tablet_bootstrap.cc:654] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.960350 28323 raft_consensus.cc:493] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.960934 28323 raft_consensus.cc:515] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.963413 28323 leader_election.cc:290] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:16.965170 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b18b3a459c47d1b67f344cf02d126b" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd" is_pre_election: true
I20260709 13:10:16.965900 28174 raft_consensus.cc:2468] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:16.967051 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b18b3a459c47d1b67f344cf02d126b" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:16.967756 28249 raft_consensus.cc:2468] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:16.968669 28248 raft_consensus.cc:3060] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.969590 28063 leader_election.cc:304] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:16.971019 28323 raft_consensus.cc:2804] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.971417 28323 raft_consensus.cc:493] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.971793 28323 raft_consensus.cc:3060] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.977869 28307 consensus_queue.cc:1048] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.983378 28323 raft_consensus.cc:515] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:16.986639 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b18b3a459c47d1b67f344cf02d126b" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:16.987273 28174 raft_consensus.cc:3060] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.988052 28307 consensus_queue.cc:1048] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.001358 28174 raft_consensus.cc:2468] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:17.002717 28063 leader_election.cc:304] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:17.003682 28289 tablet_bootstrap.cc:654] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.003576 28321 raft_consensus.cc:2804] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.004138 28321 raft_consensus.cc:697] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.005079 28321 consensus_queue.cc:237] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.015213 28323 leader_election.cc:290] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.022686 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b18b3a459c47d1b67f344cf02d126b" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.023415 28248 raft_consensus.cc:3060] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.025846 28290 tablet_bootstrap.cc:492] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b: No bootstrap required, opened a new log
I20260709 13:10:17.026373 28290 ts_tablet_manager.cc:1403] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b: Time spent bootstrapping tablet: real 0.078s	user 0.026s	sys 0.043s
I20260709 13:10:17.029109 28293 tablet_bootstrap.cc:492] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:17.029721 28293 ts_tablet_manager.cc:1403] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.082s	user 0.025s	sys 0.021s
I20260709 13:10:17.032915 28290 raft_consensus.cc:359] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.033731 28290 raft_consensus.cc:385] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.034044 28290 raft_consensus.cc:740] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.034834 28290 consensus_queue.cc:260] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.036123 28293 raft_consensus.cc:359] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.036924 28290 ts_tablet_manager.cc:1434] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:10:17.038527 28293 raft_consensus.cc:385] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.038888 28293 raft_consensus.cc:740] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.038118 27997 catalog_manager.cc:5697] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 0 to 1, leader changed from <none> to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 1 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.039589 28293 consensus_queue.cc:260] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.041370 28293 ts_tablet_manager.cc:1434] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:10:17.042114 28293 tablet_bootstrap.cc:492] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:17.051129 28293 tablet_bootstrap.cc:654] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.056672 28293 tablet_bootstrap.cc:492] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:17.057488 28293 ts_tablet_manager.cc:1403] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 13:10:17.059316 28248 raft_consensus.cc:2468] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:17.060365 28293 raft_consensus.cc:359] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.061167 28293 raft_consensus.cc:385] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.061483 28293 raft_consensus.cc:740] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.061587 28289 tablet_bootstrap.cc:492] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd: No bootstrap required, opened a new log
I20260709 13:10:17.062145 28289 ts_tablet_manager.cc:1403] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.021s
I20260709 13:10:17.062549 28293 consensus_queue.cc:260] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.064858 28293 ts_tablet_manager.cc:1434] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:10:17.064903 28289 raft_consensus.cc:359] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.065781 28289 raft_consensus.cc:385] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.066149 28293 tablet_bootstrap.cc:492] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e: Bootstrap starting.
I20260709 13:10:17.066059 28289 raft_consensus.cc:740] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.066905 28289 consensus_queue.cc:260] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.069799 28289 ts_tablet_manager.cc:1434] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:17.073462 28293 tablet_bootstrap.cc:654] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.072898 28307 consensus_queue.cc:1048] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:17.082261 28293 tablet_bootstrap.cc:492] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e: No bootstrap required, opened a new log
I20260709 13:10:17.083001 28293 ts_tablet_manager.cc:1403] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:10:17.086313 28293 raft_consensus.cc:359] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.087077 28293 raft_consensus.cc:385] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.087404 28293 raft_consensus.cc:740] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.088227 28293 consensus_queue.cc:260] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.091121 28293 ts_tablet_manager.cc:1434] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:17.099697 28308 consensus_queue.cc:1048] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.114655 28321 raft_consensus.cc:493] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.115208 28321 raft_consensus.cc:515] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.116971 28321 leader_election.cc:290] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.117935 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd" is_pre_election: true
I20260709 13:10:17.118073 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:17.118494 28174 raft_consensus.cc:2468] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:17.118726 28248 raft_consensus.cc:2468] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:17.119583 28063 leader_election.cc:304] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:17.120240 28321 raft_consensus.cc:2804] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.120565 28321 raft_consensus.cc:493] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.120884 28321 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.126085 28321 raft_consensus.cc:515] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.127827 28321 leader_election.cc:290] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.128638 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:17.128901 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.129189 28174 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.129536 28248 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.133982 28248 raft_consensus.cc:2468] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:17.134368 28174 raft_consensus.cc:2468] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:17.135219 28308 raft_consensus.cc:493] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.135102 28064 leader_election.cc:304] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:17.135980 28321 raft_consensus.cc:2804] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.135689 28308 raft_consensus.cc:515] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.136467 28321 raft_consensus.cc:697] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.137288 28321 consensus_queue.cc:237] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.137719 28308 leader_election.cc:290] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.138558 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b" is_pre_election: true
I20260709 13:10:17.138965 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:17.139765 28248 raft_consensus.cc:2393] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 902d2150c00848cfa7a0678a216cdccd in current term 1: Already voted for candidate daf040ae8e6e4c97961e4091eecd217b in this term.
I20260709 13:10:17.140856 28139 leader_election.cc:304] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd; no voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e
I20260709 13:10:17.141855 28308 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.145823 27997 catalog_manager.cc:5697] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 0 to 1, leader changed from <none> to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 1 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.147205 28308 raft_consensus.cc:2749] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:17.228704 28321 consensus_queue.cc:1048] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.234910 28321 consensus_queue.cc:1048] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.239742 28324 consensus_queue.cc:1048] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:17.241094 28324 raft_consensus.cc:493] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.241590 28324 raft_consensus.cc:515] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.245971 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd" is_pre_election: true
I20260709 13:10:17.247092 28324 leader_election.cc:290] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.249218 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e" is_pre_election: true
I20260709 13:10:17.250022 28249 raft_consensus.cc:2468] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:17.251968 28064 leader_election.cc:304] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:17.252779 28323 consensus_queue.cc:1048] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.253759 28324 raft_consensus.cc:2804] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.254182 28324 raft_consensus.cc:493] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.254539 28324 raft_consensus.cc:3060] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.246603 28174 raft_consensus.cc:2468] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 0.
I20260709 13:10:17.268378 28324 raft_consensus.cc:515] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.270773 28324 leader_election.cc:290] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.271668 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:17.271795 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.272384 28174 raft_consensus.cc:3060] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.272406 28249 raft_consensus.cc:3060] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.278877 28321 consensus_queue.cc:1048] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.279520 28174 raft_consensus.cc:2468] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:17.279520 28249 raft_consensus.cc:2468] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 1.
I20260709 13:10:17.280787 28064 leader_election.cc:304] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:17.281527 28321 raft_consensus.cc:2804] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.282047 28321 raft_consensus.cc:697] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.282900 28321 consensus_queue.cc:237] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.297436 28321 consensus_queue.cc:1048] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:17.297474 27996 catalog_manager.cc:5697] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 0 to 1, leader changed from <none> to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 1 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.314577 28299 raft_consensus.cc:493] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.315025 28299 raft_consensus.cc:515] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.316589 28299 leader_election.cc:290] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:17.317329 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59374436d3444d38b88af758d517398c" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b" is_pre_election: true
I20260709 13:10:17.317546 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59374436d3444d38b88af758d517398c" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd" is_pre_election: true
I20260709 13:10:17.317848 28100 raft_consensus.cc:2468] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 0.
I20260709 13:10:17.318197 28174 raft_consensus.cc:2468] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 0.
I20260709 13:10:17.318904 28213 leader_election.cc:304] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:17.319715 28299 raft_consensus.cc:2804] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.320111 28299 raft_consensus.cc:493] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.320384 28299 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.324764 28299 raft_consensus.cc:515] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.326391 28299 leader_election.cc:290] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 1 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:17.327348 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59374436d3444d38b88af758d517398c" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:17.327852 28100 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.327838 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59374436d3444d38b88af758d517398c" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:17.328528 28174 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.332093 28308 consensus_queue.cc:1048] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.337090 28174 raft_consensus.cc:2468] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 1.
I20260709 13:10:17.337090 28100 raft_consensus.cc:2468] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 1.
I20260709 13:10:17.338544 28212 leader_election.cc:304] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:17.339939 28299 raft_consensus.cc:2804] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.341621 28299 raft_consensus.cc:697] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 1 LEADER]: Becoming Leader. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:17.342559 28299 consensus_queue.cc:237] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.347110 28308 consensus_queue.cc:1048] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.368090 27997 catalog_manager.cc:5697] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e reported cstate change: term changed from 0 to 1, leader changed from <none> to f7a25393f941485683305e8565b68c1e (127.26.202.3). New cstate: current_term: 1 leader_uuid: "f7a25393f941485683305e8565b68c1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.473969 28174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b0f6ecbe6494aeba49e952004f26d5f"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
mode: GRACEFUL
new_leader_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:38394
I20260709 13:10:17.474581 28174 raft_consensus.cc:606] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Received request to transfer leadership to TS daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:17.480775 28174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f4e729927824e469a1801236a925d07"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
mode: GRACEFUL
new_leader_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:38394
I20260709 13:10:17.481521 28174 raft_consensus.cc:606] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Received request to transfer leadership to TS daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:17.487618 28174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f4e6625af2f4a61ac35726996130288"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
mode: GRACEFUL
new_leader_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:38394
I20260709 13:10:17.488240 28174 raft_consensus.cc:606] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Received request to transfer leadership to TS daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:17.507653 28099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:54252
I20260709 13:10:17.508285 28099 raft_consensus.cc:606] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Received request to transfer leadership to TS 902d2150c00848cfa7a0678a216cdccd
I20260709 13:10:17.521528 28249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59374436d3444d38b88af758d517398c"
dest_uuid: "f7a25393f941485683305e8565b68c1e"
mode: GRACEFUL
new_leader_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:41502
I20260709 13:10:17.522133 28249 raft_consensus.cc:606] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 1 LEADER]: Received request to transfer leadership to TS 902d2150c00848cfa7a0678a216cdccd
I20260709 13:10:17.525506 28307 raft_consensus.cc:993] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd: : Instructing follower daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:17.526005 28308 raft_consensus.cc:1081] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Signalling peer daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:17.527593 28099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b0f6ecbe6494aeba49e952004f26d5f"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:54228
I20260709 13:10:17.527921 28100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:54252
I20260709 13:10:17.528178 28099 raft_consensus.cc:493] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.528666 28100 raft_consensus.cc:606] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Received request to transfer leadership to TS 902d2150c00848cfa7a0678a216cdccd
I20260709 13:10:17.528672 28099 raft_consensus.cc:3060] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.531253 28321 consensus_queue.cc:1048] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.534847 28100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:54252
I20260709 13:10:17.535635 28100 raft_consensus.cc:606] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Received request to transfer leadership to TS 902d2150c00848cfa7a0678a216cdccd
I20260709 13:10:17.536634 28099 raft_consensus.cc:515] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.538681 28099 leader_election.cc:290] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 2 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.539557 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0f6ecbe6494aeba49e952004f26d5f" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:17.540156 28174 raft_consensus.cc:3055] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.540496 28174 raft_consensus.cc:740] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:17.540809 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b0f6ecbe6494aeba49e952004f26d5f" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.541385 28248 raft_consensus.cc:3060] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.541307 28174 consensus_queue.cc:260] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.542503 28174 raft_consensus.cc:3060] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.550288 28174 raft_consensus.cc:2468] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 2.
I20260709 13:10:17.550215 28099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1b18b3a459c47d1b67f344cf02d126b"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:54252
I20260709 13:10:17.551757 28063 leader_election.cc:304] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:17.552022 28248 raft_consensus.cc:2468] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 2.
I20260709 13:10:17.553040 28324 raft_consensus.cc:2804] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.553593 28324 raft_consensus.cc:697] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.553048 28099 raft_consensus.cc:606] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Received request to transfer leadership to TS f7a25393f941485683305e8565b68c1e
I20260709 13:10:17.554443 28324 consensus_queue.cc:237] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.555382 28295 consensus_queue.cc:1048] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.573108 27997 catalog_manager.cc:5697] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 1 to 2, leader changed from 902d2150c00848cfa7a0678a216cdccd (127.26.202.2) to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 2 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.593394 28324 consensus_queue.cc:1048] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.600148 28295 raft_consensus.cc:993] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:17.600618 28323 raft_consensus.cc:1081] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Signalling peer 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:17.604205 28174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:38378
I20260709 13:10:17.604790 28174 raft_consensus.cc:493] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.605214 28174 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.607934 28295 consensus_queue.cc:1048] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.609670 28308 raft_consensus.cc:993] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd: : Instructing follower daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:17.610131 28308 raft_consensus.cc:1081] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Signalling peer daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:17.611922 28099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f4e6625af2f4a61ac35726996130288"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:54228
I20260709 13:10:17.612623 28099 raft_consensus.cc:493] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.613039 28099 raft_consensus.cc:3060] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.613121 28174 raft_consensus.cc:515] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.616343 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:17.616989 28100 raft_consensus.cc:3055] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.617362 28100 raft_consensus.cc:740] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.618181 28100 consensus_queue.cc:260] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.620203 28174 leader_election.cc:290] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 2 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.620734 28249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.621361 28100 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.622471 28099 raft_consensus.cc:515] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.624504 28099 leader_election.cc:290] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 2 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.626111 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4e6625af2f4a61ac35726996130288" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.626638 28248 raft_consensus.cc:3060] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.628904 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4e6625af2f4a61ac35726996130288" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:17.629660 28174 raft_consensus.cc:3055] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.630084 28174 raft_consensus.cc:740] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:17.630498 28100 raft_consensus.cc:2468] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 2.
I20260709 13:10:17.631232 28174 consensus_queue.cc:260] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.631837 28139 leader_election.cc:304] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: f7a25393f941485683305e8565b68c1e
I20260709 13:10:17.633098 28308 raft_consensus.cc:2804] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.633400 28174 raft_consensus.cc:3060] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.633551 28308 raft_consensus.cc:697] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:17.634351 28248 raft_consensus.cc:2468] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 2.
I20260709 13:10:17.634450 28308 consensus_queue.cc:237] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.635576 28064 leader_election.cc:304] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:17.636428 28295 raft_consensus.cc:2804] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.636901 28295 raft_consensus.cc:697] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.637732 28295 consensus_queue.cc:237] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.639844 28174 raft_consensus.cc:2468] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 2.
I20260709 13:10:17.642930 27996 catalog_manager.cc:5697] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 1 to 2, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 2 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.645318 27997 catalog_manager.cc:5697] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 1 to 2, leader changed from 902d2150c00848cfa7a0678a216cdccd (127.26.202.2) to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 2 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.719820 28295 consensus_queue.cc:1048] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.724680 28323 raft_consensus.cc:993] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:17.725193 28295 raft_consensus.cc:1081] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Signalling peer 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:17.727012 28174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:38378
I20260709 13:10:17.727555 28174 raft_consensus.cc:493] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.727943 28174 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.731844 28295 consensus_queue.cc:1048] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.738119 28174 raft_consensus.cc:515] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.741146 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:17.741745 28100 raft_consensus.cc:3055] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.742013 28174 leader_election.cc:290] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 2 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.742061 28100 raft_consensus.cc:740] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.743248 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.743207 28100 consensus_queue.cc:260] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.744606 28100 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.744874 28323 raft_consensus.cc:993] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:17.744541 28248 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.745399 28295 raft_consensus.cc:1081] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Signalling peer 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:17.747112 28175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:38378
I20260709 13:10:17.747748 28175 raft_consensus.cc:493] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.748209 28175 raft_consensus.cc:3060] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.750888 28100 raft_consensus.cc:2468] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 2.
I20260709 13:10:17.752053 28139 leader_election.cc:304] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:17.752916 28308 raft_consensus.cc:2804] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.753450 28308 raft_consensus.cc:697] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:17.753660 28248 raft_consensus.cc:2468] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 2.
I20260709 13:10:17.754261 28308 consensus_queue.cc:237] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.755414 28175 raft_consensus.cc:515] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.757550 28175 leader_election.cc:290] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 2 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.758793 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:17.759150 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ae2a73cdb74a7fbfb51323802b09af" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.759407 28100 raft_consensus.cc:3055] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.759809 28248 raft_consensus.cc:3060] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.759778 28100 raft_consensus.cc:740] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.760763 28100 consensus_queue.cc:260] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.762065 28100 raft_consensus.cc:3060] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.766269 28248 raft_consensus.cc:2468] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 2.
I20260709 13:10:17.767552 28139 leader_election.cc:304] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:17.767622 28100 raft_consensus.cc:2468] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 2.
I20260709 13:10:17.768370 28308 raft_consensus.cc:2804] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.768898 28308 raft_consensus.cc:697] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:17.769166 27996 catalog_manager.cc:5697] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 1 to 2, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 2 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.769651 28308 consensus_queue.cc:237] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.781482 27996 catalog_manager.cc:5697] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 1 to 2, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 2 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.811657 28299 consensus_queue.cc:1048] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.818718 28359 raft_consensus.cc:993] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e: : Instructing follower 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:17.819398 28299 raft_consensus.cc:1081] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 1 LEADER]: Signalling peer 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:17.821444 28174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59374436d3444d38b88af758d517398c"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:38390
I20260709 13:10:17.823264 28174 raft_consensus.cc:493] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.823702 28174 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.825845 28299 consensus_queue.cc:1048] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.831202 28174 raft_consensus.cc:515] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.837109 28174 leader_election.cc:290] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 2 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.837257 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59374436d3444d38b88af758d517398c" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.838011 28248 raft_consensus.cc:3055] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.838411 28248 raft_consensus.cc:740] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:17.838937 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59374436d3444d38b88af758d517398c" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:17.840305 28100 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.839262 28248 consensus_queue.cc:260] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.842168 28248 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.846261 28100 raft_consensus.cc:2468] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 2.
I20260709 13:10:17.847368 28139 leader_election.cc:304] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:17.848130 28308 raft_consensus.cc:2804] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.848126 28248 raft_consensus.cc:2468] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 2.
I20260709 13:10:17.848739 28308 raft_consensus.cc:697] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:17.849570 28308 consensus_queue.cc:237] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.855541 27996 catalog_manager.cc:5697] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 1 to 2, leader changed from f7a25393f941485683305e8565b68c1e (127.26.202.3) to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 2 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.958600 28294 raft_consensus.cc:993] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd: : Instructing follower daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:17.959223 28308 raft_consensus.cc:1081] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Signalling peer daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:17.960647 28100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f4e729927824e469a1801236a925d07"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:54228
I20260709 13:10:17.961202 28100 raft_consensus.cc:493] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.961508 28100 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.966873 28100 raft_consensus.cc:515] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.968648 28100 leader_election.cc:290] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 2 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:17.969702 28174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4e729927824e469a1801236a925d07" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:17.969871 28248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4e729927824e469a1801236a925d07" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:17.970244 28174 raft_consensus.cc:3055] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.970504 28248 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.970626 28174 raft_consensus.cc:740] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:17.971426 28174 consensus_queue.cc:260] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.972311 28174 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.975591 28248 raft_consensus.cc:2468] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 2.
I20260709 13:10:17.976615 28064 leader_election.cc:304] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:17.977159 28174 raft_consensus.cc:2468] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 2.
I20260709 13:10:17.977583 28295 raft_consensus.cc:2804] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.978075 28295 raft_consensus.cc:697] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:17.978897 28295 consensus_queue.cc:237] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:17.985532 27996 catalog_manager.cc:5697] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 1 to 2, leader changed from 902d2150c00848cfa7a0678a216cdccd (127.26.202.2) to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 2 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.055117 28248 raft_consensus.cc:1275] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.056826 28295 consensus_queue.cc:1048] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.057952 28324 raft_consensus.cc:993] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:18.058532 28324 raft_consensus.cc:1081] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Signalling peer f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:18.060052 28249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1b18b3a459c47d1b67f344cf02d126b"
dest_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:41494
I20260709 13:10:18.060599 28249 raft_consensus.cc:493] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.060976 28249 raft_consensus.cc:3060] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.067950 28249 raft_consensus.cc:515] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:18.070451 28249 leader_election.cc:290] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 2 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:18.071264 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b18b3a459c47d1b67f344cf02d126b" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:18.071869 28175 raft_consensus.cc:3060] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.072340 28174 raft_consensus.cc:1275] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.071403 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1b18b3a459c47d1b67f344cf02d126b" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:18.072964 28100 raft_consensus.cc:3055] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.073329 28100 raft_consensus.cc:740] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:18.074124 28100 consensus_queue.cc:260] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:18.075034 28100 raft_consensus.cc:3060] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.075119 28295 consensus_queue.cc:1048] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.078737 28175 raft_consensus.cc:2468] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 2.
I20260709 13:10:18.080184 28212 leader_election.cc:304] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:18.080974 28299 raft_consensus.cc:2804] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.081462 28299 raft_consensus.cc:697] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Becoming Leader. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:18.082289 28299 consensus_queue.cc:237] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:18.082297 28100 raft_consensus.cc:2468] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 2.
I20260709 13:10:18.092407 27996 catalog_manager.cc:5697] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e reported cstate change: term changed from 1 to 2, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to f7a25393f941485683305e8565b68c1e (127.26.202.3). New cstate: current_term: 2 leader_uuid: "f7a25393f941485683305e8565b68c1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.144826 28175 raft_consensus.cc:1275] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.146144 28295 consensus_queue.cc:1048] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.151396 28249 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.155930 28247 raft_consensus.cc:1275] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.157591 28324 consensus_queue.cc:1048] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.158839 28249 raft_consensus.cc:1275] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.160529 28294 consensus_queue.cc:1048] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.170183 28100 raft_consensus.cc:1275] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.172587 28294 consensus_queue.cc:1048] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.173560 28100 raft_consensus.cc:1275] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.175348 28294 consensus_queue.cc:1048] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.184887 28249 raft_consensus.cc:1275] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.187198 28307 consensus_queue.cc:1048] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.194136 28247 raft_consensus.cc:1275] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.195838 28294 consensus_queue.cc:1048] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.206223 28099 raft_consensus.cc:1275] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.207516 28294 consensus_queue.cc:1048] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.342443 28099 raft_consensus.cc:1275] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.344091 28247 raft_consensus.cc:1275] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.345544 28294 consensus_queue.cc:1048] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.346292 28378 consensus_queue.cc:1048] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.394750 28175 raft_consensus.cc:1275] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.396255 28324 consensus_queue.cc:1048] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.404980 28247 raft_consensus.cc:1275] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.406852 28322 consensus_queue.cc:1048] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.544627 28175 raft_consensus.cc:1275] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.546463 28299 consensus_queue.cc:1048] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.554433 28099 raft_consensus.cc:1275] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.555979 28373 consensus_queue.cc:1048] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.603113 27432 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:10:20.603994 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:20.621479 28100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:10:20.622136 28100 raft_consensus.cc:606] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Received request to transfer leadership to TS f7a25393f941485683305e8565b68c1e
I20260709 13:10:20.625187 28100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:10:20.625909 28100 raft_consensus.cc:606] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Received request to transfer leadership to TS f7a25393f941485683305e8565b68c1e
I20260709 13:10:20.627179 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:20.627591 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:20.888223 28384 raft_consensus.cc:993] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:20.889056 28322 raft_consensus.cc:1081] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Signalling peer f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:20.891080 28247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca"
dest_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:41494
I20260709 13:10:20.891788 28247 raft_consensus.cc:493] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.892170 28247 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.898900 28247 raft_consensus.cc:515] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:20.901095 28247 leader_election.cc:290] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 2 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:20.902393 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:20.902609 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:20.903577 28100 raft_consensus.cc:3055] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.903734 28175 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.904145 28100 raft_consensus.cc:740] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:20.905483 28100 consensus_queue.cc:260] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:20.907565 28100 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.915041 28175 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 2.
I20260709 13:10:20.916746 28212 leader_election.cc:304] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:20.917151 28100 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 2.
I20260709 13:10:20.917919 28373 raft_consensus.cc:2804] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.919005 28373 raft_consensus.cc:697] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Becoming Leader. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:20.919914 28373 consensus_queue.cc:237] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:20.929288 27995 catalog_manager.cc:5697] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e reported cstate change: term changed from 1 to 2, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to f7a25393f941485683305e8565b68c1e (127.26.202.3). New cstate: current_term: 2 leader_uuid: "f7a25393f941485683305e8565b68c1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.979085 28384 raft_consensus.cc:993] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:20.979770 28322 raft_consensus.cc:1081] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Signalling peer f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:20.981778 28247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf"
dest_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:41494
I20260709 13:10:20.982452 28247 raft_consensus.cc:493] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.982851 28247 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.991385 28247 raft_consensus.cc:515] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:20.993475 28247 leader_election.cc:290] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 2 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:20.994830 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:20.994733 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:20.995584 28100 raft_consensus.cc:3055] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.995891 28175 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.995975 28100 raft_consensus.cc:740] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:20.997041 28100 consensus_queue.cc:260] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:20.998535 28100 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.002213 28175 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 2.
I20260709 13:10:21.003640 28212 leader_election.cc:304] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:21.004524 28373 raft_consensus.cc:2804] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.005030 28373 raft_consensus.cc:697] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Becoming Leader. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:21.005944 28373 consensus_queue.cc:237] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.006968 28100 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 2.
I20260709 13:10:21.013533 27995 catalog_manager.cc:5697] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e reported cstate change: term changed from 1 to 2, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to f7a25393f941485683305e8565b68c1e (127.26.202.3). New cstate: current_term: 2 leader_uuid: "f7a25393f941485683305e8565b68c1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.466344 28175 raft_consensus.cc:1275] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.467847 28373 consensus_queue.cc:1048] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.480037 28100 raft_consensus.cc:1275] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.483594 28388 consensus_queue.cc:1048] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:21.492902 28099 raft_consensus.cc:1275] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.495072 28373 consensus_queue.cc:1048] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.507248 28175 raft_consensus.cc:1275] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.509610 28402 consensus_queue.cc:1048] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:21.628573 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:21.649473 28247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf"
dest_uuid: "f7a25393f941485683305e8565b68c1e"
mode: GRACEFUL
new_leader_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:41502
I20260709 13:10:21.650077 28247 raft_consensus.cc:606] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Received request to transfer leadership to TS daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:21.655815 28247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca"
dest_uuid: "f7a25393f941485683305e8565b68c1e"
mode: GRACEFUL
new_leader_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:41502
I20260709 13:10:21.656508 28247 raft_consensus.cc:606] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Received request to transfer leadership to TS daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:21.662441 28175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
mode: GRACEFUL
new_leader_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:38394
I20260709 13:10:21.663175 28175 raft_consensus.cc:606] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Received request to transfer leadership to TS daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:21.669601 28175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59374436d3444d38b88af758d517398c"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
mode: GRACEFUL
new_leader_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:38394
I20260709 13:10:21.670197 28175 raft_consensus.cc:606] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Received request to transfer leadership to TS daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:21.675968 28175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
mode: GRACEFUL
new_leader_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:38394
I20260709 13:10:21.676618 28175 raft_consensus.cc:606] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Received request to transfer leadership to TS daf040ae8e6e4c97961e4091eecd217b
I20260709 13:10:21.689770 28401 raft_consensus.cc:993] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd: : Instructing follower daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:21.690300 28383 raft_consensus.cc:1081] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Signalling peer daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:21.691808 28099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59374436d3444d38b88af758d517398c"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:54228
I20260709 13:10:21.692296 28099 raft_consensus.cc:493] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.692596 28099 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.697701 28099 raft_consensus.cc:515] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.699344 28099 leader_election.cc:290] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:21.700312 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59374436d3444d38b88af758d517398c" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:21.700718 28247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59374436d3444d38b88af758d517398c" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:21.700969 28175 raft_consensus.cc:3055] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:21.701310 28247 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.701339 28175 raft_consensus.cc:740] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:21.702291 28175 consensus_queue.cc:260] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.703567 28175 raft_consensus.cc:3060] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.708518 28247 raft_consensus.cc:2468] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:21.709947 28064 leader_election.cc:304] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:21.710264 28175 raft_consensus.cc:2468] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:21.710691 28322 raft_consensus.cc:2804] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:21.711833 28322 raft_consensus.cc:697] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:21.712680 28322 consensus_queue.cc:237] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.719604 27996 catalog_manager.cc:5697] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 2 to 3, leader changed from 902d2150c00848cfa7a0678a216cdccd (127.26.202.2) to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 3 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.847160 28401 raft_consensus.cc:993] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd: : Instructing follower daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:21.847649 28383 raft_consensus.cc:1081] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Signalling peer daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:21.849248 28099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:54228
I20260709 13:10:21.849702 28099 raft_consensus.cc:493] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.849967 28099 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.855007 28099 raft_consensus.cc:515] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.856895 28099 leader_election.cc:290] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:21.857969 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:21.858181 28247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:21.858675 28175 raft_consensus.cc:3055] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:21.858831 28247 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.859138 28175 raft_consensus.cc:740] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:21.860163 28175 consensus_queue.cc:260] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.861476 28175 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.864786 28247 raft_consensus.cc:2468] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:21.866144 28064 leader_election.cc:304] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:21.866992 28322 raft_consensus.cc:2804] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:21.867024 28175 raft_consensus.cc:2468] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:21.867681 28322 raft_consensus.cc:697] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:21.869390 28322 consensus_queue.cc:237] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.876541 27996 catalog_manager.cc:5697] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 2 to 3, leader changed from 902d2150c00848cfa7a0678a216cdccd (127.26.202.2) to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 3 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.926966 28388 raft_consensus.cc:993] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e: : Instructing follower daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:21.927516 28402 raft_consensus.cc:1081] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Signalling peer daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:21.929090 28099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:10:21.929607 28099 raft_consensus.cc:493] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.929900 28099 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.935055 28099 raft_consensus.cc:515] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.936759 28099 leader_election.cc:290] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:21.937897 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:21.937951 28247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:21.938658 28175 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.938755 28247 raft_consensus.cc:3055] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:21.939152 28247 raft_consensus.cc:740] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:21.939837 28247 consensus_queue.cc:260] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.940745 28247 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:21.943409 28175 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:21.944602 28063 leader_election.cc:304] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:21.945405 28322 raft_consensus.cc:2804] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:21.945796 28247 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:21.945927 28322 raft_consensus.cc:697] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:21.947005 28322 consensus_queue.cc:237] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:21.953317 27996 catalog_manager.cc:5697] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 2 to 3, leader changed from f7a25393f941485683305e8565b68c1e (127.26.202.3) to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 3 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.039170 28388 raft_consensus.cc:993] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e: : Instructing follower daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:22.039733 28410 raft_consensus.cc:1081] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Signalling peer daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:22.041553 28099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:54238
I20260709 13:10:22.042238 28099 raft_consensus.cc:493] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.042660 28099 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.047585 28099 raft_consensus.cc:515] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:22.049567 28099 leader_election.cc:290] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:22.050477 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:22.050774 28247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:22.051065 28175 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.051333 28247 raft_consensus.cc:3055] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:22.051640 28247 raft_consensus.cc:740] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:22.052430 28247 consensus_queue.cc:260] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:22.053664 28247 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.057756 28175 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:22.059342 28063 leader_election.cc:304] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, daf040ae8e6e4c97961e4091eecd217b; no voters: 
I20260709 13:10:22.060096 28322 raft_consensus.cc:2804] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:22.060200 28247 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:22.060647 28322 raft_consensus.cc:697] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:22.061685 28322 consensus_queue.cc:237] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:22.067891 27996 catalog_manager.cc:5697] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 2 to 3, leader changed from f7a25393f941485683305e8565b68c1e (127.26.202.3) to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 3 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.111795 28401 raft_consensus.cc:993] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd: : Instructing follower daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:22.112296 28383 raft_consensus.cc:1081] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Signalling peer daf040ae8e6e4c97961e4091eecd217b to start an election
I20260709 13:10:22.113775 28099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
 from {username='slave'} at 127.0.0.1:54228
I20260709 13:10:22.114234 28099 raft_consensus.cc:493] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.114534 28099 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.119050 28099 raft_consensus.cc:515] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:22.120651 28099 leader_election.cc:290] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Requested vote from peers 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:22.121631 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:22.121692 28247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fabafc658f4e4e8049b5d1b2d3d983" candidate_uuid: "daf040ae8e6e4c97961e4091eecd217b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:22.122257 28175 raft_consensus.cc:3055] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:22.122390 28247 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.122615 28175 raft_consensus.cc:740] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:22.123445 28175 consensus_queue.cc:260] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:22.124787 28175 raft_consensus.cc:3060] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.130764 28247 raft_consensus.cc:2468] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:22.131632 28175 raft_consensus.cc:2468] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daf040ae8e6e4c97961e4091eecd217b in term 3.
I20260709 13:10:22.132050 28064 leader_election.cc:304] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daf040ae8e6e4c97961e4091eecd217b, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:22.133092 28322 raft_consensus.cc:2804] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:22.133595 28322 raft_consensus.cc:697] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Becoming Leader. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:22.134280 28322 consensus_queue.cc:237] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:22.141453 27996 catalog_manager.cc:5697] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b reported cstate change: term changed from 2 to 3, leader changed from 902d2150c00848cfa7a0678a216cdccd (127.26.202.2) to daf040ae8e6e4c97961e4091eecd217b (127.26.202.1). New cstate: current_term: 3 leader_uuid: "daf040ae8e6e4c97961e4091eecd217b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.275724 28247 raft_consensus.cc:1275] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.277181 28322 consensus_queue.cc:1048] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.282473 28175 raft_consensus.cc:1275] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.284294 28322 consensus_queue.cc:1048] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.331694 28175 raft_consensus.cc:1275] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.333369 28404 consensus_queue.cc:1048] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:22.341723 28247 raft_consensus.cc:1275] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.343191 28173 raft_consensus.cc:1275] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.343454 28418 consensus_queue.cc:1048] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:22.344945 28322 consensus_queue.cc:1048] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.357368 28247 raft_consensus.cc:1275] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.358966 28322 consensus_queue.cc:1048] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.524228 28173 raft_consensus.cc:1275] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.525558 28322 consensus_queue.cc:1048] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.538054 28247 raft_consensus.cc:1275] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.539813 28322 consensus_queue.cc:1048] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:22.594790 28173 raft_consensus.cc:1275] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.596465 28322 consensus_queue.cc:1048] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.605741 28249 raft_consensus.cc:1275] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Refusing update from remote peer daf040ae8e6e4c97961e4091eecd217b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:22.607038 28413 consensus_queue.cc:1048] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.684206 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:24.691653 28099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:10:24.692179 28099 raft_consensus.cc:606] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Received request to transfer leadership to TS f7a25393f941485683305e8565b68c1e
I20260709 13:10:24.694752 28099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f4e729927824e469a1801236a925d07"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:10:24.695238 28099 raft_consensus.cc:606] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Received request to transfer leadership to TS 902d2150c00848cfa7a0678a216cdccd
I20260709 13:10:24.697549 28099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:10:24.697976 28099 raft_consensus.cc:606] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Received request to transfer leadership to TS f7a25393f941485683305e8565b68c1e
I20260709 13:10:24.700363 28099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546"
dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
mode: GRACEFUL
new_leader_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:54268
I20260709 13:10:24.700846 28099 raft_consensus.cc:606] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Received request to transfer leadership to TS 902d2150c00848cfa7a0678a216cdccd
I20260709 13:10:24.701951 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:24.702400 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:24.906155 28413 raft_consensus.cc:993] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:24.906675 28427 raft_consensus.cc:1081] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Signalling peer 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:24.908314 28175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:38378
I20260709 13:10:24.908733 28175 raft_consensus.cc:493] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.908970 28175 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.913239 28175 raft_consensus.cc:515] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:24.914665 28175 leader_election.cc:290] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 4 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:24.915912 28099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:24.915966 28247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb91a46e19b74da399aac13c512d1546" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:24.916623 28247 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.916620 28099 raft_consensus.cc:3055] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:24.917181 28099 raft_consensus.cc:740] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:24.918009 28099 consensus_queue.cc:260] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:24.919291 28099 raft_consensus.cc:3060] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:24.923429 28247 raft_consensus.cc:2468] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 4.
I20260709 13:10:24.924932 28139 leader_election.cc:304] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:24.925438 28099 raft_consensus.cc:2468] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 4.
I20260709 13:10:24.925797 28383 raft_consensus.cc:2804] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:24.926939 28383 raft_consensus.cc:697] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 4 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:24.927625 28383 consensus_queue.cc:237] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:24.934592 27995 catalog_manager.cc:5697] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 3 to 4, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 4 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.074164 28413 raft_consensus.cc:993] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:25.074582 28413 raft_consensus.cc:1081] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Signalling peer 902d2150c00848cfa7a0678a216cdccd to start an election
I20260709 13:10:25.076054 28175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f4e729927824e469a1801236a925d07"
dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
 from {username='slave'} at 127.0.0.1:38378
I20260709 13:10:25.076463 28175 raft_consensus.cc:493] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.076696 28175 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.080907 28175 raft_consensus.cc:515] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.082327 28175 leader_election.cc:290] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 3 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), f7a25393f941485683305e8565b68c1e (127.26.202.3:45761)
I20260709 13:10:25.083261 28099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4e729927824e469a1801236a925d07" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:25.083691 28247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4e729927824e469a1801236a925d07" candidate_uuid: "902d2150c00848cfa7a0678a216cdccd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7a25393f941485683305e8565b68c1e"
I20260709 13:10:25.083791 28099 raft_consensus.cc:3055] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:25.084151 28247 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.084399 28099 raft_consensus.cc:740] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:25.085357 28099 consensus_queue.cc:260] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.086385 28099 raft_consensus.cc:3060] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.089762 28247 raft_consensus.cc:2468] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 3.
I20260709 13:10:25.090852 28139 leader_election.cc:304] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:25.091676 28383 raft_consensus.cc:2804] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.092182 28383 raft_consensus.cc:697] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 3 LEADER]: Becoming Leader. State: Replica: 902d2150c00848cfa7a0678a216cdccd, State: Running, Role: LEADER
I20260709 13:10:25.092859 28427 raft_consensus.cc:993] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:25.092522 28099 raft_consensus.cc:2468] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 902d2150c00848cfa7a0678a216cdccd in term 3.
I20260709 13:10:25.093410 28413 raft_consensus.cc:1081] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Signalling peer f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:25.093273 28383 consensus_queue.cc:237] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.095152 28247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca"
dest_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:41494
I20260709 13:10:25.095572 28247 raft_consensus.cc:493] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.095865 28247 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.101378 28247 raft_consensus.cc:515] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.101511 27995 catalog_manager.cc:5697] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd reported cstate change: term changed from 2 to 3, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to 902d2150c00848cfa7a0678a216cdccd (127.26.202.2). New cstate: current_term: 3 leader_uuid: "902d2150c00848cfa7a0678a216cdccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.103488 28247 leader_election.cc:290] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 4 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:25.103716 28099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:25.104012 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f1195d08a94750b4f48dc0f64380ca" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:25.104272 28099 raft_consensus.cc:3055] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:25.104486 28099 raft_consensus.cc:740] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:25.104570 28175 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.105113 28099 consensus_queue.cc:260] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.105836 28099 raft_consensus.cc:3060] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.110915 28175 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 4.
I20260709 13:10:25.111891 28099 raft_consensus.cc:2468] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 4.
I20260709 13:10:25.112044 28212 leader_election.cc:304] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:25.112887 28425 raft_consensus.cc:2804] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:25.114254 28425 raft_consensus.cc:697] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 4 LEADER]: Becoming Leader. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:25.115160 28425 consensus_queue.cc:237] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.121987 27995 catalog_manager.cc:5697] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e reported cstate change: term changed from 3 to 4, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to f7a25393f941485683305e8565b68c1e (127.26.202.3). New cstate: current_term: 4 leader_uuid: "f7a25393f941485683305e8565b68c1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.128867 28427 raft_consensus.cc:993] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b: : Instructing follower f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:25.129454 28413 raft_consensus.cc:1081] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Signalling peer f7a25393f941485683305e8565b68c1e to start an election
I20260709 13:10:25.131034 28247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf"
dest_uuid: "f7a25393f941485683305e8565b68c1e"
 from {username='slave'} at 127.0.0.1:41494
I20260709 13:10:25.131520 28247 raft_consensus.cc:493] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.131783 28247 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.136102 28247 raft_consensus.cc:515] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.137557 28247 leader_election.cc:290] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 4 election: Requested vote from peers daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821), 902d2150c00848cfa7a0678a216cdccd (127.26.202.2:32829)
I20260709 13:10:25.138442 28099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "daf040ae8e6e4c97961e4091eecd217b"
I20260709 13:10:25.138609 28175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409ca5efa2814111a9b9253b0a9737cf" candidate_uuid: "f7a25393f941485683305e8565b68c1e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "902d2150c00848cfa7a0678a216cdccd"
I20260709 13:10:25.138923 28099 raft_consensus.cc:3055] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:25.139119 28175 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.139279 28099 raft_consensus.cc:740] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: daf040ae8e6e4c97961e4091eecd217b, State: Running, Role: LEADER
I20260709 13:10:25.140055 28099 consensus_queue.cc:260] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.140874 28099 raft_consensus.cc:3060] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.143636 28175 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 4.
I20260709 13:10:25.144696 28212 leader_election.cc:304] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 902d2150c00848cfa7a0678a216cdccd, f7a25393f941485683305e8565b68c1e; no voters: 
I20260709 13:10:25.145298 28099 raft_consensus.cc:2468] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a25393f941485683305e8565b68c1e in term 4.
I20260709 13:10:25.145455 28425 raft_consensus.cc:2804] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:25.145970 28425 raft_consensus.cc:697] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 4 LEADER]: Becoming Leader. State: Replica: f7a25393f941485683305e8565b68c1e, State: Running, Role: LEADER
I20260709 13:10:25.147094 28425 consensus_queue.cc:237] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } }
I20260709 13:10:25.154289 27995 catalog_manager.cc:5697] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e reported cstate change: term changed from 3 to 4, leader changed from daf040ae8e6e4c97961e4091eecd217b (127.26.202.1) to f7a25393f941485683305e8565b68c1e (127.26.202.3). New cstate: current_term: 4 leader_uuid: "f7a25393f941485683305e8565b68c1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.376636 28247 raft_consensus.cc:1275] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:25.378329 28383 consensus_queue.cc:1048] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:25.391295 28099 raft_consensus.cc:1275] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:25.394480 28383 consensus_queue.cc:1048] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:25.487990 28249 raft_consensus.cc:1275] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:25.489814 28383 consensus_queue.cc:1048] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a25393f941485683305e8565b68c1e" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 45761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.501430 28099 raft_consensus.cc:1275] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Refusing update from remote peer 902d2150c00848cfa7a0678a216cdccd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:25.503175 28445 consensus_queue.cc:1048] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:25.550796 28099 raft_consensus.cc:1275] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:25.552130 28425 consensus_queue.cc:1048] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:25.564035 28175 raft_consensus.cc:1275] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:25.565588 28425 consensus_queue.cc:1048] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.631755 28099 raft_consensus.cc:1275] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:25.633472 28448 consensus_queue.cc:1048] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "daf040ae8e6e4c97961e4091eecd217b" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.642508 28175 raft_consensus.cc:1275] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Refusing update from remote peer f7a25393f941485683305e8565b68c1e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:25.643937 28448 consensus_queue.cc:1048] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "902d2150c00848cfa7a0678a216cdccd" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 32829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.703372 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.710903 27432 tablet_server.cc:179] TabletServer@127.26.202.1:0 shutting down...
I20260709 13:10:25.741262 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.742129 27432 tablet_replica.cc:333] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.742727 27432 raft_consensus.cc:2243] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.743171 27432 raft_consensus.cc:2272] T fb91a46e19b74da399aac13c512d1546 P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.745617 27432 tablet_replica.cc:333] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.746157 27432 raft_consensus.cc:2243] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.746582 27432 raft_consensus.cc:2272] T a1b18b3a459c47d1b67f344cf02d126b P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.748191 27432 tablet_replica.cc:333] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.748700 27432 raft_consensus.cc:2243] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.749459 27432 raft_consensus.cc:2272] T 7f4e6625af2f4a61ac35726996130288 P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.751240 27432 tablet_replica.cc:333] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.751783 27432 raft_consensus.cc:2243] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.752192 27432 raft_consensus.cc:2272] T 409ca5efa2814111a9b9253b0a9737cf P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.754343 27432 tablet_replica.cc:333] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.754853 27432 raft_consensus.cc:2243] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.755534 27432 raft_consensus.cc:2272] T 59374436d3444d38b88af758d517398c P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.757277 27432 tablet_replica.cc:333] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.757764 27432 raft_consensus.cc:2243] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.758224 27432 raft_consensus.cc:2272] T e4f1195d08a94750b4f48dc0f64380ca P daf040ae8e6e4c97961e4091eecd217b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.760051 27432 tablet_replica.cc:333] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.760522 27432 raft_consensus.cc:2243] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.760932 27432 raft_consensus.cc:2272] T 46ae2a73cdb74a7fbfb51323802b09af P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.762591 27432 tablet_replica.cc:333] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.763126 27432 raft_consensus.cc:2243] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.763464 27432 raft_consensus.cc:2272] T 9f4e729927824e469a1801236a925d07 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.765614 27432 tablet_replica.cc:333] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.766070 27432 raft_consensus.cc:2243] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.766812 27432 raft_consensus.cc:2272] T f7fabafc658f4e4e8049b5d1b2d3d983 P daf040ae8e6e4c97961e4091eecd217b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.768488 27432 tablet_replica.cc:333] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b: stopping tablet replica
I20260709 13:10:25.769055 27432 raft_consensus.cc:2243] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.769842 27432 raft_consensus.cc:2272] T 1b0f6ecbe6494aeba49e952004f26d5f P daf040ae8e6e4c97961e4091eecd217b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.801620 27432 tablet_server.cc:196] TabletServer@127.26.202.1:0 shutdown complete.
I20260709 13:10:25.823365 27432 tablet_server.cc:179] TabletServer@127.26.202.2:0 shutting down...
I20260709 13:10:25.853178 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.854247 27432 tablet_replica.cc:333] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
W20260709 13:10:25.855010 28213 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.202.1:33821: connect: Connection refused (error 111) [suppressed 3 similar messages]
I20260709 13:10:25.855343 27432 raft_consensus.cc:2243] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.856360 27432 raft_consensus.cc:2272] T fb91a46e19b74da399aac13c512d1546 P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.859354 27432 tablet_replica.cc:333] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
W20260709 13:10:25.859421 28213 consensus_peers.cc:597] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e -> Peer daf040ae8e6e4c97961e4091eecd217b (127.26.202.1:33821): Couldn't send request to peer daf040ae8e6e4c97961e4091eecd217b. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:33821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.860225 27432 raft_consensus.cc:2243] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.860631 27432 raft_consensus.cc:2272] T 59374436d3444d38b88af758d517398c P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.862455 27432 tablet_replica.cc:333] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
I20260709 13:10:25.862977 27432 raft_consensus.cc:2243] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.863420 27432 raft_consensus.cc:2272] T e4f1195d08a94750b4f48dc0f64380ca P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.866513 27432 tablet_replica.cc:333] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
I20260709 13:10:25.867105 27432 raft_consensus.cc:2243] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.867578 27432 raft_consensus.cc:2272] T a1b18b3a459c47d1b67f344cf02d126b P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.869537 27432 tablet_replica.cc:333] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
I20260709 13:10:25.870071 27432 raft_consensus.cc:2243] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.870524 27432 raft_consensus.cc:2272] T 7f4e6625af2f4a61ac35726996130288 P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.872429 27432 tablet_replica.cc:333] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
I20260709 13:10:25.872956 27432 raft_consensus.cc:2243] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.873456 27432 raft_consensus.cc:2272] T 409ca5efa2814111a9b9253b0a9737cf P 902d2150c00848cfa7a0678a216cdccd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.875859 27432 tablet_replica.cc:333] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
I20260709 13:10:25.876421 27432 raft_consensus.cc:2243] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.877300 27432 raft_consensus.cc:2272] T 46ae2a73cdb74a7fbfb51323802b09af P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.879367 27432 tablet_replica.cc:333] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
I20260709 13:10:25.879869 27432 raft_consensus.cc:2243] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.880649 27432 raft_consensus.cc:2272] T 9f4e729927824e469a1801236a925d07 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.882812 27432 tablet_replica.cc:333] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
I20260709 13:10:25.883360 27432 raft_consensus.cc:2243] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.883809 27432 raft_consensus.cc:2272] T f7fabafc658f4e4e8049b5d1b2d3d983 P 902d2150c00848cfa7a0678a216cdccd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.885668 27432 tablet_replica.cc:333] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd: stopping tablet replica
I20260709 13:10:25.886202 27432 raft_consensus.cc:2243] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.886649 27432 raft_consensus.cc:2272] T 1b0f6ecbe6494aeba49e952004f26d5f P 902d2150c00848cfa7a0678a216cdccd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.918380 27432 tablet_server.cc:196] TabletServer@127.26.202.2:0 shutdown complete.
I20260709 13:10:25.939743 27432 tablet_server.cc:179] TabletServer@127.26.202.3:0 shutting down...
I20260709 13:10:25.974264 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.975020 27432 tablet_replica.cc:333] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:25.976019 27432 raft_consensus.cc:2243] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.976680 27432 raft_consensus.cc:2272] T 59374436d3444d38b88af758d517398c P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.978390 27432 tablet_replica.cc:333] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:25.978839 27432 raft_consensus.cc:2243] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.979540 27432 raft_consensus.cc:2272] T e4f1195d08a94750b4f48dc0f64380ca P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.981894 27432 tablet_replica.cc:333] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:25.982442 27432 raft_consensus.cc:2243] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.983157 27432 raft_consensus.cc:2272] T a1b18b3a459c47d1b67f344cf02d126b P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.984855 27432 tablet_replica.cc:333] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:25.985463 27432 raft_consensus.cc:2243] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.985862 27432 raft_consensus.cc:2272] T 7f4e6625af2f4a61ac35726996130288 P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.987396 27432 tablet_replica.cc:333] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:25.987862 27432 raft_consensus.cc:2243] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.988505 27432 raft_consensus.cc:2272] T 409ca5efa2814111a9b9253b0a9737cf P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.990944 27432 tablet_replica.cc:333] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:25.991396 27432 raft_consensus.cc:2243] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.991787 27432 raft_consensus.cc:2272] T 46ae2a73cdb74a7fbfb51323802b09af P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.993492 27432 tablet_replica.cc:333] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:25.993923 27432 raft_consensus.cc:2243] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.994297 27432 raft_consensus.cc:2272] T 9f4e729927824e469a1801236a925d07 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.996660 27432 tablet_replica.cc:333] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:25.997232 27432 raft_consensus.cc:2243] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.997660 27432 raft_consensus.cc:2272] T fb91a46e19b74da399aac13c512d1546 P f7a25393f941485683305e8565b68c1e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.999926 27432 tablet_replica.cc:333] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:26.000473 27432 raft_consensus.cc:2243] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.000934 27432 raft_consensus.cc:2272] T f7fabafc658f4e4e8049b5d1b2d3d983 P f7a25393f941485683305e8565b68c1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.002777 27432 tablet_replica.cc:333] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e: stopping tablet replica
I20260709 13:10:26.003430 27432 raft_consensus.cc:2243] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:26.004258 27432 raft_consensus.cc:2272] T 1b0f6ecbe6494aeba49e952004f26d5f P f7a25393f941485683305e8565b68c1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.028833 27432 tablet_server.cc:196] TabletServer@127.26.202.3:0 shutdown complete.
I20260709 13:10:26.049717 27432 master.cc:562] Master@127.26.202.62:45925 shutting down...
I20260709 13:10:26.073571 27432 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:26.074311 27432 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:26.074705 27432 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a5fe5a559484ceca80f4bddf62a1fcb: stopping tablet replica
I20260709 13:10:26.095849 27432 master.cc:584] Master@127.26.202.62:45925 shutdown complete.
902d2150c00848cfa7a0678a216cdccd  4
daf040ae8e6e4c97961e4091eecd217b  5
f7a25393f941485683305e8565b68c1e  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10616 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:10:26.142716 27432 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.202.62:36613
I20260709 13:10:26.144171 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:26.151134 28454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:26.151255 28455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:26.151444 28457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:26.153115 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:26.158411 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:26.158680 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:26.158802 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602626158789 us; error 0 us; skew 500 ppm
I20260709 13:10:26.159334 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:26.162446 27432 webserver.cc:533] Webserver started at http://127.26.202.62:38759/ using document root <none> and password file <none>
I20260709 13:10:26.162914 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:26.163065 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:26.163283 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:26.164366 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/master-0-root/instance:
uuid: "12655fdad3714eb6a91469c435fc7ad5"
format_stamp: "Formatted at 2026-07-09 13:10:26 on dist-test-slave-008w"
I20260709 13:10:26.169150 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:10:26.172513 28462 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.173355 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:26.173676 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/master-0-root
uuid: "12655fdad3714eb6a91469c435fc7ad5"
format_stamp: "Formatted at 2026-07-09 13:10:26 on dist-test-slave-008w"
I20260709 13:10:26.173947 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:26.189446 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:26.190984 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:26.234542 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.62:36613
I20260709 13:10:26.234650 28513 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.62:36613 every 8 connection(s)
I20260709 13:10:26.238536 28514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.248761 28514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Bootstrap starting.
I20260709 13:10:26.253532 28514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.258164 28514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: No bootstrap required, opened a new log
I20260709 13:10:26.260366 28514 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12655fdad3714eb6a91469c435fc7ad5" member_type: VOTER }
I20260709 13:10:26.260753 28514 raft_consensus.cc:385] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:26.261076 28514 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12655fdad3714eb6a91469c435fc7ad5, State: Initialized, Role: FOLLOWER
I20260709 13:10:26.261663 28514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12655fdad3714eb6a91469c435fc7ad5" member_type: VOTER }
I20260709 13:10:26.262138 28514 raft_consensus.cc:399] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:26.262368 28514 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:26.262683 28514 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.267176 28514 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12655fdad3714eb6a91469c435fc7ad5" member_type: VOTER }
I20260709 13:10:26.267729 28514 leader_election.cc:304] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12655fdad3714eb6a91469c435fc7ad5; no voters: 
I20260709 13:10:26.268913 28514 leader_election.cc:290] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:26.269392 28517 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:26.270743 28517 raft_consensus.cc:697] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 12655fdad3714eb6a91469c435fc7ad5, State: Running, Role: LEADER
I20260709 13:10:26.271494 28517 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12655fdad3714eb6a91469c435fc7ad5" member_type: VOTER }
I20260709 13:10:26.271977 28514 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:26.276311 28518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12655fdad3714eb6a91469c435fc7ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12655fdad3714eb6a91469c435fc7ad5" member_type: VOTER } }
I20260709 13:10:26.277096 28518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:26.276894 28519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12655fdad3714eb6a91469c435fc7ad5. Latest consensus state: current_term: 1 leader_uuid: "12655fdad3714eb6a91469c435fc7ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12655fdad3714eb6a91469c435fc7ad5" member_type: VOTER } }
I20260709 13:10:26.277547 28519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:26.280381 28523 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:26.288400 28523 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:26.289618 27432 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:26.297909 28523 catalog_manager.cc:1383] Generated new cluster ID: c47f586af67c4241a7bc7f39b2285877
I20260709 13:10:26.298231 28523 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:26.321772 28523 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:26.323053 28523 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:26.340026 28523 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Generated new TSK 0
I20260709 13:10:26.340691 28523 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:26.356279 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:26.362964 28535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:26.363901 28536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:26.366736 28538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:26.366773 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:26.367817 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:26.368050 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:26.368214 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602626368196 us; error 0 us; skew 500 ppm
I20260709 13:10:26.368981 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:26.371644 27432 webserver.cc:533] Webserver started at http://127.26.202.1:45095/ using document root <none> and password file <none>
I20260709 13:10:26.372167 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:26.372381 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:26.372658 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:26.373937 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/instance:
uuid: "178f22d83287460fb8c0db0ba2799895"
format_stamp: "Formatted at 2026-07-09 13:10:26 on dist-test-slave-008w"
I20260709 13:10:26.378728 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:26.382328 28543 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.383376 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:10:26.383728 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "178f22d83287460fb8c0db0ba2799895"
format_stamp: "Formatted at 2026-07-09 13:10:26 on dist-test-slave-008w"
I20260709 13:10:26.384027 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:26.399863 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:26.401288 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:26.402776 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:26.405290 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:26.405517 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.405779 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:26.405972 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.451536 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:36115
I20260709 13:10:26.451699 28605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:36115 every 8 connection(s)
I20260709 13:10:26.457293 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:26.465624 28610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:26.466427 28611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:26.468698 28613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:26.469735 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:26.471352 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:26.471662 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:26.471894 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602626471870 us; error 0 us; skew 500 ppm
I20260709 13:10:26.472697 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:26.472733 28606 heartbeater.cc:344] Connected to a master server at 127.26.202.62:36613
I20260709 13:10:26.473259 28606 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:26.474421 28606 heartbeater.cc:507] Master 127.26.202.62:36613 requested a full tablet report, sending...
I20260709 13:10:26.476552 27432 webserver.cc:533] Webserver started at http://127.26.202.2:38953/ using document root <none> and password file <none>
I20260709 13:10:26.477224 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:26.477461 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:26.477423 28479 ts_manager.cc:194] Registered new tserver with Master: 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:10:26.477999 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:26.479292 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/instance:
uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
format_stamp: "Formatted at 2026-07-09 13:10:26 on dist-test-slave-008w"
I20260709 13:10:26.479564 28479 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43518
I20260709 13:10:26.485114 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:10:26.488801 28618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.489907 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:26.490345 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root
uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
format_stamp: "Formatted at 2026-07-09 13:10:26 on dist-test-slave-008w"
I20260709 13:10:26.490664 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:26.505947 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:26.507473 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:26.509150 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:26.511475 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:26.511718 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.511969 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:26.512148 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.558207 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.2:39245
I20260709 13:10:26.558320 28680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.2:39245 every 8 connection(s)
I20260709 13:10:26.563884 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:26.572477 28684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:26.573838 28685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:26.578318 28681 heartbeater.cc:344] Connected to a master server at 127.26.202.62:36613
W20260709 13:10:26.578714 28687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:26.578792 28681 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:26.578939 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:26.579917 28681 heartbeater.cc:507] Master 127.26.202.62:36613 requested a full tablet report, sending...
I20260709 13:10:26.580042 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:26.580260 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:26.580386 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602626580375 us; error 0 us; skew 500 ppm
I20260709 13:10:26.581184 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:26.582407 28479 ts_manager.cc:194] Registered new tserver with Master: 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:26.584432 27432 webserver.cc:533] Webserver started at http://127.26.202.3:32969/ using document root <none> and password file <none>
I20260709 13:10:26.584540 28479 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43526
I20260709 13:10:26.585256 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:26.585548 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:26.585906 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:26.587424 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/instance:
uuid: "ed517a03edd141a798f07798667c1c04"
format_stamp: "Formatted at 2026-07-09 13:10:26 on dist-test-slave-008w"
I20260709 13:10:26.592408 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:26.596118 28692 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.597132 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:26.597414 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root
uuid: "ed517a03edd141a798f07798667c1c04"
format_stamp: "Formatted at 2026-07-09 13:10:26 on dist-test-slave-008w"
I20260709 13:10:26.597671 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:26.613101 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:26.614494 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:26.616281 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:26.618759 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:26.618945 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.619232 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:26.619419 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:26.664263 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.3:40339
I20260709 13:10:26.664393 28754 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.3:40339 every 8 connection(s)
I20260709 13:10:26.680750 28755 heartbeater.cc:344] Connected to a master server at 127.26.202.62:36613
I20260709 13:10:26.681216 28755 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:26.681993 28755 heartbeater.cc:507] Master 127.26.202.62:36613 requested a full tablet report, sending...
I20260709 13:10:26.684332 28479 ts_manager.cc:194] Registered new tserver with Master: ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:26.684875 27432 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017547861s
I20260709 13:10:26.686349 28479 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43532
I20260709 13:10:26.714846 28479 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43536:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:26.721239 28479 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:26.922683 28571 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0bc7b3c800463996a3d14ce7e5786f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:26.923089 28569 tablet_service.cc:1511] Processing CreateTablet for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:26.924408 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0bc7b3c800463996a3d14ce7e5786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.925822 28570 tablet_service.cc:1511] Processing CreateTablet for tablet c5e88af67eea4aa588b7cf82a03a9c3d (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:26.927361 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e88af67eea4aa588b7cf82a03a9c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.932528 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0bc7b3c800463996a3d14ce7e5786f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:26.933401 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.934158 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0bc7b3c800463996a3d14ce7e5786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.938858 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0bc7b3c800463996a3d14ce7e5786f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:26.940392 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0bc7b3c800463996a3d14ce7e5786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.942294 28645 tablet_service.cc:1511] Processing CreateTablet for tablet c5e88af67eea4aa588b7cf82a03a9c3d (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:26.943751 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e88af67eea4aa588b7cf82a03a9c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.946302 28644 tablet_service.cc:1511] Processing CreateTablet for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:26.953377 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.953583 28568 tablet_service.cc:1511] Processing CreateTablet for tablet 5080a9ad719842a1b28d579fb99c6282 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:26.954667 28770 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:26.955196 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5080a9ad719842a1b28d579fb99c6282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.954929 28643 tablet_service.cc:1511] Processing CreateTablet for tablet 5080a9ad719842a1b28d579fb99c6282 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:26.956328 28643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5080a9ad719842a1b28d579fb99c6282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.957988 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 35fc728c038d4d8d8827779516ffce5f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:26.959426 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fc728c038d4d8d8827779516ffce5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.971882 28719 tablet_service.cc:1511] Processing CreateTablet for tablet c5e88af67eea4aa588b7cf82a03a9c3d (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:26.973665 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e88af67eea4aa588b7cf82a03a9c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.976732 28718 tablet_service.cc:1511] Processing CreateTablet for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:26.978749 28571 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:26.979521 28717 tablet_service.cc:1511] Processing CreateTablet for tablet 5080a9ad719842a1b28d579fb99c6282 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:26.982687 28567 tablet_service.cc:1511] Processing CreateTablet for tablet e868dee9130744a3bc9fab23a236b03a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:26.983016 28642 tablet_service.cc:1511] Processing CreateTablet for tablet 35fc728c038d4d8d8827779516ffce5f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:26.983980 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.984375 28770 tablet_bootstrap.cc:654] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:26.985818 28716 tablet_service.cc:1511] Processing CreateTablet for tablet 35fc728c038d4d8d8827779516ffce5f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:26.988817 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e868dee9130744a3bc9fab23a236b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.989797 28641 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:26.992352 28640 tablet_service.cc:1511] Processing CreateTablet for tablet e868dee9130744a3bc9fab23a236b03a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:26.994408 28714 tablet_service.cc:1511] Processing CreateTablet for tablet e868dee9130744a3bc9fab23a236b03a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:26.984434 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fc728c038d4d8d8827779516ffce5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.996832 28718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.996740 28715 tablet_service.cc:1511] Processing CreateTablet for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:27.000435 28570 tablet_service.cc:1511] Processing CreateTablet for tablet 50de2f4297b44d57a1acdb6f6af1f02f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:27.001951 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50de2f4297b44d57a1acdb6f6af1f02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.002030 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.002789 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5080a9ad719842a1b28d579fb99c6282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.011859 28639 tablet_service.cc:1511] Processing CreateTablet for tablet 50de2f4297b44d57a1acdb6f6af1f02f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:27.013827 28716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fc728c038d4d8d8827779516ffce5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.017484 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e868dee9130744a3bc9fab23a236b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.018143 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 50de2f4297b44d57a1acdb6f6af1f02f (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:27.019644 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50de2f4297b44d57a1acdb6f6af1f02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.021620 28571 tablet_service.cc:1511] Processing CreateTablet for tablet 31c48009ac1c494fac1b2eb14ee5e90e (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:27.022984 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c48009ac1c494fac1b2eb14ee5e90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.025558 28638 tablet_service.cc:1511] Processing CreateTablet for tablet 31c48009ac1c494fac1b2eb14ee5e90e (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:27.026798 28712 tablet_service.cc:1511] Processing CreateTablet for tablet 31c48009ac1c494fac1b2eb14ee5e90e (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:27.028316 28712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c48009ac1c494fac1b2eb14ee5e90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.029508 28638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c48009ac1c494fac1b2eb14ee5e90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.033565 28639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50de2f4297b44d57a1acdb6f6af1f02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.038127 28637 tablet_service.cc:1511] Processing CreateTablet for tablet 220dd03eba974f23a47374679c6d2fb7 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:27.039777 28637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220dd03eba974f23a47374679c6d2fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.039716 28711 tablet_service.cc:1511] Processing CreateTablet for tablet 220dd03eba974f23a47374679c6d2fb7 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:27.041386 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220dd03eba974f23a47374679c6d2fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.041581 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.041826 28567 tablet_service.cc:1511] Processing CreateTablet for tablet ed9ebd651cf34b18b29911e247dc9834 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:27.043260 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9ebd651cf34b18b29911e247dc9834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.049446 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e868dee9130744a3bc9fab23a236b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.051636 28568 tablet_service.cc:1511] Processing CreateTablet for tablet f2a02df07d6643edb55e844cfc7fbe3e (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:27.053351 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a02df07d6643edb55e844cfc7fbe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.060192 28570 tablet_service.cc:1511] Processing CreateTablet for tablet 220dd03eba974f23a47374679c6d2fb7 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:27.061791 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220dd03eba974f23a47374679c6d2fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.066902 28571 tablet_service.cc:1511] Processing CreateTablet for tablet 0817000b219d44bc891d4c9a50a56999 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:27.068463 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0817000b219d44bc891d4c9a50a56999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.074205 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 8877b0f244204425983fb5d505497cf3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:27.075764 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8877b0f244204425983fb5d505497cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.084754 28645 tablet_service.cc:1511] Processing CreateTablet for tablet ed9ebd651cf34b18b29911e247dc9834 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:27.086205 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9ebd651cf34b18b29911e247dc9834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.091037 28770 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:27.091578 28770 ts_tablet_manager.cc:1403] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.000s
I20260709 13:10:27.094544 28770 raft_consensus.cc:359] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.095587 28770 raft_consensus.cc:385] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.096824 28770 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.097707 28770 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.114421 28712 tablet_service.cc:1511] Processing CreateTablet for tablet ed9ebd651cf34b18b29911e247dc9834 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:27.114814 28638 tablet_service.cc:1511] Processing CreateTablet for tablet 0817000b219d44bc891d4c9a50a56999 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:27.122978 28772 tablet_bootstrap.cc:492] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:27.130290 28644 tablet_service.cc:1511] Processing CreateTablet for tablet f2a02df07d6643edb55e844cfc7fbe3e (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:27.132247 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a02df07d6643edb55e844cfc7fbe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.139007 28713 tablet_service.cc:1511] Processing CreateTablet for tablet f2a02df07d6643edb55e844cfc7fbe3e (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:27.140208 28638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0817000b219d44bc891d4c9a50a56999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.144646 28606 heartbeater.cc:499] Master 127.26.202.62:36613 was elected leader, sending a full tablet report...
I20260709 13:10:27.145601 28571 tablet_service.cc:1511] Processing CreateTablet for tablet a9b5276724f2468eb1927555abdfcc2a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:27.147051 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b5276724f2468eb1927555abdfcc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.136714 28639 tablet_service.cc:1511] Processing CreateTablet for tablet 8877b0f244204425983fb5d505497cf3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:27.158396 28639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8877b0f244204425983fb5d505497cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.154433 28637 tablet_service.cc:1511] Processing CreateTablet for tablet a9b5276724f2468eb1927555abdfcc2a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:27.155258 28567 tablet_service.cc:1511] Processing CreateTablet for tablet f8259ae9bad54fb1b2f26e7b813a8bd6 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:27.154145 28719 tablet_service.cc:1511] Processing CreateTablet for tablet 0817000b219d44bc891d4c9a50a56999 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:27.165162 28712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9ebd651cf34b18b29911e247dc9834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.173986 28770 ts_tablet_manager.cc:1434] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.082s	user 0.011s	sys 0.000s
I20260709 13:10:27.174270 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8259ae9bad54fb1b2f26e7b813a8bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.175117 28770 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:27.175717 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a02df07d6643edb55e844cfc7fbe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.177363 28717 tablet_service.cc:1511] Processing CreateTablet for tablet 8877b0f244204425983fb5d505497cf3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:27.182318 28637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b5276724f2468eb1927555abdfcc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.182526 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0817000b219d44bc891d4c9a50a56999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.184983 28772 tablet_bootstrap.cc:654] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.185729 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8877b0f244204425983fb5d505497cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.192445 28774 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:27.198376 28711 tablet_service.cc:1511] Processing CreateTablet for tablet a9b5276724f2468eb1927555abdfcc2a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:27.200023 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b5276724f2468eb1927555abdfcc2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.219568 28774 tablet_bootstrap.cc:654] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.240566 28718 tablet_service.cc:1511] Processing CreateTablet for tablet f8259ae9bad54fb1b2f26e7b813a8bd6 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:27.245173 28570 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed00f783ec545f7a156d77cd9062498 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:27.246098 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed00f783ec545f7a156d77cd9062498 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:27.247027 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed00f783ec545f7a156d77cd9062498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.247848 28718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8259ae9bad54fb1b2f26e7b813a8bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.248626 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed00f783ec545f7a156d77cd9062498 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:27.250036 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed00f783ec545f7a156d77cd9062498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.249910 28773 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.250633 28773 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.253644 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed00f783ec545f7a156d77cd9062498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.259250 28773 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:27.283555 28770 tablet_bootstrap.cc:654] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:27.284276 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:27.297976 28571 tablet_service.cc:1511] Processing CreateTablet for tablet 6003600bf2df4ecbaeff7fa53e044e91 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:27.298972 28772 tablet_bootstrap.cc:492] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:27.299329 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6003600bf2df4ecbaeff7fa53e044e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.299614 28772 ts_tablet_manager.cc:1403] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.177s	user 0.035s	sys 0.045s
I20260709 13:10:27.302949 28772 raft_consensus.cc:359] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.303730 28772 raft_consensus.cc:385] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.304060 28772 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.304842 28772 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.308465 28712 tablet_service.cc:1511] Processing CreateTablet for tablet 6003600bf2df4ecbaeff7fa53e044e91 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:27.305718 28639 tablet_service.cc:1511] Processing CreateTablet for tablet f8259ae9bad54fb1b2f26e7b813a8bd6 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:27.309878 28712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6003600bf2df4ecbaeff7fa53e044e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.311841 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:27.316764 28567 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:27.318306 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.321790 28639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8259ae9bad54fb1b2f26e7b813a8bd6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:27.323410 28545 leader_election.cc:343] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.325901 28637 tablet_service.cc:1511] Processing CreateTablet for tablet 6003600bf2df4ecbaeff7fa53e044e91 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:27.326591 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:27.330205 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:27.330691 28715 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:27.334313 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.335148 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.332314 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 04a304ac38c74ef5af43514ad1732e01 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:27.337975 28637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6003600bf2df4ecbaeff7fa53e044e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.338305 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a304ac38c74ef5af43514ad1732e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.334867 28638 tablet_service.cc:1511] Processing CreateTablet for tablet 04a304ac38c74ef5af43514ad1732e01 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:27.345394 28568 tablet_service.cc:1511] Processing CreateTablet for tablet 788a727f92304a5a9926b2f15933af88 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:27.353148 28644 tablet_service.cc:1511] Processing CreateTablet for tablet 788a727f92304a5a9926b2f15933af88 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:27.356961 28719 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff2d657aad54bbe97b4cda17edf3957 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:27.357546 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788a727f92304a5a9926b2f15933af88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.358309 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff2d657aad54bbe97b4cda17edf3957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.358130 28570 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff2d657aad54bbe97b4cda17edf3957 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:27.359372 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff2d657aad54bbe97b4cda17edf3957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.355798 28711 tablet_service.cc:1511] Processing CreateTablet for tablet 788a727f92304a5a9926b2f15933af88 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:27.364578 28641 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff2d657aad54bbe97b4cda17edf3957 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:27.366123 28718 tablet_service.cc:1511] Processing CreateTablet for tablet 04a304ac38c74ef5af43514ad1732e01 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:27.369093 28566 tablet_service.cc:1511] Processing CreateTablet for tablet 4fbdeb3c093d412b871d55add092cb37 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:27.370942 28774 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:27.371318 28566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fbdeb3c093d412b871d55add092cb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.371483 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788a727f92304a5a9926b2f15933af88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.371511 28774 ts_tablet_manager.cc:1403] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.179s	user 0.021s	sys 0.025s
I20260709 13:10:27.380071 28774 raft_consensus.cc:359] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.367303 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788a727f92304a5a9926b2f15933af88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:27.381192 28546 leader_election.cc:343] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.381767 28546 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:27.382577 28773 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.385898 28714 tablet_service.cc:1511] Processing CreateTablet for tablet 4fbdeb3c093d412b871d55add092cb37 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:27.387337 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fbdeb3c093d412b871d55add092cb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.380862 28774 raft_consensus.cc:385] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.396534 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff2d657aad54bbe97b4cda17edf3957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.398696 28716 tablet_service.cc:1511] Processing CreateTablet for tablet a055ab5c44004b99a22596b86a4c2a45 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:27.395828 28774 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.406137 28774 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.418998 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce0ec29e76b45f59ccace895ac58f28 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:27.420338 28645 tablet_service.cc:1511] Processing CreateTablet for tablet 4fbdeb3c093d412b871d55add092cb37 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:27.418298 28718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a304ac38c74ef5af43514ad1732e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.423607 28565 tablet_service.cc:1511] Processing CreateTablet for tablet a055ab5c44004b99a22596b86a4c2a45 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:27.430308 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a055ab5c44004b99a22596b86a4c2a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.437471 28638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a304ac38c74ef5af43514ad1732e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.448325 28642 tablet_service.cc:1511] Processing CreateTablet for tablet a055ab5c44004b99a22596b86a4c2a45 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:27.448916 28770 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:27.449631 28770 ts_tablet_manager.cc:1403] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.275s	user 0.011s	sys 0.006s
I20260709 13:10:27.446169 28716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a055ab5c44004b99a22596b86a4c2a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.453660 28772 ts_tablet_manager.cc:1434] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.154s	user 0.012s	sys 0.007s
I20260709 13:10:27.453361 28717 tablet_service.cc:1511] Processing CreateTablet for tablet cbbd878f3c5b4d8f829666660878c2ef (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:27.454900 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbd878f3c5b4d8f829666660878c2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.456487 28770 raft_consensus.cc:359] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.458281 28643 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce0ec29e76b45f59ccace895ac58f28 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:27.458390 28770 raft_consensus.cc:385] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.459487 28770 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.461411 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce0ec29e76b45f59ccace895ac58f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.463184 28564 tablet_service.cc:1511] Processing CreateTablet for tablet cbbd878f3c5b4d8f829666660878c2ef (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:27.464566 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbd878f3c5b4d8f829666660878c2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.469287 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fbdeb3c093d412b871d55add092cb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.470402 28563 tablet_service.cc:1511] Processing CreateTablet for tablet b051a542445141ae99fc26201430f3ae (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:27.470978 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a055ab5c44004b99a22596b86a4c2a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.471971 28563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b051a542445141ae99fc26201430f3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.474143 28643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce0ec29e76b45f59ccace895ac58f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.478374 28711 tablet_service.cc:1511] Processing CreateTablet for tablet b051a542445141ae99fc26201430f3ae (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:27.480031 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b051a542445141ae99fc26201430f3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.481422 28681 heartbeater.cc:499] Master 127.26.202.62:36613 was elected leader, sending a full tablet report...
I20260709 13:10:27.488282 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 07a2389891a145aeb0c85e04f061855a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:27.488576 28562 tablet_service.cc:1511] Processing CreateTablet for tablet 07a2389891a145aeb0c85e04f061855a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:27.490031 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a2389891a145aeb0c85e04f061855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.490120 28562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a2389891a145aeb0c85e04f061855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.430673 28567 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce0ec29e76b45f59ccace895ac58f28 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:27.499780 28755 heartbeater.cc:499] Master 127.26.202.62:36613 was elected leader, sending a full tablet report...
I20260709 13:10:27.501886 28772 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:27.522660 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce0ec29e76b45f59ccace895ac58f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.535620 28566 tablet_service.cc:1511] Processing CreateTablet for tablet 1404e4e726904b9da0d047a2f50142f0 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:27.537564 28566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1404e4e726904b9da0d047a2f50142f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.502903 28640 tablet_service.cc:1511] Processing CreateTablet for tablet cbbd878f3c5b4d8f829666660878c2ef (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:27.510097 28774 ts_tablet_manager.cc:1434] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.134s	user 0.017s	sys 0.009s
I20260709 13:10:27.515210 28712 tablet_service.cc:1511] Processing CreateTablet for tablet 1404e4e726904b9da0d047a2f50142f0 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:27.517338 28770 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.545840 28773 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.546167 28712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1404e4e726904b9da0d047a2f50142f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.546468 28773 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.549391 28774 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:27.555097 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbbd878f3c5b4d8f829666660878c2ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.575110 28773 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:27.575832 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:27.576275 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:10:27.578246 28545 leader_election.cc:343] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:27.580049 28546 leader_election.cc:343] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.580490 28546 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:27.591303 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 07a2389891a145aeb0c85e04f061855a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:27.597155 28637 tablet_service.cc:1511] Processing CreateTablet for tablet 1404e4e726904b9da0d047a2f50142f0 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:27.599483 28639 tablet_service.cc:1511] Processing CreateTablet for tablet b051a542445141ae99fc26201430f3ae (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:27.601231 28719 tablet_service.cc:1511] Processing CreateTablet for tablet 507239c483484d3abb552ab606bfd45c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:27.601552 28571 tablet_service.cc:1511] Processing CreateTablet for tablet a8522d0aafd845c3b071def21aaaec24 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:27.636938 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8522d0aafd845c3b071def21aaaec24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.640604 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507239c483484d3abb552ab606bfd45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.606549 28570 tablet_service.cc:1511] Processing CreateTablet for tablet 507239c483484d3abb552ab606bfd45c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:27.614178 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a2389891a145aeb0c85e04f061855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.615075 28714 tablet_service.cc:1511] Processing CreateTablet for tablet a8522d0aafd845c3b071def21aaaec24 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:27.620193 28774 tablet_bootstrap.cc:654] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.623701 28772 tablet_bootstrap.cc:654] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.624029 28773 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.600754 28643 tablet_service.cc:1511] Processing CreateTablet for tablet 507239c483484d3abb552ab606bfd45c (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:27.645638 28770 ts_tablet_manager.cc:1434] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.196s	user 0.008s	sys 0.015s
I20260709 13:10:27.625191 28717 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae379c498ad42cb8a8201bd2640f6e3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:27.646005 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8522d0aafd845c3b071def21aaaec24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.646632 28770 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:27.628228 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae379c498ad42cb8a8201bd2640f6e3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:27.647814 28637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1404e4e726904b9da0d047a2f50142f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.634563 28715 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8a47d75d1241b7acc3796f628c9196 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:27.640228 28644 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae379c498ad42cb8a8201bd2640f6e3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:27.627573 28641 tablet_service.cc:1511] Processing CreateTablet for tablet a8522d0aafd845c3b071def21aaaec24 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:27.646695 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae379c498ad42cb8a8201bd2640f6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.644556 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507239c483484d3abb552ab606bfd45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.653400 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8a47d75d1241b7acc3796f628c9196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.653436 28643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507239c483484d3abb552ab606bfd45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.661803 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8522d0aafd845c3b071def21aaaec24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.665247 28770 tablet_bootstrap.cc:654] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.672874 28568 tablet_service.cc:1511] Processing CreateTablet for tablet b644d4c5865d4fd89ed3c9e770e2eaac (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:27.677584 28565 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8a47d75d1241b7acc3796f628c9196 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:27.678902 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae379c498ad42cb8a8201bd2640f6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.680644 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b644d4c5865d4fd89ed3c9e770e2eaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.681176 28639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b051a542445141ae99fc26201430f3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.686509 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8a47d75d1241b7acc3796f628c9196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.695472 28772 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:27.696081 28772 ts_tablet_manager.cc:1403] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.194s	user 0.020s	sys 0.005s
I20260709 13:10:27.699914 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae379c498ad42cb8a8201bd2640f6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.703821 28772 raft_consensus.cc:359] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.704682 28772 raft_consensus.cc:385] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.705044 28772 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.718338 28638 tablet_service.cc:1511] Processing CreateTablet for tablet b644d4c5865d4fd89ed3c9e770e2eaac (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:27.720306 28638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b644d4c5865d4fd89ed3c9e770e2eaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.725513 28564 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9f7022e7f24efaa9b25cb129729504 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:27.726055 28642 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8a47d75d1241b7acc3796f628c9196 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:27.726928 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9f7022e7f24efaa9b25cb129729504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.727557 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8a47d75d1241b7acc3796f628c9196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.731262 28645 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9f7022e7f24efaa9b25cb129729504 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:27.732592 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9f7022e7f24efaa9b25cb129729504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.738336 28772 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.749519 28772 ts_tablet_manager.cc:1434] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.001s
I20260709 13:10:27.760892 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9f7022e7f24efaa9b25cb129729504 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:27.762293 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9f7022e7f24efaa9b25cb129729504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.765723 28712 tablet_service.cc:1511] Processing CreateTablet for tablet b644d4c5865d4fd89ed3c9e770e2eaac (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:27.767442 28712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b644d4c5865d4fd89ed3c9e770e2eaac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.785624 28772 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:27.793201 28780 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.793906 28780 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.826680 28781 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.827406 28781 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.868602 28774 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:27.869175 28774 ts_tablet_manager.cc:1403] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.320s	user 0.016s	sys 0.017s
I20260709 13:10:27.862172 28780 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:27.872116 28774 raft_consensus.cc:359] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.872906 28774 raft_consensus.cc:385] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.895991 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 55ea2a86b4ee4d399b9b439246c9d92a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:27.883061 28774 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.884680 28781 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:27.905444 28774 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.907107 28770 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:27.913195 28770 ts_tablet_manager.cc:1403] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.267s	user 0.022s	sys 0.009s
I20260709 13:10:27.908309 28711 tablet_service.cc:1511] Processing CreateTablet for tablet e3680992ef7b48798cdf5ea60753f423 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:27.908622 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ea2a86b4ee4d399b9b439246c9d92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.920987 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3680992ef7b48798cdf5ea60753f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.920714 28780 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.921769 28780 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:27.924829 28465 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 110990us
I20260709 13:10:27.928929 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 55ea2a86b4ee4d399b9b439246c9d92a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:27.932366 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ea2a86b4ee4d399b9b439246c9d92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.944263 28780 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:27.939472 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 55ea2a86b4ee4d399b9b439246c9d92a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:27.944819 28571 tablet_service.cc:1511] Processing CreateTablet for tablet e3680992ef7b48798cdf5ea60753f423 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:27.945766 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ea2a86b4ee4d399b9b439246c9d92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.946069 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3680992ef7b48798cdf5ea60753f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.947732 28642 tablet_service.cc:1511] Processing CreateTablet for tablet e3680992ef7b48798cdf5ea60753f423 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:27.950125 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3680992ef7b48798cdf5ea60753f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.950325 28774 ts_tablet_manager.cc:1434] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.004s
I20260709 13:10:27.962033 28774 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:27.916417 28770 raft_consensus.cc:359] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.970753 28772 tablet_bootstrap.cc:654] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.976971 28774 tablet_bootstrap.cc:654] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.992604 28641 tablet_service.cc:1511] Processing CreateTablet for tablet f91cfbc609274be4a869217b22fc197b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:27.993719 28772 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:27.994027 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91cfbc609274be4a869217b22fc197b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.994328 28772 ts_tablet_manager.cc:1403] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.209s	user 0.015s	sys 0.004s
I20260709 13:10:27.997814 28772 raft_consensus.cc:359] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:27.998668 28772 raft_consensus.cc:385] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.999029 28772 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.999948 28772 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.006181 28564 tablet_service.cc:1511] Processing CreateTablet for tablet f91cfbc609274be4a869217b22fc197b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:28.010010 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91cfbc609274be4a869217b22fc197b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.967068 28770 raft_consensus.cc:385] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.023451 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:28.022333 28770 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.024492 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:28.025336 28695 leader_election.cc:343] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.023831 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:28.025169 28579 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:28.030575 28772 ts_tablet_manager.cc:1434] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.036s	user 0.013s	sys 0.013s
I20260709 13:10:28.031576 28772 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
W20260709 13:10:28.034742 28621 leader_election.cc:343] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.035620 28711 tablet_service.cc:1511] Processing CreateTablet for tablet f91cfbc609274be4a869217b22fc197b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:28.037101 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91cfbc609274be4a869217b22fc197b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.040266 28621 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:28.040132 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 95579b54a2ec400081e0a348b2395dfc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:28.041132 28780 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.035297 28770 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.041778 28780 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.042213 28780 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.043488 28770 ts_tablet_manager.cc:1434] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.130s	user 0.003s	sys 0.004s
I20260709 13:10:28.044164 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 95579b54a2ec400081e0a348b2395dfc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:28.041428 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95579b54a2ec400081e0a348b2395dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.046797 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95579b54a2ec400081e0a348b2395dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.048959 28571 tablet_service.cc:1511] Processing CreateTablet for tablet 3d30c923964844ccad86f6776b30b074 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:28.050218 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d30c923964844ccad86f6776b30b074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.044564 28770 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:28.058187 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 95579b54a2ec400081e0a348b2395dfc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:28.060607 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:28.061548 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:28.066273 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 3d30c923964844ccad86f6776b30b074 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:28.067713 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d30c923964844ccad86f6776b30b074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.064177 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 3d30c923964844ccad86f6776b30b074 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:28.069473 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d30c923964844ccad86f6776b30b074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.070519 28772 tablet_bootstrap.cc:654] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:28.073891 28620 leader_election.cc:343] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.074373 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:28.077757 28780 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.080579 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:28.081213 28579 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.073163 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95579b54a2ec400081e0a348b2395dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.081642 28562 tablet_service.cc:1511] Processing CreateTablet for tablet b445e2209eb343cf9d87aa63ba0becbc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:28.083952 28774 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:28.089788 28774 ts_tablet_manager.cc:1403] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.004s
I20260709 13:10:28.090571 28579 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:28.091514 28780 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:28.094743 28642 tablet_service.cc:1511] Processing CreateTablet for tablet b445e2209eb343cf9d87aa63ba0becbc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:28.096040 28562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b445e2209eb343cf9d87aa63ba0becbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.096125 28621 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:28.096489 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b445e2209eb343cf9d87aa63ba0becbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.095821 28780 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.098486 28780 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.098805 28564 tablet_service.cc:1511] Processing CreateTablet for tablet e1210d5a904b4f328048e3c924967b95 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:28.098910 28780 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:28.100286 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1210d5a904b4f328048e3c924967b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.101596 28780 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.100308 28711 tablet_service.cc:1511] Processing CreateTablet for tablet b445e2209eb343cf9d87aa63ba0becbc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:28.107232 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b445e2209eb343cf9d87aa63ba0becbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.105348 28774 raft_consensus.cc:359] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.113602 28774 raft_consensus.cc:385] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.120409 28641 tablet_service.cc:1511] Processing CreateTablet for tablet e1210d5a904b4f328048e3c924967b95 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:28.123015 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1210d5a904b4f328048e3c924967b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.123580 28713 tablet_service.cc:1511] Processing CreateTablet for tablet e1210d5a904b4f328048e3c924967b95 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:28.123972 28479 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.124836 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1210d5a904b4f328048e3c924967b95. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:28.128584 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54060.9us
W20260709 13:10:28.136425 28620 leader_election.cc:343] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.138358 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:28.117273 28774 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.141804 28774 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.144796 28774 ts_tablet_manager.cc:1434] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.000s
I20260709 13:10:28.152328 28571 tablet_service.cc:1511] Processing CreateTablet for tablet b905a9410ce147d093be203901159c35 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:28.154618 28646 tablet_service.cc:1511] Processing CreateTablet for tablet b905a9410ce147d093be203901159c35 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:28.162345 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b905a9410ce147d093be203901159c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.164603 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b905a9410ce147d093be203901159c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.166126 28772 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:28.166643 28772 ts_tablet_manager.cc:1403] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.135s	user 0.022s	sys 0.010s
I20260709 13:10:28.169680 28772 raft_consensus.cc:359] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.170464 28772 raft_consensus.cc:385] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.170198 28712 tablet_service.cc:1511] Processing CreateTablet for tablet b905a9410ce147d093be203901159c35 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:28.170809 28772 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.171806 28712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b905a9410ce147d093be203901159c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.171605 28772 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:28.173650 28620 leader_election.cc:343] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.173950 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:28.174942 28717 tablet_service.cc:1511] Processing CreateTablet for tablet 299a315de86c44c0a3613934339689e4 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:28.176604 28568 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf5b8cf3c9a478da7deba36d7acbe96 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:28.177107 28774 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:28.178910 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf5b8cf3c9a478da7deba36d7acbe96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.179683 28638 tablet_service.cc:1511] Processing CreateTablet for tablet 299a315de86c44c0a3613934339689e4 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:28.181097 28638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299a315de86c44c0a3613934339689e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.181773 28645 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf5b8cf3c9a478da7deba36d7acbe96 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:28.182732 28566 tablet_service.cc:1511] Processing CreateTablet for tablet 299a315de86c44c0a3613934339689e4 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:28.183152 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf5b8cf3c9a478da7deba36d7acbe96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.183753 28566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299a315de86c44c0a3613934339689e4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:28.179085 28695 leader_election.cc:343] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.185670 28796 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.185566 28695 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:28.186197 28796 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.187126 28791 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.188241 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299a315de86c44c0a3613934339689e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.190546 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:28.191253 28579 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:28.188771 28796 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:28.197530 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:28.198616 28796 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.199051 28796 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.199546 28796 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.200189 28564 tablet_service.cc:1511] Processing CreateTablet for tablet 4380fb261ad646d49d956c3ba5036856 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:28.201517 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4380fb261ad646d49d956c3ba5036856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.203027 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 7cf5b8cf3c9a478da7deba36d7acbe96 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:28.211529 28796 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.213687 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf5b8cf3c9a478da7deba36d7acbe96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.215183 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:28.215901 28579 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.225596 28796 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:28.226716 28772 ts_tablet_manager.cc:1434] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:10:28.230176 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:28.234334 28644 tablet_service.cc:1511] Processing CreateTablet for tablet 4380fb261ad646d49d956c3ba5036856 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:28.234686 28711 tablet_service.cc:1511] Processing CreateTablet for tablet 4380fb261ad646d49d956c3ba5036856 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:28.236027 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4380fb261ad646d49d956c3ba5036856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.236532 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4380fb261ad646d49d956c3ba5036856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.244783 28643 tablet_service.cc:1511] Processing CreateTablet for tablet c23648b5c68c4f9584b74b6a8ff47454 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:28.246271 28643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23648b5c68c4f9584b74b6a8ff47454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.246546 28772 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:28.255460 28579 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:28.257752 28715 tablet_service.cc:1511] Processing CreateTablet for tablet c23648b5c68c4f9584b74b6a8ff47454 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:28.260543 28772 tablet_bootstrap.cc:654] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.263211 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23648b5c68c4f9584b74b6a8ff47454. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:28.261566 28620 leader_election.cc:343] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.261785 28568 tablet_service.cc:1511] Processing CreateTablet for tablet 61d9db35d52e47849f6205fef1ea841a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:28.262009 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:10:28.270314 28620 leader_election.cc:343] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.270315 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d9db35d52e47849f6205fef1ea841a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.273934 28770 tablet_bootstrap.cc:654] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.265836 28571 tablet_service.cc:1511] Processing CreateTablet for tablet c23648b5c68c4f9584b74b6a8ff47454 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:28.278116 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23648b5c68c4f9584b74b6a8ff47454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.265836 28711 tablet_service.cc:1511] Processing CreateTablet for tablet 61d9db35d52e47849f6205fef1ea841a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:28.279374 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d9db35d52e47849f6205fef1ea841a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.290352 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:10:28.292049 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:28.292879 28796 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.293569 28796 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:28.293862 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 6caf9ec933124d00b3e0e2cfeccd317b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:28.295224 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6caf9ec933124d00b3e0e2cfeccd317b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.294727 28796 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.299866 28643 tablet_service.cc:1511] Processing CreateTablet for tablet 6caf9ec933124d00b3e0e2cfeccd317b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:28.301119 28791 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.301893 28643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6caf9ec933124d00b3e0e2cfeccd317b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.301591 28791 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.304339 28791 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:28.305794 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:28.306159 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:28.309276 28656 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
W20260709 13:10:28.310626 28695 leader_election.cc:343] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.311362 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:28.312498 28791 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.312861 28791 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.311381 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 6caf9ec933124d00b3e0e2cfeccd317b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:28.313263 28641 tablet_service.cc:1511] Processing CreateTablet for tablet 61d9db35d52e47849f6205fef1ea841a (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:28.314996 28774 tablet_bootstrap.cc:654] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.315275 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d9db35d52e47849f6205fef1ea841a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.313261 28791 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.317306 28566 tablet_service.cc:1511] Processing CreateTablet for tablet 908e88869b314709ad606ff91b8da799 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:28.318776 28566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908e88869b314709ad606ff91b8da799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.322263 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 908e88869b314709ad606ff91b8da799 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:28.323764 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908e88869b314709ad606ff91b8da799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.325122 28714 tablet_service.cc:1511] Processing CreateTablet for tablet 908e88869b314709ad606ff91b8da799 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:28.332368 28562 tablet_service.cc:1511] Processing CreateTablet for tablet fce221ba4bb64300a7d2ae39b8b95b77 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:28.334160 28562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce221ba4bb64300a7d2ae39b8b95b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.345986 28770 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:28.346529 28770 ts_tablet_manager.cc:1403] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.302s	user 0.022s	sys 0.001s
I20260709 13:10:28.348191 28791 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.349236 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6caf9ec933124d00b3e0e2cfeccd317b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.349515 28770 raft_consensus.cc:359] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.350234 28770 raft_consensus.cc:385] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.350521 28770 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.351390 28770 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.353344 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908e88869b314709ad606ff91b8da799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.363210 28770 ts_tablet_manager.cc:1434] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:10:28.372184 28772 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:28.372684 28772 ts_tablet_manager.cc:1403] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.026s
I20260709 13:10:28.376091 28772 raft_consensus.cc:359] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.376883 28772 raft_consensus.cc:385] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.377211 28772 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.377890 28772 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.378921 28715 tablet_service.cc:1511] Processing CreateTablet for tablet fce221ba4bb64300a7d2ae39b8b95b77 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:28.380041 28642 tablet_service.cc:1511] Processing CreateTablet for tablet aee1d5c683234ed9969b70eb583d0724 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:28.381084 28791 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:28.381346 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee1d5c683234ed9969b70eb583d0724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.380981 28565 tablet_service.cc:1511] Processing CreateTablet for tablet aee1d5c683234ed9969b70eb583d0724 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:28.380431 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce221ba4bb64300a7d2ae39b8b95b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.385820 28711 tablet_service.cc:1511] Processing CreateTablet for tablet aee1d5c683234ed9969b70eb583d0724 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:28.386282 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:28.387373 28770 tablet_bootstrap.cc:492] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
W20260709 13:10:28.387897 28695 leader_election.cc:343] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.388835 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee1d5c683234ed9969b70eb583d0724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.385708 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:28.394634 28656 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.398773 28791 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.399286 28791 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.400775 28770 tablet_bootstrap.cc:654] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.404816 28712 tablet_service.cc:1511] Processing CreateTablet for tablet 220149aed66a471b9a682f9229ae53fd (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:28.406849 28712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220149aed66a471b9a682f9229ae53fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.406778 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:28.407624 28655 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:28.409487 28719 tablet_service.cc:1511] Processing CreateTablet for tablet de05bba072764f32aeb479edb07a9d4b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:28.411911 28695 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:28.412773 28781 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.413314 28781 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.412986 28718 tablet_service.cc:1511] Processing CreateTablet for tablet eb791c0c5eb14aff83f666f36ab82a30 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:28.413731 28781 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.415333 28571 tablet_service.cc:1511] Processing CreateTablet for tablet 220149aed66a471b9a682f9229ae53fd (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:28.409408 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee1d5c683234ed9969b70eb583d0724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.417572 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:28.418417 28718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb791c0c5eb14aff83f666f36ab82a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.419059 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220149aed66a471b9a682f9229ae53fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.419536 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de05bba072764f32aeb479edb07a9d4b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:28.424891 28695 leader_election.cc:343] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.404729 28791 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:28.431165 28656 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:28.432245 28643 tablet_service.cc:1511] Processing CreateTablet for tablet eb791c0c5eb14aff83f666f36ab82a30 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:28.434231 28643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb791c0c5eb14aff83f666f36ab82a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.434726 28638 tablet_service.cc:1511] Processing CreateTablet for tablet de05bba072764f32aeb479edb07a9d4b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:28.436136 28638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de05bba072764f32aeb479edb07a9d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.438109 28569 tablet_service.cc:1511] Processing CreateTablet for tablet eb791c0c5eb14aff83f666f36ab82a30 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:28.432631 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 220149aed66a471b9a682f9229ae53fd (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:28.439424 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb791c0c5eb14aff83f666f36ab82a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.442571 28772 ts_tablet_manager.cc:1434] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:10:28.453913 28644 tablet_service.cc:1511] Processing CreateTablet for tablet fce221ba4bb64300a7d2ae39b8b95b77 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:28.471290 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:28.476872 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 74487246ff8b4903996c628e2ca7c948 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:28.475670 28791 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.478188 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74487246ff8b4903996c628e2ca7c948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.486146 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 74487246ff8b4903996c628e2ca7c948 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:28.486513 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 74487246ff8b4903996c628e2ca7c948 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:28.487784 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74487246ff8b4903996c628e2ca7c948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.493685 28781 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.494179 28568 tablet_service.cc:1511] Processing CreateTablet for tablet de05bba072764f32aeb479edb07a9d4b (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:28.495580 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de05bba072764f32aeb479edb07a9d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.496250 28781 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:28.484357 28772 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:28.497737 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:28.500042 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:10:28.501909 28695 leader_election.cc:343] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.500783 28656 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.518643 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce221ba4bb64300a7d2ae39b8b95b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.518707 28770 tablet_bootstrap.cc:492] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:28.526252 28770 ts_tablet_manager.cc:1403] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.013s
I20260709 13:10:28.530586 28564 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0b4abdc504f32a67b93235778cdbc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:28.531016 28796 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.531373 28645 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0b4abdc504f32a67b93235778cdbc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:28.531976 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0b4abdc504f32a67b93235778cdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.536546 28782 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.537081 28782 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.539247 28782 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:28.540169 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:28.535658 28571 tablet_service.cc:1511] Processing CreateTablet for tablet e1d00e421d5e40fb93fa17b07c0e88a3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:28.542455 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:10:28.544521 28546 leader_election.cc:343] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:28.545424 28545 leader_election.cc:343] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.545897 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:28.546489 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d00e421d5e40fb93fa17b07c0e88a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.547360 28782 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.551192 28656 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:28.557941 28711 tablet_service.cc:1511] Processing CreateTablet for tablet bdc0b4abdc504f32a67b93235778cdbc (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:28.559144 28711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0b4abdc504f32a67b93235778cdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.523466 28791 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:28.563548 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220149aed66a471b9a682f9229ae53fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.577965 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0b4abdc504f32a67b93235778cdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.579262 28791 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.586268 28772 tablet_bootstrap.cc:654] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.575695 28695 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:28.589795 28638 tablet_service.cc:1511] Processing CreateTablet for tablet e1d00e421d5e40fb93fa17b07c0e88a3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:28.591588 28714 tablet_service.cc:1511] Processing CreateTablet for tablet e1d00e421d5e40fb93fa17b07c0e88a3 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:28.591985 28774 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:28.592955 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d00e421d5e40fb93fa17b07c0e88a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.595376 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74487246ff8b4903996c628e2ca7c948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.589797 28808 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.597694 28808 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:28.598173 28770 raft_consensus.cc:359] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.598941 28770 raft_consensus.cc:385] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.599126 28774 ts_tablet_manager.cc:1403] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.422s	user 0.023s	sys 0.016s
I20260709 13:10:28.599269 28770 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.600015 28770 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.607312 28774 raft_consensus.cc:359] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.608500 28774 raft_consensus.cc:385] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.609681 28479 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.613261 28808 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.619166 28641 tablet_service.cc:1511] Processing CreateTablet for tablet bd08c8d0651d4f21937f0b958dcaaba7 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:28.620831 28715 tablet_service.cc:1511] Processing CreateTablet for tablet bd08c8d0651d4f21937f0b958dcaaba7 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:28.622171 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd08c8d0651d4f21937f0b958dcaaba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.614890 28571 tablet_service.cc:1511] Processing CreateTablet for tablet bd08c8d0651d4f21937f0b958dcaaba7 (DEFAULT_TABLE table=test-workload [id=968a8e8c399e43e1b6426057d66f2f19]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:28.626945 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd08c8d0651d4f21937f0b958dcaaba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.608930 28774 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.633855 28770 ts_tablet_manager.cc:1434] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.002s
I20260709 13:10:28.634047 28774 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.635025 28770 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:28.636811 28774 ts_tablet_manager.cc:1434] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 13:10:28.638420 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd08c8d0651d4f21937f0b958dcaaba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.638206 28774 tablet_bootstrap.cc:492] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:28.656215 28770 tablet_bootstrap.cc:654] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.669193 28638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d00e421d5e40fb93fa17b07c0e88a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.694026 28780 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.647817 28808 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.660650 28478 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.699041 28808 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:28.719494 28620 consensus_peers.cc:597] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.722517 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:28.722946 28772 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:28.723408 28772 ts_tablet_manager.cc:1403] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.246s	user 0.016s	sys 0.024s
I20260709 13:10:28.723706 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:28.725247 28695 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:28.726089 28791 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.734272 28774 tablet_bootstrap.cc:654] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.737598 28808 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:28.740644 28772 raft_consensus.cc:359] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.745960 28772 raft_consensus.cc:385] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.746290 28772 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.747088 28772 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.749770 28770 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:28.750260 28770 ts_tablet_manager.cc:1403] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.026s
I20260709 13:10:28.751976 28796 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.752784 28796 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.755522 28770 raft_consensus.cc:359] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.756342 28770 raft_consensus.cc:385] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.756516 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:28.756708 28770 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.757845 28770 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:28.758479 28621 leader_election.cc:343] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.756772 28772 ts_tablet_manager.cc:1434] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:10:28.760103 28772 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:28.761421 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:28.762300 28729 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:28.763976 28620 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:28.765228 28780 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.765692 28780 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.766130 28780 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.771023 28772 tablet_bootstrap.cc:654] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.771633 28796 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:28.774552 28770 ts_tablet_manager.cc:1434] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:10:28.780002 28770 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:28.781633 28774 tablet_bootstrap.cc:492] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:28.782178 28774 ts_tablet_manager.cc:1403] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.022s
I20260709 13:10:28.777288 28780 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.787643 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:28.788409 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:28.789117 28729 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:28.789717 28621 leader_election.cc:343] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.790923 28780 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:28.793668 28730 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.792618 28478 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.795068 28770 tablet_bootstrap.cc:654] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.799621 28774 raft_consensus.cc:359] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.800523 28774 raft_consensus.cc:385] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.800804 28774 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.806237 28774 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.808882 28729 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:28.809650 28772 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:28.809679 28782 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.811481 28772 ts_tablet_manager.cc:1403] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.000s
I20260709 13:10:28.811508 28782 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.814043 28782 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:28.814774 28772 raft_consensus.cc:359] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.815135 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:28.815469 28772 raft_consensus.cc:385] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.815796 28772 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.815830 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:10:28.816704 28546 leader_election.cc:343] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.816648 28772 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:28.818020 28545 leader_election.cc:343] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.818548 28818 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.818614 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:28.818779 28620 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:28.820679 28818 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.821463 28818 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:28.820006 28782 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.822491 28818 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.826956 28774 ts_tablet_manager.cc:1434] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 13:10:28.829763 28772 ts_tablet_manager.cc:1434] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:10:28.830139 28774 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:28.832158 28772 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:28.835551 28770 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:28.836172 28770 ts_tablet_manager.cc:1403] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.005s
I20260709 13:10:28.838353 28772 tablet_bootstrap.cc:654] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.839377 28770 raft_consensus.cc:359] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.846103 28770 raft_consensus.cc:385] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.838376 28478 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.846575 28770 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.847601 28770 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.850558 28770 ts_tablet_manager.cc:1434] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:10:28.851255 28774 tablet_bootstrap.cc:654] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.852133 28770 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:28.860966 28770 tablet_bootstrap.cc:654] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.871888 28772 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:28.872406 28772 ts_tablet_manager.cc:1403] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:10:28.874092 28770 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:28.874531 28770 ts_tablet_manager.cc:1403] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.005s
I20260709 13:10:28.875001 28774 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:28.875542 28774 ts_tablet_manager.cc:1403] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.013s
I20260709 13:10:28.875604 28772 raft_consensus.cc:359] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.876641 28772 raft_consensus.cc:385] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.876660 28770 raft_consensus.cc:359] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.877156 28772 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.877465 28770 raft_consensus.cc:385] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.877772 28770 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.878082 28772 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.878489 28770 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.879051 28774 raft_consensus.cc:359] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.879850 28774 raft_consensus.cc:385] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.880191 28774 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.880702 28772 ts_tablet_manager.cc:1434] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:10:28.881175 28774 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.882400 28770 ts_tablet_manager.cc:1434] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:28.883520 28770 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:28.885744 28772 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:28.887523 28774 ts_tablet_manager.cc:1434] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:28.888706 28774 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:28.890265 28770 tablet_bootstrap.cc:654] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.892129 28772 tablet_bootstrap.cc:654] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.898272 28774 tablet_bootstrap.cc:654] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.903766 28772 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:28.904330 28772 ts_tablet_manager.cc:1403] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.012s
I20260709 13:10:28.907044 28772 raft_consensus.cc:359] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.908063 28772 raft_consensus.cc:385] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.908418 28772 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.909235 28772 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.912451 28772 ts_tablet_manager.cc:1434] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:10:28.912459 28774 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:28.913122 28774 ts_tablet_manager.cc:1403] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.003s
I20260709 13:10:28.913802 28772 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:28.914408 28770 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:28.914947 28770 ts_tablet_manager.cc:1403] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.016s
I20260709 13:10:28.916082 28774 raft_consensus.cc:359] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.916858 28774 raft_consensus.cc:385] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.917178 28774 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.917656 28770 raft_consensus.cc:359] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.917923 28774 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.918380 28770 raft_consensus.cc:385] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.918686 28770 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.919456 28770 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.920784 28772 tablet_bootstrap.cc:654] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.922967 28774 ts_tablet_manager.cc:1434] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:28.924027 28774 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:28.927831 28770 ts_tablet_manager.cc:1434] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:28.928833 28770 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:28.934598 28770 tablet_bootstrap.cc:654] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.937325 28774 tablet_bootstrap.cc:654] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.939146 28808 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.939677 28808 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.941722 28808 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:28.944227 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:28.944980 28581 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:28.946146 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:28.946878 28656 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:28.947070 28770 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:28.947866 28770 ts_tablet_manager.cc:1403] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:10:28.948352 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:28.949331 28808 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.949751 28808 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.950181 28808 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.951467 28770 raft_consensus.cc:359] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.952548 28770 raft_consensus.cc:385] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.952941 28770 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.954049 28770 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.955755 28774 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:28.956065 28770 ts_tablet_manager.cc:1434] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:28.956264 28774 ts_tablet_manager.cc:1403] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.010s
I20260709 13:10:28.957432 28808 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.958927 28770 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:28.959223 28774 raft_consensus.cc:359] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.959870 28774 raft_consensus.cc:385] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.960120 28774 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.960281 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:28.960949 28581 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.960875 28774 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.966223 28774 ts_tablet_manager.cc:1434] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:28.967178 28774 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:28.968796 28770 tablet_bootstrap.cc:654] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.970062 28772 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:28.970571 28772 ts_tablet_manager.cc:1403] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.003s
I20260709 13:10:28.968855 28581 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:28.973760 28774 tablet_bootstrap.cc:654] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.975435 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:28.977376 28791 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.978223 28791 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:28.979966 28791 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:28.987795 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:28.988471 28656 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.992081 28477 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.996680 28774 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:28.997192 28774 ts_tablet_manager.cc:1403] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.030s	user 0.003s	sys 0.015s
I20260709 13:10:29.000130 28774 raft_consensus.cc:359] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.000782 28774 raft_consensus.cc:385] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.000941 28656 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:29.001922 28808 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.002123 28774 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.001678 28581 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.002712 28772 raft_consensus.cc:359] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.002857 28774 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.003468 28772 raft_consensus.cc:385] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.003794 28772 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.004411 28772 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.004890 28774 ts_tablet_manager.cc:1434] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:29.005954 28774 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.007798 28772 ts_tablet_manager.cc:1434] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:10:29.008718 28772 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:29.011318 28808 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.011822 28808 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.012499 28774 tablet_bootstrap.cc:654] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.015682 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.016851 28791 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.018383 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.024369 28580 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.033278 28770 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:29.033236 28581 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:29.034032 28770 ts_tablet_manager.cc:1403] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.075s	user 0.034s	sys 0.021s
I20260709 13:10:29.025280 28782 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.037349 28782 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.037971 28770 raft_consensus.cc:359] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.039140 28770 raft_consensus.cc:385] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.039518 28770 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.040568 28770 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.041839 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.043268 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.043900 28655 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:29.045220 28772 tablet_bootstrap.cc:654] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.050748 28770 ts_tablet_manager.cc:1434] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:10:29.051220 28774 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.051663 28774 ts_tablet_manager.cc:1403] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.023s
I20260709 13:10:29.045408 28546 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:29.051692 28770 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
W20260709 13:10:29.053604 28545 leader_election.cc:343] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.054208 28774 raft_consensus.cc:359] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.055001 28774 raft_consensus.cc:385] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.055308 28774 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.055653 28838 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.056145 28774 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.057371 28838 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.057377 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.060755 28770 tablet_bootstrap.cc:654] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.060878 28791 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.061476 28791 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.061968 28791 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.065740 28782 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.067641 28774 ts_tablet_manager.cc:1434] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:10:29.069038 28774 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.025944 28656 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:29.072678 28840 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.074990 28840 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.058125 28838 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.076880 28774 tablet_bootstrap.cc:654] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.080529 28781 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:29.026918 28808 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.101194 28818 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.101874 28818 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.104182 28818 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.108079 28808 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.108752 28808 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.111368 28808 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.118857 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.119561 28655 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:29.120951 28546 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:29.121871 28782 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:29.122324 28782 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.122678 28782 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.125579 28791 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.130041 28791 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.132261 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.130261 28770 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:29.132965 28730 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:29.133334 28770 ts_tablet_manager.cc:1403] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.011s
I20260709 13:10:29.134070 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.134696 28580 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:29.133057 28729 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.137897 28840 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.138391 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.142292 28770 raft_consensus.cc:359] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.139900 28818 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.143011 28770 raft_consensus.cc:385] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.140893 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:29.141142 28620 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.142027 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:29.143352 28770 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.143285 28841 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.143175 28818 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.144765 28770 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.145318 28780 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.145745 28780 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.146080 28780 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.146365 28818 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.138594 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.147199 28770 ts_tablet_manager.cc:1434] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:29.148273 28581 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.149076 28770 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:29.143081 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.142693 28838 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.155339 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.155967 28655 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.158037 28770 tablet_bootstrap.cc:654] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.155966 28774 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.156004 28579 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:29.158605 28774 ts_tablet_manager.cc:1403] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.090s	user 0.032s	sys 0.031s
I20260709 13:10:29.159780 28838 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.161346 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:29.163582 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:29.169066 28656 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.171201 28655 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:29.166698 28845 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.164979 28780 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.162323 28774 raft_consensus.cc:359] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.175544 28774 raft_consensus.cc:385] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.168387 28782 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.175877 28774 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.176769 28580 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:29.177523 28774 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.178612 28728 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.182828 28782 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.162745 28621 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:29.164641 28841 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.184669 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:29.160424 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.162936 28581 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:29.185408 28653 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.185200 28841 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.176769 28772 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:29.186648 28730 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:29.189199 28728 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:29.192041 28818 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.192682 28818 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.193217 28818 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.196552 28774 ts_tablet_manager.cc:1434] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:10:29.199195 28774 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.204198 28780 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.190482 28841 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.186808 28772 ts_tablet_manager.cc:1403] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.178s	user 0.029s	sys 0.037s
I20260709 13:10:29.189803 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:29.197930 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.205950 28774 tablet_bootstrap.cc:654] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.207298 28772 raft_consensus.cc:359] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.207988 28772 raft_consensus.cc:385] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.208243 28772 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.208424 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:29.209414 28581 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.211117 28772 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.214519 28772 ts_tablet_manager.cc:1434] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:29.215703 28772 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:29.219340 28782 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.220520 28782 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:29.221192 28774 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.221642 28774 ts_tablet_manager.cc:1403] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:10:29.224318 28774 raft_consensus.cc:359] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.229580 28774 raft_consensus.cc:385] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.229902 28774 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.232479 28656 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:29.230792 28774 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.221655 28782 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.271872 28581 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:29.273516 28621 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:29.274534 28780 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.275051 28780 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:29.275863 28780 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.285329 28796 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.290436 28796 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.294216 28796 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:10:29.295043 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:29.168378 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:29.300155 28791 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.300531 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.298100 28818 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.300706 28653 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:29.303753 28774 ts_tablet_manager.cc:1434] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.082s	user 0.035s	sys 0.035s
I20260709 13:10:29.305234 28774 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.309134 28770 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:29.309796 28770 ts_tablet_manager.cc:1403] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.161s	user 0.065s	sys 0.051s
W20260709 13:10:29.310497 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 137819us
W20260709 13:10:29.312856 28621 leader_election.cc:343] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.313694 28546 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:10:29.315587 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:29.315827 28838 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.316234 28729 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.316360 28838 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:29.317142 28818 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.317376 28838 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.318944 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.323302 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:29.323330 28772 tablet_bootstrap.cc:654] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.315783 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.329173 28770 raft_consensus.cc:359] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.330175 28770 raft_consensus.cc:385] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.330585 28770 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.331467 28770 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.316375 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.333834 28791 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.336494 28791 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:29.329226 28580 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.337697 28791 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:29.334188 28621 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.333114 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.343088 28580 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:29.343721 28656 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 1: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:10:29.344326 28621 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:29.344786 28653 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:29.347426 28841 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.348491 28845 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.348874 28845 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:29.349768 28845 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.346398 28770 ts_tablet_manager.cc:1434] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:10:29.354213 28770 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:29.363420 28774 tablet_bootstrap.cc:654] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.361389 28841 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.347965 28477 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.364811 28841 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.367167 28841 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.361109 28845 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.353317 28780 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:29.374475 28620 leader_election.cc:343] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.375066 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:29.380156 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.380892 28580 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:29.381369 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:29.381942 28727 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.382403 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:29.384454 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.385147 28841 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.385496 28841 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.385824 28841 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.372586 28780 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:29.388059 28796 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.388953 28478 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.389843 28780 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.387086 28838 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.386786 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.392812 28838 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.395848 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.396255 28841 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.397244 28796 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:29.397574 28546 leader_election.cc:343] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.398372 28838 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.398860 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.399534 28841 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:10:29.400322 28545 leader_election.cc:343] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.400804 28545 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:29.400950 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:29.401131 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:29.401592 28580 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.409752 28838 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:29.412568 28695 leader_election.cc:343] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.421468 28695 leader_election.cc:343] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.423156 28580 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:29.425248 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:29.426743 28841 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.427345 28841 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:29.432785 28727 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:29.433893 28791 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.433380 28477 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.442202 28729 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:29.437322 28841 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.447305 28791 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.453473 28838 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.454085 28838 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.456926 28772 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:29.457463 28772 ts_tablet_manager.cc:1403] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.242s	user 0.010s	sys 0.008s
I20260709 13:10:29.458676 28838 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.460215 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.460963 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.461637 28729 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
W20260709 13:10:29.461957 28546 leader_election.cc:343] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.462239 28770 tablet_bootstrap.cc:654] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.463552 28545 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:29.464282 28772 raft_consensus.cc:359] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.464819 28772 raft_consensus.cc:385] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.465088 28772 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.465757 28782 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.466176 28782 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.466507 28782 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.469251 28479 catalog_manager.cc:5697] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.470660 28478 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.481509 28782 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.491632 28772 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.494105 28772 ts_tablet_manager.cc:1434] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.036s	user 0.013s	sys 0.015s
I20260709 13:10:29.495075 28772 tablet_bootstrap.cc:492] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:29.501870 28772 tablet_bootstrap.cc:654] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.509171 28774 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.509693 28774 ts_tablet_manager.cc:1403] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.205s	user 0.013s	sys 0.005s
I20260709 13:10:29.512516 28774 raft_consensus.cc:359] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.512823 28841 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.517549 28772 tablet_bootstrap.cc:492] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:29.518090 28772 ts_tablet_manager.cc:1403] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:10:29.513289 28774 raft_consensus.cc:385] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.519423 28774 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.520210 28774 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.521322 28772 raft_consensus.cc:359] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.522226 28772 raft_consensus.cc:385] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.522516 28774 ts_tablet_manager.cc:1434] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:29.522590 28772 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.523718 28774 tablet_bootstrap.cc:492] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.523854 28772 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.529117 28772 ts_tablet_manager.cc:1434] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:10:29.530406 28782 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.531044 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:10:29.534811 28546 leader_election.cc:343] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.530150 28772 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:29.531477 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:29.536885 28728 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.539664 28774 tablet_bootstrap.cc:654] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.542284 28818 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.542788 28818 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.544157 28770 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:29.544546 28728 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:29.545025 28770 ts_tablet_manager.cc:1403] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.191s	user 0.014s	sys 0.004s
I20260709 13:10:29.545791 28545 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:29.548641 28782 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.549228 28782 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:29.549782 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.550184 28782 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.550706 28580 raft_consensus.cc:2393] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:29.550675 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.552740 28620 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:29.553613 28796 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.554083 28772 tablet_bootstrap.cc:654] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.556488 28770 raft_consensus.cc:359] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.557657 28770 raft_consensus.cc:385] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.558123 28770 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.559146 28770 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.562589 28770 ts_tablet_manager.cc:1434] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:10:29.563978 28770 tablet_bootstrap.cc:492] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:29.544947 28818 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.570679 28796 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.574088 28772 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:29.576707 28772 ts_tablet_manager.cc:1403] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.006s
I20260709 13:10:29.576383 28479 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.577780 28478 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.582325 28772 raft_consensus.cc:359] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.583298 28772 raft_consensus.cc:385] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.583755 28770 tablet_bootstrap.cc:654] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.583695 28772 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.585247 28774 tablet_bootstrap.cc:492] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.584774 28772 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.585690 28774 ts_tablet_manager.cc:1403] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.008s
I20260709 13:10:29.587720 28772 ts_tablet_manager.cc:1434] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:29.588500 28774 raft_consensus.cc:359] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.589325 28774 raft_consensus.cc:385] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.589318 28772 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:29.589643 28774 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.590662 28774 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.592962 28774 ts_tablet_manager.cc:1434] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:29.594341 28774 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.599947 28772 tablet_bootstrap.cc:654] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.600534 28774 tablet_bootstrap.cc:654] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.612694 28774 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.613214 28774 ts_tablet_manager.cc:1403] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.006s
I20260709 13:10:29.615962 28774 raft_consensus.cc:359] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.616647 28774 raft_consensus.cc:385] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.616904 28774 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.617838 28774 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.620054 28774 ts_tablet_manager.cc:1434] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:29.621269 28774 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.626951 28774 tablet_bootstrap.cc:654] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.638787 28774 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.639267 28774 ts_tablet_manager.cc:1403] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 13:10:29.641880 28774 raft_consensus.cc:359] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.642740 28774 raft_consensus.cc:385] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.643021 28774 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.644032 28774 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.645958 28782 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.646804 28774 ts_tablet_manager.cc:1434] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:29.646620 28782 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.647894 28774 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.650887 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.655372 28774 tablet_bootstrap.cc:654] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.656916 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.659476 28545 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:29.660856 28838 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.661939 28782 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.676983 28782 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.682922 28845 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.683897 28845 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.694766 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.697432 28845 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.697793 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:10:29.698378 28695 leader_election.cc:343] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.699182 28695 leader_election.cc:343] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.699702 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:29.702783 28845 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.726007 28838 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.729972 28796 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.755411 28770 tablet_bootstrap.cc:492] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:29.756295 28770 ts_tablet_manager.cc:1403] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.193s	user 0.033s	sys 0.046s
I20260709 13:10:29.757683 28772 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:29.757877 28774 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.758140 28772 ts_tablet_manager.cc:1403] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.169s	user 0.088s	sys 0.054s
I20260709 13:10:29.758356 28774 ts_tablet_manager.cc:1403] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.111s	user 0.052s	sys 0.044s
I20260709 13:10:29.759004 28770 raft_consensus.cc:359] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.759727 28770 raft_consensus.cc:385] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.760039 28770 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.760835 28770 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.761456 28774 raft_consensus.cc:359] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.761593 28772 raft_consensus.cc:359] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.762219 28774 raft_consensus.cc:385] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.762586 28772 raft_consensus.cc:385] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.762642 28774 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.762992 28772 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.763551 28774 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.763679 28772 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.765926 28772 ts_tablet_manager.cc:1434] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:29.766283 28774 ts_tablet_manager.cc:1434] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:29.769282 28770 ts_tablet_manager.cc:1434] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:29.770303 28770 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:29.771207 28772 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:29.775293 28854 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.782977 28770 tablet_bootstrap.cc:654] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.784195 28774 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.791150 28841 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.791869 28841 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.794626 28841 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.791150 28653 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:29.797755 28774 tablet_bootstrap.cc:654] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.796890 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.796471 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.798625 28656 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:29.800180 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.800081 28782 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.802379 28845 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.802867 28845 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.803295 28845 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.798784 28580 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:29.804128 28791 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.804628 28791 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.806066 28770 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:29.806524 28770 ts_tablet_manager.cc:1403] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.002s
I20260709 13:10:29.806746 28791 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:29.807291 28791 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.809844 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.811374 28845 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:29.812156 28695 leader_election.cc:343] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.813437 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:29.814239 28845 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:10:29.815944 28695 leader_election.cc:343] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.816407 28695 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:29.817873 28841 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.819221 28770 raft_consensus.cc:359] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.820214 28770 raft_consensus.cc:385] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.820616 28770 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.821517 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:29.822118 28580 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.824437 28728 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:10:29.824822 28774 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.824857 28728 pending_rounds.cc:85] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 0
I20260709 13:10:29.825369 28728 pending_rounds.cc:107] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:29.825501 28774 ts_tablet_manager.cc:1403] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.009s
I20260709 13:10:29.825745 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:29.825744 28728 raft_consensus.cc:2889] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:29.826473 28656 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.829077 28774 raft_consensus.cc:359] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.830045 28774 raft_consensus.cc:385] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.830376 28774 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.831173 28774 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.826674 28780 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.832966 28780 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.833694 28774 ts_tablet_manager.cc:1434] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:29.834892 28774 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.835656 28780 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.836779 28772 tablet_bootstrap.cc:654] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.821517 28770 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.837564 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.839556 28579 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:29.842103 28770 ts_tablet_manager.cc:1434] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:10:29.843262 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.843938 28727 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:29.847402 28580 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:29.848268 28656 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:29.851317 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.852326 28770 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:29.840809 28838 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:10:29.852980 28780 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.856014 28780 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.856353 28780 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.858260 28854 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.858798 28854 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.863619 28854 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.869525 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:29.870535 28580 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:29.871137 28774 tablet_bootstrap.cc:654] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.857786 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.872709 28621 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:29.873770 28841 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.874027 28854 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.874292 28841 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:29.874436 28854 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.874861 28854 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.875306 28841 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.877171 28838 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.877718 28838 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.874863 28772 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:29.880774 28838 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.882009 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.882753 28728 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:29.882660 28854 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.884090 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:29.884333 28854 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.886262 28770 tablet_bootstrap.cc:654] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.888741 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:10:29.890640 28546 leader_election.cc:343] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.887463 28772 ts_tablet_manager.cc:1403] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.006s
I20260709 13:10:29.892320 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:29.893172 28580 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.894464 28772 raft_consensus.cc:359] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.895319 28772 raft_consensus.cc:385] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.895594 28772 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.896209 28772 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.899168 28772 ts_tablet_manager.cc:1434] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:29.887665 28838 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.900885 28772 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:29.901253 28838 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.904296 28838 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.906525 28818 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.906940 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.907160 28818 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.908121 28729 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:29.910835 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:29.912170 28621 leader_election.cc:343] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.922765 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:29.923481 28729 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.923863 28818 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.927048 28838 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.931197 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:29.936657 28478 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.940081 28774 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:29.940222 28772 tablet_bootstrap.cc:654] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.940632 28774 ts_tablet_manager.cc:1403] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.012s
I20260709 13:10:29.944371 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:29.944985 28653 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.945403 28774 raft_consensus.cc:359] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:29.945928 28546 leader_election.cc:343] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.946123 28774 raft_consensus.cc:385] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.946444 28774 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.946224 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:29.946962 28728 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.947129 28774 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.953393 28780 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:29.956646 28620 leader_election.cc:343] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.956857 28780 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.957223 28620 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:29.957788 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:29.958443 28579 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.959424 28728 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:29.959678 28796 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.961663 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:29.963096 28840 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.963625 28840 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:29.954370 28838 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:29.964632 28841 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.948868 28774 ts_tablet_manager.cc:1434] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:10:29.969843 28774 tablet_bootstrap.cc:492] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:29.968621 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:29.971781 28727 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.968717 28580 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:29.964504 28840 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.988047 28621 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:29.988775 28818 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.989241 28854 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.989777 28854 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:29.990989 28580 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.990691 28854 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:29.993036 28782 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.942567 28729 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:29.997216 28791 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.997792 28791 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.007146 28791 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.007745 28841 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:30.010890 28796 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.012756 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:10:30.023686 28695 leader_election.cc:343] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.027118 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:30.028865 28695 leader_election.cc:343] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.029554 28695 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:30.045522 28841 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.033602 28791 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.045468 28845 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:30.032361 28579 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:30.052946 28841 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.072885 28841 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.078758 28774 tablet_bootstrap.cc:654] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.067972 28727 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:30.090365 28770 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:30.105695 28770 ts_tablet_manager.cc:1403] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.254s	user 0.041s	sys 0.008s
I20260709 13:10:30.083053 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:30.121071 28854 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.128217 28854 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:30.129460 28772 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:30.130079 28772 ts_tablet_manager.cc:1403] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.229s	user 0.012s	sys 0.012s
I20260709 13:10:30.135721 28854 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.141390 28772 raft_consensus.cc:359] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.143373 28772 raft_consensus.cc:385] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.143637 28772 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.147838 28772 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.146313 28838 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:10:30.157618 28772 ts_tablet_manager.cc:1434] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.006s
I20260709 13:10:30.159080 28772 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:30.177307 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.175841 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.211223 28770 raft_consensus.cc:359] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.212008 28770 raft_consensus.cc:385] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.212289 28770 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
W20260709 13:10:30.197266 28695 leader_election.cc:343] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.208316 28477 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.213586 28770 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:30.214175 28695 leader_election.cc:343] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.214694 28695 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:30.217832 28781 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.218408 28774 tablet_bootstrap.cc:492] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:30.218490 28770 ts_tablet_manager.cc:1434] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.001s
I20260709 13:10:30.221098 28782 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.221853 28782 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.222574 28774 ts_tablet_manager.cc:1403] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.253s	user 0.021s	sys 0.011s
I20260709 13:10:30.225925 28782 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.227358 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:30.228101 28728 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:30.232577 28774 raft_consensus.cc:359] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.233359 28774 raft_consensus.cc:385] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.233577 28770 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:30.233693 28774 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.233721 28545 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:30.234701 28838 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.235126 28838 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.235522 28838 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.236195 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:10:30.240393 28546 leader_election.cc:343] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.245405 28772 tablet_bootstrap.cc:654] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.249462 28774 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.251466 28774 ts_tablet_manager.cc:1434] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:10:30.251856 28770 tablet_bootstrap.cc:654] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.252601 28774 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:30.254522 28478 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.258323 28838 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.258827 28774 tablet_bootstrap.cc:654] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.265878 28478 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.271035 28838 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.272933 28774 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:30.272905 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:30.273720 28774 ts_tablet_manager.cc:1403] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:10:30.274931 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:10:30.277182 28546 leader_election.cc:343] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.275827 28727 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.286772 28774 raft_consensus.cc:359] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.287640 28774 raft_consensus.cc:385] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.287953 28774 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.288653 28774 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.288981 28727 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:30.290741 28545 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:30.292214 28838 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.292614 28772 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:30.293201 28772 ts_tablet_manager.cc:1403] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.134s	user 0.031s	sys 0.012s
I20260709 13:10:30.293215 28838 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:30.294286 28838 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.296365 28772 raft_consensus.cc:359] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.297209 28772 raft_consensus.cc:385] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.297488 28772 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.298172 28772 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.298882 28770 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:30.299892 28770 ts_tablet_manager.cc:1403] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.017s
I20260709 13:10:30.300428 28772 ts_tablet_manager.cc:1434] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:30.304028 28770 raft_consensus.cc:359] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.304802 28770 raft_consensus.cc:385] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.308881 28770 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.309916 28774 ts_tablet_manager.cc:1434] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:10:30.310103 28770 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.310999 28774 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:30.314025 28770 ts_tablet_manager.cc:1434] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:10:30.314616 28772 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:30.315156 28770 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:30.322747 28772 tablet_bootstrap.cc:654] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.322726 28854 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.325455 28781 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.326325 28774 tablet_bootstrap.cc:654] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.323789 28854 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.328686 28854 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.330420 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.337423 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:30.326460 28476 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.341392 28727 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:10:30.342774 28620 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:30.345122 28854 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.345435 28772 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:30.346558 28772 ts_tablet_manager.cc:1403] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.014s
W20260709 13:10:30.347962 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:30.349551 28772 raft_consensus.cc:359] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.350355 28772 raft_consensus.cc:385] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.350656 28772 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.351521 28772 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.353590 28854 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.354321 28772 ts_tablet_manager.cc:1434] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:10:30.355382 28772 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:30.356654 28770 tablet_bootstrap.cc:654] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.358217 28838 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.358842 28838 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.362586 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.363366 28652 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:30.364655 28546 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:30.365895 28896 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.366307 28896 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.366664 28896 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.370450 28791 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.371023 28791 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.373379 28791 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.373900 28791 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.374460 28774 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:30.375041 28774 ts_tablet_manager.cc:1403] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.003s
I20260709 13:10:30.375659 28772 tablet_bootstrap.cc:654] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.380946 28838 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.381271 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:30.382017 28727 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:30.384297 28772 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:30.384110 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.384441 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.384819 28772 ts_tablet_manager.cc:1403] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 13:10:30.385362 28652 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:30.387763 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:30.389178 28845 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.389576 28845 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.389925 28845 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.392905 28774 raft_consensus.cc:359] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.393721 28774 raft_consensus.cc:385] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.394076 28774 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.394896 28774 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.381285 28770 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:30.400913 28770 ts_tablet_manager.cc:1403] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 13:10:30.403246 28770 raft_consensus.cc:359] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.403769 28770 raft_consensus.cc:385] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.404044 28770 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.403966 28896 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.404878 28770 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.407534 28770 ts_tablet_manager.cc:1434] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:30.407900 28845 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.408609 28579 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:10:30.410465 28845 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.411332 28770 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:30.413302 28772 raft_consensus.cc:359] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.414018 28772 raft_consensus.cc:385] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.414284 28772 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.415019 28772 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.416432 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:30.416982 28772 ts_tablet_manager.cc:1434] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.000s
I20260709 13:10:30.417239 28579 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:10:30.417913 28772 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:30.420904 28774 ts_tablet_manager.cc:1434] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:10:30.422916 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:30.423578 28652 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.427783 28774 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:30.432171 28652 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:30.434310 28774 tablet_bootstrap.cc:654] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.436555 28772 tablet_bootstrap.cc:654] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.438773 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:30.439826 28652 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:30.441675 28896 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.442907 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:30.443599 28770 tablet_bootstrap.cc:654] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.443846 28727 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:30.445811 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:30.445971 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:30.446496 28774 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:30.446368 28845 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.446996 28774 ts_tablet_manager.cc:1403] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:10:30.447285 28841 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.446924 28845 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.447808 28841 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:30.447072 28896 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.448778 28841 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.449559 28845 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.451364 28772 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:30.451838 28772 ts_tablet_manager.cc:1403] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:10:30.451985 28774 raft_consensus.cc:359] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.452700 28774 raft_consensus.cc:385] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.452979 28774 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.455579 28772 raft_consensus.cc:359] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.456326 28772 raft_consensus.cc:385] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.456102 28774 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.458313 28774 ts_tablet_manager.cc:1434] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:10:30.459300 28774 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:30.459527 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:10:30.461170 28695 leader_election.cc:343] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.460547 28477 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.456645 28772 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.462541 28772 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.453773 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.464957 28772 ts_tablet_manager.cc:1434] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
W20260709 13:10:30.466511 28695 leader_election.cc:343] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.466987 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:30.467818 28772 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:30.471055 28841 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.475445 28774 tablet_bootstrap.cc:654] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.506453 28772 tablet_bootstrap.cc:654] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.507061 28770 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:30.507560 28770 ts_tablet_manager.cc:1403] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.096s	user 0.024s	sys 0.016s
I20260709 13:10:30.513561 28770 raft_consensus.cc:359] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.515327 28770 raft_consensus.cc:385] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.515748 28770 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.516659 28770 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.519985 28770 ts_tablet_manager.cc:1434] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:10:30.522933 28770 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:30.523424 28841 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.524255 28841 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.527277 28841 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.529996 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.531549 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.532433 28654 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:30.532670 28770 tablet_bootstrap.cc:654] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.535382 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:10:30.536612 28695 leader_election.cc:343] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.537333 28780 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.541988 28774 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:30.542491 28774 ts_tablet_manager.cc:1403] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.028s
I20260709 13:10:30.543478 28841 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.543942 28841 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.544337 28841 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.544710 28770 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:30.545218 28770 ts_tablet_manager.cc:1403] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:10:30.545740 28774 raft_consensus.cc:359] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.546264 28774 raft_consensus.cc:385] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.546499 28774 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.547120 28774 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.548067 28770 raft_consensus.cc:359] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.548743 28770 raft_consensus.cc:385] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.548983 28774 ts_tablet_manager.cc:1434] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:30.548991 28770 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.550248 28770 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.551807 28772 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:30.552558 28772 ts_tablet_manager.cc:1403] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.015s
I20260709 13:10:30.555117 28841 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.552665 28774 tablet_bootstrap.cc:492] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:30.558504 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:30.559273 28581 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.562795 28770 ts_tablet_manager.cc:1434] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:10:30.563899 28770 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:30.563499 28772 raft_consensus.cc:359] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.564436 28772 raft_consensus.cc:385] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.564816 28772 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.565788 28772 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.568166 28772 ts_tablet_manager.cc:1434] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:10:30.571123 28770 tablet_bootstrap.cc:654] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.570182 28774 tablet_bootstrap.cc:654] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.571204 28772 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:30.566787 28581 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:30.577361 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:30.578855 28845 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.579587 28845 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:30.580838 28845 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.584620 28772 tablet_bootstrap.cc:654] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.591692 28896 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.592154 28841 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.599810 28780 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.603405 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:30.604327 28654 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.607192 28840 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.618382 28782 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.619184 28782 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.625996 28782 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.627261 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:30.628047 28728 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:30.628538 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.630955 28780 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.631179 28652 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:30.631628 28545 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:30.633512 28782 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.634091 28782 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.634626 28782 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.650967 28780 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.651749 28780 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.651949 28477 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.654448 28780 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.656599 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.656950 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:30.658344 28728 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:10:30.659727 28620 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:30.660223 28780 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.660604 28796 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.660749 28780 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.663789 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:30.665383 28621 leader_election.cc:343] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.666422 28780 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.670706 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:30.672781 28796 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:30.674310 28620 leader_election.cc:343] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.674933 28620 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:30.677217 28780 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.704682 28818 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.692556 28654 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:30.727990 28774 tablet_bootstrap.cc:492] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:30.728645 28774 ts_tablet_manager.cc:1403] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.176s	user 0.028s	sys 0.020s
I20260709 13:10:30.738561 28840 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.751078 28782 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.751575 28774 raft_consensus.cc:359] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.756522 28774 raft_consensus.cc:385] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.757480 28772 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:30.758165 28772 ts_tablet_manager.cc:1403] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.187s	user 0.021s	sys 0.021s
I20260709 13:10:30.760349 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:30.761071 28654 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.768651 28772 raft_consensus.cc:359] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.770219 28782 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.771003 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:30.770306 28774 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.772445 28770 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:30.768932 28654 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:30.774515 28772 raft_consensus.cc:385] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.776476 28772 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.776576 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:30.777148 28772 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.775413 28774 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.775840 28770 ts_tablet_manager.cc:1403] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.212s	user 0.054s	sys 0.116s
I20260709 13:10:30.783308 28782 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.775014 28727 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.784395 28782 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:30.785298 28782 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.789973 28774 ts_tablet_manager.cc:1434] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
I20260709 13:10:30.793615 28774 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:30.795805 28772 ts_tablet_manager.cc:1434] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:10:30.805011 28772 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:30.796563 28840 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.807621 28840 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.809825 28840 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.812103 28727 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:30.812145 28841 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.812779 28841 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.815369 28841 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.817229 28770 raft_consensus.cc:359] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.817935 28770 raft_consensus.cc:385] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.818279 28770 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.818980 28770 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.820797 28772 tablet_bootstrap.cc:654] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.821079 28774 tablet_bootstrap.cc:654] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.821182 28770 ts_tablet_manager.cc:1434] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:10:30.822239 28770 tablet_bootstrap.cc:492] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:30.870736 28781 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.871413 28845 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.876914 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.877101 28845 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.865130 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.882835 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.884009 28653 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:30.884490 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:30.873571 28781 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.887022 28579 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:30.891664 28896 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.896865 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:30.898442 28772 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:30.898573 28841 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.899102 28841 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.899487 28841 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.900550 28774 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:30.901443 28774 ts_tablet_manager.cc:1403] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.006s
I20260709 13:10:30.902642 28772 ts_tablet_manager.cc:1403] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.000s
I20260709 13:10:30.907004 28845 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.911139 28770 tablet_bootstrap.cc:654] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:30.914079 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.918817 28772 raft_consensus.cc:359] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.931852 28772 raft_consensus.cc:385] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.932318 28772 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.932717 28727 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:30.933478 28772 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.921149 28781 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:10:30.922027 28546 leader_election.cc:343] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.925618 28478 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.941450 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:30.942036 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.944005 28579 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:30.948241 28780 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.948450 28838 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.948979 28838 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:30.948262 28695 leader_election.cc:343] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.949623 28838 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.950063 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:30.950671 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.952782 28781 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.954051 28781 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.954447 28781 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.956432 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:30.948946 28780 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.965126 28774 raft_consensus.cc:359] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.965977 28774 raft_consensus.cc:385] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:30.966284 28774 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:30.966797 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:30.967093 28774 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.967002 28654 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:30.971664 28772 ts_tablet_manager.cc:1434] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.003s
I20260709 13:10:30.967002 28781 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.973616 28772 tablet_bootstrap.cc:492] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:30.964705 28841 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.975790 28781 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:30.980557 28841 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:10:30.981844 28695 leader_election.cc:343] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:30.982280 28841 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.982596 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:30.968066 28780 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:30.982865 28841 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.986263 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:30.991498 28727 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:30.988270 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:30.993745 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:30.994267 28654 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.986831 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:30.996140 28652 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.995792 28838 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:30.997256 28579 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:10:30.988526 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:30.999837 28841 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:31.000069 28580 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.001407 28770 tablet_bootstrap.cc:492] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:31.001706 28838 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.002343 28770 ts_tablet_manager.cc:1403] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.180s	user 0.016s	sys 0.009s
I20260709 13:10:31.005976 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:31.007506 28772 tablet_bootstrap.cc:654] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.007915 28727 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:31.008281 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:31.008998 28791 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.009684 28774 ts_tablet_manager.cc:1434] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.003s
I20260709 13:10:31.011395 28546 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:31.013078 28896 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.014231 28620 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:31.015442 28652 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:31.017653 28774 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:31.020644 28580 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:31.022729 28770 raft_consensus.cc:359] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.023506 28770 raft_consensus.cc:385] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.023805 28770 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.029258 28781 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.030289 28774 tablet_bootstrap.cc:654] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.030339 28654 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:31.031756 28780 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.033272 28770 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.035357 28770 ts_tablet_manager.cc:1434] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.005s
I20260709 13:10:31.036917 28770 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:31.037213 28772 tablet_bootstrap.cc:492] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:31.037796 28772 ts_tablet_manager.cc:1403] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.004s
I20260709 13:10:31.040970 28772 raft_consensus.cc:359] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.041445 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:31.041723 28772 raft_consensus.cc:385] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.043256 28772 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.044813 28772 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.047952 28772 ts_tablet_manager.cc:1434] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:10:31.049203 28772 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:31.052748 28770 tablet_bootstrap.cc:654] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.056684 28772 tablet_bootstrap.cc:654] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.058753 28774 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:31.059192 28774 ts_tablet_manager.cc:1403] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.000s
I20260709 13:10:31.061286 28774 raft_consensus.cc:359] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.061934 28774 raft_consensus.cc:385] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.062194 28774 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.062793 28774 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.065155 28774 ts_tablet_manager.cc:1434] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:31.067163 28774 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:31.030413 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.069670 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:31.070649 28781 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.071141 28781 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:31.072211 28781 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:31.077306 28695 leader_election.cc:343] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.089362 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:31.090634 28774 tablet_bootstrap.cc:654] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.090178 28781 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.094934 28781 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:31.096912 28781 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.107285 28477 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:31.136394 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47107.4us
I20260709 13:10:31.139993 28770 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:31.140570 28770 ts_tablet_manager.cc:1403] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.104s	user 0.023s	sys 0.003s
I20260709 13:10:31.140756 28780 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.141407 28772 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:31.141309 28780 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.141861 28772 ts_tablet_manager.cc:1403] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.000s
I20260709 13:10:31.145556 28780 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.146668 28772 raft_consensus.cc:359] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.147392 28772 raft_consensus.cc:385] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.147212 28770 raft_consensus.cc:359] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.147670 28772 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.147869 28770 raft_consensus.cc:385] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.148167 28770 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.148813 28770 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.148331 28772 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.155505 28770 ts_tablet_manager.cc:1434] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:10:31.157405 28772 ts_tablet_manager.cc:1434] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:31.160145 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.160650 28770 tablet_bootstrap.cc:492] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:31.160877 28580 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:31.162451 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:10:31.155210 28695 leader_election.cc:343] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.164666 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:31.163726 28780 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.171722 28780 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.183233 28780 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.201442 28772 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:31.169363 28781 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.209335 28818 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.209870 28818 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.212860 28774 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:31.213449 28774 ts_tablet_manager.cc:1403] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.147s	user 0.030s	sys 0.045s
I20260709 13:10:31.208292 28780 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.214253 28818 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.214457 28476 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.221809 28774 raft_consensus.cc:359] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.222605 28774 raft_consensus.cc:385] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.222821 28774 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.224081 28838 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.240813 28774 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.221731 28781 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:10:31.233916 28780 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.255546 28774 ts_tablet_manager.cc:1434] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:10:31.241739 28838 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.253731 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.256121 28845 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.260903 28774 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:31.256398 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:31.256789 28781 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.262392 28579 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:31.264751 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:31.265363 28580 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.267683 28727 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:31.270916 28838 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.273782 28580 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:31.274272 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:31.275012 28729 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:31.275168 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:31.276499 28727 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:31.264025 28781 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.279898 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:31.280550 28727 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.282581 28781 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:31.284286 28770 tablet_bootstrap.cc:654] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.285997 28838 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.286520 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:31.286803 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:31.287202 28653 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:31.287751 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:31.289615 28854 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.290726 28796 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.290838 28854 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.291299 28854 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.285105 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:31.291306 28796 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:31.299008 28796 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.307637 28772 tablet_bootstrap.cc:654] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.308589 28838 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.313932 28838 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.314989 28838 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.321260 28854 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.325521 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:31.325685 28727 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:31.327988 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.328289 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:31.328915 28655 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:31.342729 28854 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.349354 28838 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.350838 28579 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:10:31.355880 28770 tablet_bootstrap.cc:492] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:31.358530 28770 ts_tablet_manager.cc:1403] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.198s	user 0.021s	sys 0.021s
I20260709 13:10:31.361223 28770 raft_consensus.cc:359] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.361937 28770 raft_consensus.cc:385] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.362236 28770 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.367985 28770 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.370391 28770 ts_tablet_manager.cc:1434] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:31.372367 28770 tablet_bootstrap.cc:492] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:31.377460 28695 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:31.378782 28476 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.393196 28845 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.393640 28845 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.393957 28845 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.381244 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:31.394989 28652 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:10:31.382439 28774 tablet_bootstrap.cc:654] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.383014 28838 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.384042 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:31.398409 28729 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.404636 28845 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.406951 28845 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:31.386577 28840 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.387331 28772 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
W20260709 13:10:31.389452 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:31.412242 28772 ts_tablet_manager.cc:1403] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.211s	user 0.008s	sys 0.009s
I20260709 13:10:31.419268 28729 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:31.420653 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:31.421931 28840 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.422485 28840 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:31.423393 28840 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.425443 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:31.424152 28772 raft_consensus.cc:359] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.429416 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:31.430758 28652 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.392283 28770 tablet_bootstrap.cc:654] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.441679 28772 raft_consensus.cc:385] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.445247 28772 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.446264 28772 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.447786 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:31.449640 28728 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:10:31.453145 28772 ts_tablet_manager.cc:1434] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:10:31.453673 28845 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:31.454555 28695 leader_election.cc:343] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.450747 28652 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:31.459312 28772 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
W20260709 13:10:31.463902 28695 leader_election.cc:343] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.460228 28774 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:31.461585 28476 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.468313 28774 ts_tablet_manager.cc:1403] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.208s	user 0.032s	sys 0.038s
I20260709 13:10:31.469628 28772 tablet_bootstrap.cc:654] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.471180 28774 raft_consensus.cc:359] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.471932 28774 raft_consensus.cc:385] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.472203 28774 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.473075 28774 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.475626 28774 ts_tablet_manager.cc:1434] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:31.477958 28774 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:31.478813 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:31.480597 28796 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.484534 28774 tablet_bootstrap.cc:654] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.494238 28695 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:31.496526 28791 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.497676 28791 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.499749 28774 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:31.500051 28791 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:31.500203 28774 ts_tablet_manager.cc:1403] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:10:31.503978 28774 raft_consensus.cc:359] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.504685 28774 raft_consensus.cc:385] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.504954 28774 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.505518 28791 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.507063 28791 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:31.508620 28770 tablet_bootstrap.cc:492] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:31.509369 28770 ts_tablet_manager.cc:1403] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.003s
I20260709 13:10:31.508630 28791 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.505614 28774 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.512869 28774 ts_tablet_manager.cc:1434] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:10:31.512787 28770 raft_consensus.cc:359] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.516618 28770 raft_consensus.cc:385] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.516940 28770 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.517417 28774 tablet_bootstrap.cc:492] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:31.517756 28770 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.521566 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.522735 28772 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:31.523069 28770 ts_tablet_manager.cc:1434] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:31.523262 28772 ts_tablet_manager.cc:1403] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.037s
I20260709 13:10:31.525975 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:31.526822 28652 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:31.529161 28772 raft_consensus.cc:359] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.524353 28770 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:31.529943 28772 raft_consensus.cc:385] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.530337 28772 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.531086 28772 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.535127 28772 ts_tablet_manager.cc:1434] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:10:31.528784 28476 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:31.536193 28695 leader_election.cc:343] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.541419 28695 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:31.542404 28845 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.542807 28845 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.543184 28845 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.550179 28791 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:31.553544 28772 tablet_bootstrap.cc:492] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:31.552310 28774 tablet_bootstrap.cc:654] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.557580 28845 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.562479 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:31.562873 28772 tablet_bootstrap.cc:654] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:31.570350 28695 leader_election.cc:343] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.571537 28791 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.572279 28845 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:31.574283 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:31.575132 28654 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.578807 28770 tablet_bootstrap.cc:654] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.584396 28772 tablet_bootstrap.cc:492] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:31.584872 28772 ts_tablet_manager.cc:1403] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.000s
I20260709 13:10:31.587604 28772 raft_consensus.cc:359] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.588294 28772 raft_consensus.cc:385] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.590814 28772 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.591478 28772 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.593650 28772 ts_tablet_manager.cc:1434] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:31.594606 28772 tablet_bootstrap.cc:492] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:31.597386 28654 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:31.607609 28772 tablet_bootstrap.cc:654] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.618865 28770 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:31.619306 28770 ts_tablet_manager.cc:1403] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.095s	user 0.024s	sys 0.014s
I20260709 13:10:31.622896 28770 raft_consensus.cc:359] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.623647 28770 raft_consensus.cc:385] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.624013 28770 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.623719 28772 tablet_bootstrap.cc:492] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:31.625188 28772 ts_tablet_manager.cc:1403] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
I20260709 13:10:31.624779 28770 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.627066 28770 ts_tablet_manager.cc:1434] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:31.628153 28770 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:31.628489 28772 raft_consensus.cc:359] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.629390 28772 raft_consensus.cc:385] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.629350 28840 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.630153 28840 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.629905 28772 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.633774 28772 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.634454 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:31.635195 28770 tablet_bootstrap.cc:654] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.635407 28727 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:31.636165 28772 ts_tablet_manager.cc:1434] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:31.639858 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:31.639344 28840 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.640641 28838 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.641078 28838 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.641486 28838 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.645314 28770 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:31.645814 28770 ts_tablet_manager.cc:1403] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.003s
I20260709 13:10:31.645828 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:31.649219 28770 raft_consensus.cc:359] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.649995 28770 raft_consensus.cc:385] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.650312 28770 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
W20260709 13:10:31.651788 28546 leader_election.cc:343] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.652153 28770 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.655282 28770 ts_tablet_manager.cc:1434] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:31.656363 28770 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:31.657385 28796 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.658104 28796 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.661589 28796 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.662358 28770 tablet_bootstrap.cc:654] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.663619 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.665766 28838 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:31.665571 28621 leader_election.cc:343] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.673225 28838 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.673576 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:10:31.675877 28546 leader_election.cc:343] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.679015 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:31.679891 28727 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.687451 28772 tablet_bootstrap.cc:492] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:31.695536 28772 tablet_bootstrap.cc:654] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.696202 28727 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:31.701567 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:31.703133 28838 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.704011 28772 tablet_bootstrap.cc:492] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:31.704495 28772 ts_tablet_manager.cc:1403] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:10:31.707171 28838 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:31.707218 28772 raft_consensus.cc:359] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.711519 28772 raft_consensus.cc:385] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.711805 28772 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.712476 28772 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.714083 28772 ts_tablet_manager.cc:1434] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:10:31.713968 28838 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.720847 28770 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:31.724764 28770 ts_tablet_manager.cc:1403] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.022s
I20260709 13:10:31.719336 28772 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:31.723235 28695 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:31.727982 28791 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:31.728490 28791 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:31.729367 28774 tablet_bootstrap.cc:492] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:31.729400 28791 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.730249 28774 ts_tablet_manager.cc:1403] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.213s	user 0.048s	sys 0.097s
I20260709 13:10:31.732414 28770 raft_consensus.cc:359] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.733269 28770 raft_consensus.cc:385] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.733570 28770 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.733610 28774 raft_consensus.cc:359] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.734534 28770 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.734561 28774 raft_consensus.cc:385] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.738134 28845 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.738972 28845 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.741425 28772 tablet_bootstrap.cc:654] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.738301 28774 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.744894 28774 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.747596 28774 ts_tablet_manager.cc:1434] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:10:31.748719 28774 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:31.749431 28845 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:31.749588 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:31.752334 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.753131 28579 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:31.753296 28770 ts_tablet_manager.cc:1434] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:10:31.755209 28770 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:31.756397 28774 tablet_bootstrap.cc:654] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.759485 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:10:31.761215 28620 leader_election.cc:343] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.761636 28772 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:31.761816 28770 tablet_bootstrap.cc:654] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.762166 28772 ts_tablet_manager.cc:1403] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.007s
I20260709 13:10:31.761724 28620 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:31.763159 28854 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.765183 28476 catalog_manager.cc:5697] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.766029 28772 raft_consensus.cc:359] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.766988 28772 raft_consensus.cc:385] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.767335 28772 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.768940 28791 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.771538 28772 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.774506 28772 ts_tablet_manager.cc:1434] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
W20260709 13:10:31.777357 28695 leader_election.cc:343] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:31.777518 28774 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:31.777966 28772 tablet_bootstrap.cc:492] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:31.778133 28774 ts_tablet_manager.cc:1403] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 13:10:31.778836 28781 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:31.780786 28774 raft_consensus.cc:359] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.781625 28774 raft_consensus.cc:385] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.781944 28774 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.781039 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:31.782696 28774 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.777518 28770 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:31.783838 28770 ts_tablet_manager.cc:1403] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.007s
I20260709 13:10:31.785817 28772 tablet_bootstrap.cc:654] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.786598 28770 raft_consensus.cc:359] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.787302 28770 raft_consensus.cc:385] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:31.787595 28770 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:31.788204 28770 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.791059 28770 ts_tablet_manager.cc:1434] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:31.792361 28770 tablet_bootstrap.cc:492] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:31.793292 28781 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.793833 28781 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.794201 28781 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.799345 28969 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.799866 28969 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.801801 28969 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:31.804661 28781 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.807670 28781 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:31.810035 28838 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.810464 28774 ts_tablet_manager.cc:1434] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:10:31.810587 28838 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.812021 28774 tablet_bootstrap.cc:492] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:31.814618 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:31.815470 28653 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:31.816138 28838 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.818240 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:31.819862 28770 tablet_bootstrap.cc:654] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.819830 28545 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:31.821784 28840 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.822328 28478 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.828284 28854 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.828819 28854 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.830932 28854 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:31.833817 28840 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:31.834287 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.835026 28580 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:31.836810 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:31.842231 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:31.842989 28655 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:31.844769 28854 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.885720 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:31.846668 28854 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.887156 28854 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:31.879705 28838 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.945381 28774 tablet_bootstrap.cc:654] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:31.883711 28840 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.953410 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:31.946117 28781 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.946880 28838 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.959959 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:31.953470 28840 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:31.993943 28791 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.972111 28781 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:32.007699 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 54378.8us
I20260709 13:10:31.997753 28969 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:31.998517 28796 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.014400 28772 tablet_bootstrap.cc:492] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:32.014900 28772 ts_tablet_manager.cc:1403] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.240s	user 0.039s	sys 0.047s
I20260709 13:10:32.010535 28791 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:32.007814 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50522us
I20260709 13:10:32.020648 28791 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:32.021302 28727 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:32.023080 28840 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.010406 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:32.010980 28969 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.008638 28581 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:32.024647 28838 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.013562 28796 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.042826 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:32.043565 28577 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:32.044279 28796 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.033293 28969 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.044395 28838 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.035445 28580 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.051362 28695 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:32.054279 28791 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.058512 28791 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.058897 28791 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:32.044301 28973 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.095s	user 0.004s	sys 0.000s
I20260709 13:10:32.067387 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:32.068145 28728 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:32.069634 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:32.072091 28770 tablet_bootstrap.cc:492] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:32.053083 28796 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.072600 28770 ts_tablet_manager.cc:1403] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.281s	user 0.015s	sys 0.004s
I20260709 13:10:32.074651 28854 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.077235 28772 raft_consensus.cc:359] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.078157 28772 raft_consensus.cc:385] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.074957 28981 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:10:32.080717 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:32.081233 28781 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:32.081457 28651 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:32.081370 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:32.082244 28577 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:32.082517 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:32.083374 28650 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:32.083633 28621 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:32.078439 28772 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.087445 28772 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.090716 28981 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.091180 28981 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.090853 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:32.091550 28981 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:32.094772 28695 leader_election.cc:343] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.082567 28796 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:32.094918 28975 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 13:10:32.097637 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:32.098758 28772 ts_tablet_manager.cc:1434] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:10:32.092551 28546 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:32.101266 28772 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:32.103178 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:32.065446 28969 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.105257 28840 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.105683 28976 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.109867 28976 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.111055 28976 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.113593 28728 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:32.121122 28969 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:32.108127 28840 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.122799 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:32.121927 28580 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:32.123673 28840 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.129289 28854 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.127135 28796 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.134804 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:10:32.146595 28695 leader_election.cc:343] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.147029 28980 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.147527 28980 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:32.134805 28774 tablet_bootstrap.cc:492] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:32.140522 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:32.142637 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:32.142765 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:32.144094 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:32.148679 28774 ts_tablet_manager.cc:1403] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.337s	user 0.030s	sys 0.007s
I20260709 13:10:32.147974 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:32.154588 28654 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.154852 28845 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:32.157706 28774 raft_consensus.cc:359] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.158469 28774 raft_consensus.cc:385] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.158849 28774 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.162916 28774 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.113770 28979 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:10:32.160504 28579 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.171804 28774 ts_tablet_manager.cc:1434] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:32.185366 28770 raft_consensus.cc:359] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.186022 28770 raft_consensus.cc:385] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.186353 28770 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.171237 28652 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 1: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:10:32.186888 28770 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:32.195416 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45926.7us
I20260709 13:10:32.200574 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:32.201304 28729 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:32.162092 28791 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.162262 28840 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.221621 28770 ts_tablet_manager.cc:1434] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.147s	user 0.006s	sys 0.002s
I20260709 13:10:32.226486 28580 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:32.232419 28774 tablet_bootstrap.cc:492] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:32.187265 28980 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.238245 28770 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:32.237843 28977 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.244413 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:32.251812 28656 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.245848 28578 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:10:32.255707 28695 leader_election.cc:343] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.256199 28695 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:32.247143 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:32.265645 28969 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.262274 28654 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:32.293473 28772 tablet_bootstrap.cc:654] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.295145 28727 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:32.266033 28977 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.286329 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:32.304076 28791 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:32.319077 28981 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.320952 28854 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.321380 28854 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.321497 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:32.321769 28854 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.308641 28840 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.296459 28986 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.107s
I20260709 13:10:32.301296 28976 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.331413 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:32.332307 28726 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:32.336582 28977 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.336859 28981 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.341863 28838 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:32.345142 28620 leader_election.cc:343] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.347334 28579 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:32.347622 28774 tablet_bootstrap.cc:654] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.359067 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:32.359879 28650 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:32.361050 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:32.361789 28650 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:10:32.363787 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:32.364871 28838 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.367736 28477 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.367470 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:32.388315 28896 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:32.389338 28976 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.392632 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:32.396414 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:32.399142 28977 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.399637 28977 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:32.400718 28977 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:32.417762 28695 consensus_peers.cc:597] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.423062 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:32.426918 28727 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.433362 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:10:32.436303 28621 leader_election.cc:343] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.437948 28993 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:10:32.421366 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:32.439538 28728 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:32.444198 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:32.444772 28978 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.447428 28978 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:32.446658 28576 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:10:32.420531 28854 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.452819 28854 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.453908 28774 tablet_bootstrap.cc:492] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:32.448252 28978 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.456861 28770 tablet_bootstrap.cc:654] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.458828 28774 ts_tablet_manager.cc:1403] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.242s	user 0.015s	sys 0.016s
I20260709 13:10:32.461397 28772 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:32.465674 28994 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:32.459551 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:32.468025 28695 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:32.468691 28727 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:32.483071 28772 ts_tablet_manager.cc:1403] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.382s	user 0.018s	sys 0.025s
I20260709 13:10:32.492151 28772 raft_consensus.cc:359] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.492700 28772 raft_consensus.cc:385] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.492970 28772 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.493709 28772 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.487141 28980 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.485314 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:32.540395 28854 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:32.540818 28854 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.541188 28854 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.541713 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:10:32.544306 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:32.546612 28774 raft_consensus.cc:359] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.547344 28774 raft_consensus.cc:385] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.547622 28774 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.555122 28774 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.554746 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:10:32.557175 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 79023.3us
I20260709 13:10:32.558682 28580 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.562891 28774 ts_tablet_manager.cc:1434] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
I20260709 13:10:32.563970 28774 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:32.548112 28854 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.568327 28580 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:32.568892 28854 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.571524 28772 ts_tablet_manager.cc:1434] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.081s	user 0.001s	sys 0.006s
I20260709 13:10:32.580269 28772 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:32.587375 28770 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:32.588069 28770 ts_tablet_manager.cc:1403] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.354s	user 0.010s	sys 0.006s
I20260709 13:10:32.595700 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:32.579574 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:32.600057 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:32.610163 28982 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.610759 28982 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:32.612186 28774 tablet_bootstrap.cc:654] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.611637 28982 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.599242 28770 raft_consensus.cc:359] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.602877 28977 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.614274 28977 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:32.615095 28977 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.621390 28770 raft_consensus.cc:385] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.621712 28770 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.622332 28770 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.601290 28545 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:32.627305 28993 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.628021 28993 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:32.618942 28620 leader_election.cc:343] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.675554 28770 ts_tablet_manager.cc:1434] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.087s	user 0.002s	sys 0.024s
I20260709 13:10:32.656637 28993 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:32.678429 28986 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.679911 28770 tablet_bootstrap.cc:492] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
W20260709 13:10:32.680308 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 76634.8us
W20260709 13:10:32.681213 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 80010.1us
I20260709 13:10:32.672370 28772 tablet_bootstrap.cc:654] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.658293 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:32.687273 28695 leader_election.cc:343] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:32.696615 28621 leader_election.cc:343] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.700734 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:32.701419 28727 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.704272 28774 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:32.704919 28774 ts_tablet_manager.cc:1403] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.007s
I20260709 13:10:32.709676 28770 tablet_bootstrap.cc:654] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.709769 28727 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:32.708474 28774 raft_consensus.cc:359] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.714287 28774 raft_consensus.cc:385] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.714727 28774 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.715672 28774 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.720058 28774 ts_tablet_manager.cc:1434] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:10:32.721275 28774 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:32.742939 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:32.747291 28977 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.747829 28977 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.747891 28774 tablet_bootstrap.cc:654] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.762801 28977 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:32.816495 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:32.817582 28580 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:32.864761 28770 tablet_bootstrap.cc:492] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:32.865337 28770 ts_tablet_manager.cc:1403] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.186s	user 0.023s	sys 0.027s
I20260709 13:10:32.866022 28577 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.882444 28772 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:32.883019 28772 ts_tablet_manager.cc:1403] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.303s	user 0.016s	sys 0.017s
W20260709 13:10:32.888021 28695 leader_election.cc:343] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:32.888525 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:32.890112 28993 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:32.890844 28770 raft_consensus.cc:359] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.891556 28770 raft_consensus.cc:385] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.891826 28770 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.892452 28770 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.893083 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:32.901371 28772 raft_consensus.cc:359] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.902243 28772 raft_consensus.cc:385] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:32.902398 28770 ts_tablet_manager.cc:1434] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 13:10:32.902539 28772 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:32.903708 28772 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.911684 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:32.912701 28854 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:32.913216 28854 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:32.914040 28854 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:32.917441 28770 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:32.940874 28772 ts_tablet_manager.cc:1434] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:10:32.943936 28772 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:32.942914 28620 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:32.949211 28977 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:32.936085 28791 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:10:32.990360 28772 tablet_bootstrap.cc:654] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:32.993127 28796 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:32.995901 28774 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:32.996676 28774 ts_tablet_manager.cc:1403] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.276s	user 0.014s	sys 0.020s
I20260709 13:10:32.996611 28986 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:10:32.999898 28986 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.001719 28774 raft_consensus.cc:359] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.002437 28774 raft_consensus.cc:385] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.002707 28774 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.003504 28774 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.005673 28774 ts_tablet_manager.cc:1434] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:33.006650 28774 tablet_bootstrap.cc:492] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:33.010632 28978 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.014032 28770 tablet_bootstrap.cc:654] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.023201 28986 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.025030 28977 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.025517 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:33.026845 28978 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.027347 28978 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.029323 28796 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.029953 28978 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.032851 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.038744 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.039500 28652 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
W20260709 13:10:33.046237 28695 leader_election.cc:343] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.050999 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:33.056977 28478 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.075881 28791 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.085521 28791 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.085912 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.088680 28980 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.085912 28791 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.094187 28546 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:33.096235 28840 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.070252 28845 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:10:33.103240 28791 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.105844 28791 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.108187 28772 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:33.108937 28772 ts_tablet_manager.cc:1403] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.005s
I20260709 13:10:33.111656 28772 raft_consensus.cc:359] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.112393 28772 raft_consensus.cc:385] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.112731 28772 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.113390 28772 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.119364 28772 ts_tablet_manager.cc:1434] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:33.122392 28770 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:33.123026 28770 ts_tablet_manager.cc:1403] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.206s	user 0.010s	sys 0.014s
I20260709 13:10:33.126399 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:33.126906 28772 tablet_bootstrap.cc:492] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:33.127957 28651 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.133401 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:33.136989 28770 raft_consensus.cc:359] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.138827 28770 raft_consensus.cc:385] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.139103 28770 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.143332 28774 tablet_bootstrap.cc:654] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.148814 28695 leader_election.cc:343] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.164741 28651 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:33.168349 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:33.169914 28969 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.170451 28969 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:33.171414 28969 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.173858 28770 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.176340 28770 ts_tablet_manager.cc:1434] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.003s
I20260709 13:10:33.177351 28770 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:33.189867 28981 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.195221 28774 tablet_bootstrap.cc:492] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:33.206907 28845 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.207286 28770 tablet_bootstrap.cc:654] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.207552 28845 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.211145 28476 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.226895 28981 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.250954 28772 tablet_bootstrap.cc:654] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.221670 28476 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.256067 28845 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.261754 28774 ts_tablet_manager.cc:1403] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.255s	user 0.019s	sys 0.006s
I20260709 13:10:33.261560 28476 catalog_manager.cc:5697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.264541 28476 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.265305 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.270239 28986 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.271281 28986 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.275137 28981 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.273707 28986 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.278894 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.279196 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:33.279840 28653 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:33.280025 28727 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:10:33.282027 28695 leader_election.cc:343] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.282938 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.291422 28774 raft_consensus.cc:359] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.292517 28774 raft_consensus.cc:385] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.293157 28774 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.293753 28896 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.294399 28896 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:33.293727 28620 consensus_peers.cc:597] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.302565 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:33.303227 28791 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.303609 28791 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.303946 28791 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.303946 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:33.304198 28896 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.306507 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.308528 28653 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:33.316123 28791 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.306878 28896 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.313208 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:33.316951 28774 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.317700 28840 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.318112 28840 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.318429 28840 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.323236 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:33.323909 28727 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:33.328186 28840 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.327876 28478 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.332803 28791 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.334188 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:33.341768 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:33.342655 28652 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.341147 28774 ts_tablet_manager.cc:1434] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.002s
I20260709 13:10:33.344844 28774 tablet_bootstrap.cc:492] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:33.323885 28896 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:33.351779 28695 leader_election.cc:343] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:33.356293 29035 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:10:33.359581 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:33.359360 28840 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.360328 28653 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.362315 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:33.362905 28727 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.366652 28770 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:33.367224 28770 ts_tablet_manager.cc:1403] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.190s	user 0.012s	sys 0.003s
I20260709 13:10:33.369835 28727 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:33.371129 28545 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:33.372084 28840 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.372624 28840 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:33.373790 28840 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.374918 28652 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:33.378027 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:33.378835 28978 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.379300 28978 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:33.380143 28978 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.382354 28770 raft_consensus.cc:359] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.384481 28770 raft_consensus.cc:385] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.384617 28772 tablet_bootstrap.cc:492] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:33.384135 28774 tablet_bootstrap.cc:654] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.385174 28772 ts_tablet_manager.cc:1403] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.258s	user 0.013s	sys 0.011s
I20260709 13:10:33.385532 28770 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.388955 28770 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.390636 28653 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:33.396166 28772 raft_consensus.cc:359] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.397061 28772 raft_consensus.cc:385] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.397377 28772 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.398466 28772 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.399310 28770 ts_tablet_manager.cc:1434] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 13:10:33.401794 28772 ts_tablet_manager.cc:1434] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:33.403540 28978 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.404094 28978 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.406752 28978 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.407464 28796 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.408372 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.408505 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.413632 28772 tablet_bootstrap.cc:492] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:33.417786 28476 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.420504 28772 tablet_bootstrap.cc:654] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.422422 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:33.433426 28796 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.439049 28791 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.410218 28770 tablet_bootstrap.cc:492] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:33.447109 28796 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.448064 28796 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.447862 28478 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.452000 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:33.454114 28621 leader_election.cc:343] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.455687 28772 tablet_bootstrap.cc:492] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:33.455803 28796 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.456178 28772 ts_tablet_manager.cc:1403] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.010s
I20260709 13:10:33.457762 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:33.459093 28772 raft_consensus.cc:359] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.459882 28772 raft_consensus.cc:385] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.460224 28772 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.462898 28770 tablet_bootstrap.cc:654] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.466795 28620 leader_election.cc:343] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.467501 28772 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.469763 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:33.470633 28796 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:33.477842 28772 ts_tablet_manager.cc:1434] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:10:33.478892 28772 tablet_bootstrap.cc:492] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:33.483081 28774 tablet_bootstrap.cc:492] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:33.483593 28774 ts_tablet_manager.cc:1403] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.025s
I20260709 13:10:33.484984 28772 tablet_bootstrap.cc:654] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.486334 28774 raft_consensus.cc:359] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.487090 28774 raft_consensus.cc:385] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.487330 28774 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.488193 28774 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.491776 28774 ts_tablet_manager.cc:1434] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:10:33.493136 28774 tablet_bootstrap.cc:492] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:33.498962 28770 tablet_bootstrap.cc:492] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:33.499470 28770 ts_tablet_manager.cc:1403] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.002s
I20260709 13:10:33.500239 28772 tablet_bootstrap.cc:492] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:33.500738 28772 ts_tablet_manager.cc:1403] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:10:33.500802 28774 tablet_bootstrap.cc:654] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.502090 28770 raft_consensus.cc:359] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.502792 28770 raft_consensus.cc:385] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.503044 28770 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.506642 28772 raft_consensus.cc:359] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.506371 28770 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.507481 28772 raft_consensus.cc:385] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.508033 28772 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.508760 28772 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.510985 28772 ts_tablet_manager.cc:1434] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:10:33.509464 28770 ts_tablet_manager.cc:1434] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.005s
I20260709 13:10:33.512552 28770 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:33.518638 28770 tablet_bootstrap.cc:654] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.518803 28772 tablet_bootstrap.cc:492] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:33.524199 28774 tablet_bootstrap.cc:492] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:33.524698 28774 ts_tablet_manager.cc:1403] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.005s
I20260709 13:10:33.531595 28772 tablet_bootstrap.cc:654] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.534349 28774 raft_consensus.cc:359] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.535113 28774 raft_consensus.cc:385] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.535382 28774 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.536140 28774 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.538149 28774 ts_tablet_manager.cc:1434] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:33.539839 28774 tablet_bootstrap.cc:492] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:33.547763 28772 tablet_bootstrap.cc:492] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:33.547763 28770 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:33.548398 28770 ts_tablet_manager.cc:1403] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.017s
I20260709 13:10:33.548602 28772 ts_tablet_manager.cc:1403] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.013s
I20260709 13:10:33.548631 28796 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.550109 28796 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.551229 28770 raft_consensus.cc:359] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.551838 28770 raft_consensus.cc:385] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.552096 28770 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.552709 28770 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.553210 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.553902 28574 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:33.554939 28770 ts_tablet_manager.cc:1434] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:33.556017 28770 tablet_bootstrap.cc:492] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:33.557999 28774 tablet_bootstrap.cc:654] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.560760 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:33.561932 28727 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:33.563525 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:33.564327 28977 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.564870 28977 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.552518 28796 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.565311 28977 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.569142 28770 tablet_bootstrap.cc:654] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.572746 28772 raft_consensus.cc:359] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.573835 28772 raft_consensus.cc:385] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.574190 28772 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.575048 28772 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.577993 28772 ts_tablet_manager.cc:1434] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:10:33.579524 28772 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:33.584314 28977 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.586670 28770 tablet_bootstrap.cc:492] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:33.587168 28770 ts_tablet_manager.cc:1403] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 13:10:33.587375 28977 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.589346 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:33.590046 28727 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.588672 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:33.593641 28574 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.597432 28772 tablet_bootstrap.cc:654] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.600466 28727 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:33.600893 28770 raft_consensus.cc:359] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.601598 28770 raft_consensus.cc:385] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.601797 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:33.601985 28770 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.603579 28796 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.603608 28770 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.604277 28796 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:33.605664 28574 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:33.605492 28796 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.616497 28770 ts_tablet_manager.cc:1434] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:10:33.632812 28579 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.644030 28770 tablet_bootstrap.cc:492] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:33.644848 28845 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.645463 28845 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.647912 28845 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.650548 28772 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:33.649995 28476 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.652913 28772 ts_tablet_manager.cc:1403] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.005s
I20260709 13:10:33.653577 28774 tablet_bootstrap.cc:492] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:33.654080 28774 ts_tablet_manager.cc:1403] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.048s
I20260709 13:10:33.655944 28772 raft_consensus.cc:359] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.649118 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.656852 28774 raft_consensus.cc:359] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.657377 28653 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:33.657652 28774 raft_consensus.cc:385] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.657995 28774 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.656759 28772 raft_consensus.cc:385] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.658711 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:33.659063 28772 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.651473 28791 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:33.659902 28772 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.661177 28978 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.661582 28978 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.661917 28978 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.662374 28772 ts_tablet_manager.cc:1434] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:10:33.658732 28774 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.662937 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.664199 28772 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:33.665293 28774 ts_tablet_manager.cc:1434] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:33.667451 28774 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
W20260709 13:10:33.669260 28695 leader_election.cc:343] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.674036 28727 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.679147 28772 tablet_bootstrap.cc:654] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.694283 28770 tablet_bootstrap.cc:654] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.694828 28607 tablet.cc:2406] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:33.707827 28978 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.711555 28978 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.713058 28774 tablet_bootstrap.cc:654] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.730635 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:33.731171 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:33.740821 28653 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.727421 28969 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.741641 28969 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.746641 28969 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.756103 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.757788 28580 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:33.758885 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.761868 28654 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:33.759472 28774 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:33.764328 28774 ts_tablet_manager.cc:1403] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.003s
W20260709 13:10:33.764668 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:10:33.757143 28695 leader_election.cc:343] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.766057 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:33.749331 28653 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:33.769074 28774 raft_consensus.cc:359] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.769830 28774 raft_consensus.cc:385] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.770038 28969 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.770545 28969 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.770932 28969 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.770107 28774 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.771909 28774 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.775482 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:33.776572 28845 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:33.777253 28772 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:33.779449 28772 ts_tablet_manager.cc:1403] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.115s	user 0.020s	sys 0.017s
I20260709 13:10:33.779876 28845 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.780346 28770 tablet_bootstrap.cc:492] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:33.786024 28770 ts_tablet_manager.cc:1403] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.010s
I20260709 13:10:33.785838 28969 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.786861 28774 ts_tablet_manager.cc:1434] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:10:33.788151 28774 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:33.788759 28969 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.789268 28770 raft_consensus.cc:359] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.789961 28770 raft_consensus.cc:385] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.790246 28770 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.793304 28845 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:33.791462 28770 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.794186 28845 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.795176 28770 ts_tablet_manager.cc:1434] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:33.799175 28770 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:33.806223 28770 tablet_bootstrap.cc:654] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.811841 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:33.813601 28774 tablet_bootstrap.cc:654] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.819849 28579 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.818275 28772 raft_consensus.cc:359] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.818590 28478 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.826766 28772 raft_consensus.cc:385] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.828027 28772 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.820941 28791 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:33.822301 28994 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.830829 28994 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.828820 28772 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.834375 28772 ts_tablet_manager.cc:1434] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:10:33.835531 28772 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:33.837356 28770 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:33.838091 28770 ts_tablet_manager.cc:1403] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.009s
I20260709 13:10:33.842214 28772 tablet_bootstrap.cc:654] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.847832 28994 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.818879 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:33.854998 28654 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.857429 28982 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.858009 28982 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.860379 28982 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.862124 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.863106 28770 raft_consensus.cc:359] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:33.864019 28621 leader_election.cc:343] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.864305 28654 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:33.864802 28770 raft_consensus.cc:385] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.865535 28770 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.866909 28770 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.867633 28579 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:33.870808 28770 ts_tablet_manager.cc:1434] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:10:33.871681 28774 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:33.872174 28774 ts_tablet_manager.cc:1403] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.009s
W20260709 13:10:33.872092 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52433us
I20260709 13:10:33.871692 28772 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:33.873353 28770 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:33.873540 28772 ts_tablet_manager.cc:1403] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.007s
I20260709 13:10:33.875212 28774 raft_consensus.cc:359] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.875864 28774 raft_consensus.cc:385] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.876145 28774 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.876145 28772 raft_consensus.cc:359] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.877081 28774 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.877820 28772 raft_consensus.cc:385] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.878108 28772 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.878719 28772 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.879329 28774 ts_tablet_manager.cc:1434] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:33.880236 28774 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:33.884183 28772 ts_tablet_manager.cc:1434] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:33.885399 28772 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:33.887455 28774 tablet_bootstrap.cc:654] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.900998 28770 tablet_bootstrap.cc:654] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.903434 28772 tablet_bootstrap.cc:654] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.909145 28982 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.909657 28982 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.910583 28774 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:33.911044 28774 ts_tablet_manager.cc:1403] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:10:33.911748 28982 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.913713 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.913899 28774 raft_consensus.cc:359] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.914697 28774 raft_consensus.cc:385] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.914983 28774 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
W20260709 13:10:33.915656 28621 leader_election.cc:343] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.915818 28774 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.918514 28774 ts_tablet_manager.cc:1434] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:33.919468 28774 tablet_bootstrap.cc:492] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:33.928498 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.928788 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:33.929728 28654 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:33.933243 29063 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.933797 29063 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.936671 29063 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:33.938807 28982 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.948055 28982 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.948457 28774 tablet_bootstrap.cc:654] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.950925 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:33.951597 28579 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:33.952834 28621 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:33.953188 28982 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:33.953781 28982 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.954526 28982 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.954927 28982 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.964071 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:33.964320 28986 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:33.965147 29063 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.965808 29063 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:33.966642 29063 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:33.988523 28896 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.006019 28774 tablet_bootstrap.cc:492] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:34.006616 28774 ts_tablet_manager.cc:1403] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.004s
I20260709 13:10:34.009907 28774 raft_consensus.cc:359] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.010790 28774 raft_consensus.cc:385] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.011127 28774 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.011916 28774 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.014780 28774 ts_tablet_manager.cc:1434] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:34.016340 28774 tablet_bootstrap.cc:492] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:34.017436 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:34.030527 28774 tablet_bootstrap.cc:654] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.039929 28840 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.040694 28840 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.045339 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:34.047125 28840 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:34.048636 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:34.053099 28774 tablet_bootstrap.cc:492] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:34.052767 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:34.053601 28774 ts_tablet_manager.cc:1403] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.009s
I20260709 13:10:34.055022 28840 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.066103 28978 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.066666 28978 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.067148 28978 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.067827 28845 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.068290 28845 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.069051 28774 raft_consensus.cc:359] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.069702 28774 raft_consensus.cc:385] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.069952 28774 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.070312 28845 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:34.070608 28774 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.072698 28774 ts_tablet_manager.cc:1434] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.000s
W20260709 13:10:34.065996 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48660.8us
I20260709 13:10:34.080737 28978 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.081718 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:34.082150 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:34.082791 28724 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:34.083000 28730 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:34.084056 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:10:34.084654 28695 leader_election.cc:343] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.082759 28978 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:34.089432 28982 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.091292 28982 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:34.092279 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:34.092645 28774 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:34.092895 28579 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.099890 28579 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:34.101327 28621 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:10:34.103902 29072 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:10:34.104827 28982 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.106056 28478 catalog_manager.cc:5697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.107900 28772 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:34.108551 28772 ts_tablet_manager.cc:1403] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.223s	user 0.051s	sys 0.055s
I20260709 13:10:34.106225 28982 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:34.110841 28982 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.112229 28772 raft_consensus.cc:359] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.113190 28772 raft_consensus.cc:385] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.113508 28772 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.114135 28772 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.117189 28774 tablet_bootstrap.cc:654] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.117686 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:34.121358 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:34.123342 28770 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:34.123896 28770 ts_tablet_manager.cc:1403] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.251s	user 0.075s	sys 0.087s
I20260709 13:10:34.124042 28772 ts_tablet_manager.cc:1434] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:10:34.122331 28653 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:34.129987 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:34.131204 28579 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.133589 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:34.127491 28770 raft_consensus.cc:359] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.137207 28770 raft_consensus.cc:385] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.137527 28770 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.138162 28770 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.139035 28574 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:34.140398 28770 ts_tablet_manager.cc:1434] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:34.141418 28770 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:34.147718 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:34.148522 28727 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:34.152366 28695 leader_election.cc:343] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:34.157130 28695 leader_election.cc:343] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.162644 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:34.163689 28791 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.163882 28727 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:34.164215 28791 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.164778 28791 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.154035 28994 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.168609 28994 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.170666 28994 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:34.171234 29063 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.174391 28840 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.176782 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:34.176646 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:34.181600 28774 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:34.182070 28774 ts_tablet_manager.cc:1403] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.006s
I20260709 13:10:34.187448 28770 tablet_bootstrap.cc:654] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.188208 28774 raft_consensus.cc:359] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.177881 29063 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.189044 28774 raft_consensus.cc:385] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.193487 28774 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.194633 28774 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.178210 28840 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:34.198558 28695 leader_election.cc:343] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.201710 28791 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.192988 29063 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.207938 28774 ts_tablet_manager.cc:1434] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:10:34.207965 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:34.211733 28791 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:34.206375 29081 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.216238 29082 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.210327 29063 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.213600 29081 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.278797 28774 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:34.283563 28772 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
W20260709 13:10:34.303390 29076 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:10:34.326069 29081 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:10:34.346167 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 137275us
W20260709 13:10:34.347170 28620 leader_election.cc:343] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.347580 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:34.348613 29081 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.356069 29063 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.348299 28476 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.375607 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:34.376418 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:34.377202 28575 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:34.381126 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:34.381767 28651 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:34.368803 29081 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:10:34.387727 29063 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:34.389520 28840 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:34.388643 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:34.399420 29082 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.408372 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:34.408922 28969 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.405269 28572 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.403378 28654 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:34.426610 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:34.427273 28655 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.421279 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:34.410163 28969 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.428066 28578 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.440675 28969 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:34.445451 28652 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:34.445597 28621 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:34.456566 28772 tablet_bootstrap.cc:654] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.461437 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:34.465418 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:34.474071 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:34.473790 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:34.479689 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:34.485641 28652 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.491091 28724 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:34.480232 28655 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:34.495774 29081 raft_consensus.cc:2764] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:34.511013 28770 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:34.511656 28770 ts_tablet_manager.cc:1403] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.370s	user 0.018s	sys 0.032s
I20260709 13:10:34.512670 29085 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.513190 29085 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.515342 29085 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:10:34.516391 28695 leader_election.cc:343] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.517372 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:34.519470 28578 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:34.519615 29085 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.508960 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:34.521467 28770 raft_consensus.cc:359] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.522997 28774 tablet_bootstrap.cc:654] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.523247 28770 raft_consensus.cc:385] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.525540 28770 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.526490 28770 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.526835 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:34.523792 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:34.527076 29084 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.528820 28978 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.529623 28969 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.530802 28652 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:34.531672 28969 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:34.533416 28969 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.535341 28770 ts_tablet_manager.cc:1434] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.002s
W20260709 13:10:34.532377 28695 leader_election.cc:343] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.537431 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:34.538326 29085 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.538859 29085 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:34.539716 29085 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.541608 28770 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:34.547387 29078 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:34.556427 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:34.557490 28774 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:34.558003 28774 ts_tablet_manager.cc:1403] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.343s	user 0.011s	sys 0.004s
W20260709 13:10:34.566783 28695 leader_election.cc:343] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.567417 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:10:34.572909 28695 leader_election.cc:343] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.578231 29080 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:34.574513 29063 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:10:34.571576 28978 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.569780 28655 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:34.577445 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:34.586709 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:34.585359 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:34.587330 29080 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.587816 29080 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:34.588697 28978 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.589202 28978 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.588673 29080 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.590466 28978 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.592734 28477 catalog_manager.cc:5697] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:34.594480 28695 leader_election.cc:343] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.638965 28772 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:34.639793 28772 ts_tablet_manager.cc:1403] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.365s	user 0.016s	sys 0.004s
I20260709 13:10:34.656874 28978 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.659337 28978 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:34.665256 28774 raft_consensus.cc:359] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.666308 28774 raft_consensus.cc:385] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.666680 28774 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.667570 28774 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.623520 29078 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:10:34.680883 28774 ts_tablet_manager.cc:1434] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.002s
I20260709 13:10:34.682037 28774 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:34.684496 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:34.685217 28652 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.688324 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:34.699666 28772 raft_consensus.cc:359] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.700492 28772 raft_consensus.cc:385] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.700793 28772 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.701676 28772 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:34.707830 28695 leader_election.cc:343] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.708858 28770 tablet_bootstrap.cc:654] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.705109 29079 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:34.722888 28772 ts_tablet_manager.cc:1434] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.000s
I20260709 13:10:34.725935 28652 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:34.728506 28774 tablet_bootstrap.cc:654] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.735016 28986 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.735536 28986 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.738322 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:34.737650 28986 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:34.740672 28978 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.740315 29080 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.749833 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:10:34.753949 28545 leader_election.cc:343] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.749068 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:10:34.758807 28546 leader_election.cc:343] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.759284 28546 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:34.760792 28986 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.761682 28772 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:34.768795 28770 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:34.769491 28770 ts_tablet_manager.cc:1403] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.233s	user 0.011s	sys 0.013s
I20260709 13:10:34.781418 28770 raft_consensus.cc:359] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.782133 28770 raft_consensus.cc:385] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.782401 28770 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.784044 28774 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:34.784505 28774 ts_tablet_manager.cc:1403] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.103s	user 0.006s	sys 0.011s
I20260709 13:10:34.785616 28477 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.787326 28477 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.788323 28770 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.795240 28770 ts_tablet_manager.cc:1434] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:10:34.796828 28770 tablet_bootstrap.cc:492] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:34.805274 28772 tablet_bootstrap.cc:654] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.806972 28774 raft_consensus.cc:359] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.810182 28774 raft_consensus.cc:385] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.810494 28774 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.811076 28774 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.815653 28770 tablet_bootstrap.cc:654] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.819785 28774 ts_tablet_manager.cc:1434] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:10:34.820842 28774 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:34.825202 29080 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:34.827304 29080 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.849121 28770 tablet_bootstrap.cc:492] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:34.850402 28770 ts_tablet_manager.cc:1403] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.002s
I20260709 13:10:34.857566 28774 tablet_bootstrap.cc:654] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.867251 28770 raft_consensus.cc:359] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.867882 28770 raft_consensus.cc:385] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.868182 28770 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.868873 28770 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.870256 28772 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:34.870771 28772 ts_tablet_manager.cc:1403] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.026s
I20260709 13:10:34.870812 28770 ts_tablet_manager.cc:1434] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:10:34.874086 28772 raft_consensus.cc:359] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.874827 28772 raft_consensus.cc:385] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.875142 28772 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.875751 28770 tablet_bootstrap.cc:492] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:34.875941 28772 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.878597 28772 ts_tablet_manager.cc:1434] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:34.879627 28772 tablet_bootstrap.cc:492] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:34.886539 28772 tablet_bootstrap.cc:654] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.896421 28770 tablet_bootstrap.cc:654] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.923097 28478 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.926714 28772 tablet_bootstrap.cc:492] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:34.927290 28772 ts_tablet_manager.cc:1403] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.011s
I20260709 13:10:34.931617 28772 raft_consensus.cc:359] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.932370 28772 raft_consensus.cc:385] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.932675 28772 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.934947 28772 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.939877 28772 ts_tablet_manager.cc:1434] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:10:34.940997 28772 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:34.943682 28977 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.951073 28977 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:34.961521 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:34.964527 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:34.964807 28620 leader_election.cc:343] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:34.971127 28621 leader_election.cc:343] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.971757 28621 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:34.975310 28772 tablet_bootstrap.cc:654] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.975270 29078 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.962531 28977 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:34.984100 29079 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.988426 29080 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:34.989146 29079 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.007728 29079 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.009462 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.009622 28774 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:35.010308 28578 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:35.011157 28774 ts_tablet_manager.cc:1403] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.191s	user 0.030s	sys 0.037s
I20260709 13:10:35.012919 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:35.013903 28721 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:35.015120 28621 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:35.016606 28982 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.017025 28982 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.017416 28982 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.031924 28770 tablet_bootstrap.cc:492] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:35.032881 28770 ts_tablet_manager.cc:1403] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.157s	user 0.030s	sys 0.049s
I20260709 13:10:35.031961 28774 raft_consensus.cc:359] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.035446 28774 raft_consensus.cc:385] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.035781 28774 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.037220 28770 raft_consensus.cc:359] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.039685 28982 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.042035 28982 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.043112 28772 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:35.042794 28774 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.043612 28772 ts_tablet_manager.cc:1403] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.011s
I20260709 13:10:35.045318 28774 ts_tablet_manager.cc:1434] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 13:10:35.046471 28774 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
W20260709 13:10:35.046547 28695 consensus_peers.cc:597] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:35.038139 28770 raft_consensus.cc:385] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.048761 28770 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.049921 28770 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:35.051359 28695 consensus_peers.cc:597] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:35.052099 28772 raft_consensus.cc:359] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.053107 28772 raft_consensus.cc:385] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.053875 28772 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.054330 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:35.055087 28721 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.055294 28772 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:35.060496 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:35.062021 28774 tablet_bootstrap.cc:654] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.063318 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:35.064047 28578 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.072467 28770 ts_tablet_manager.cc:1434] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:10:35.074635 28774 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:35.075301 28774 ts_tablet_manager.cc:1403] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.006s
I20260709 13:10:35.078043 28770 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:35.080600 28772 ts_tablet_manager.cc:1434] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:10:35.081864 28772 tablet_bootstrap.cc:492] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:35.084810 28774 raft_consensus.cc:359] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.085690 28774 raft_consensus.cc:385] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.086072 28774 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.086898 28774 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.089507 28774 ts_tablet_manager.cc:1434] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:35.090543 28772 tablet_bootstrap.cc:654] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.091353 28774 tablet_bootstrap.cc:492] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:35.097738 28770 tablet_bootstrap.cc:654] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.100796 28774 tablet_bootstrap.cc:654] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.106348 28578 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:35.110443 28721 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:35.113452 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:35.117671 29063 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.117861 28774 tablet_bootstrap.cc:492] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:35.118537 28774 ts_tablet_manager.cc:1403] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 13:10:35.115830 28977 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.121290 28977 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:35.118263 29063 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.122186 28977 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.123816 29063 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.127118 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.127885 28578 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:35.128584 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:35.130136 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:35.130046 28774 raft_consensus.cc:359] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.132573 28774 raft_consensus.cc:385] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.132654 29080 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.132939 28774 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.133252 29080 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.133738 29080 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.133728 28774 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:10:35.135519 28695 leader_election.cc:343] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.136157 28774 ts_tablet_manager.cc:1434] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:10:35.130847 29103 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:10:35.138262 28772 tablet_bootstrap.cc:492] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:35.149927 28772 ts_tablet_manager.cc:1403] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.000s
I20260709 13:10:35.150264 29063 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:35.144645 29080 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.146739 28770 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:35.151940 28770 ts_tablet_manager.cc:1403] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.003s
I20260709 13:10:35.153059 29080 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.152681 28772 raft_consensus.cc:359] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.153517 28772 raft_consensus.cc:385] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.153821 28772 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.154560 28772 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.154956 28770 raft_consensus.cc:359] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.155627 28770 raft_consensus.cc:385] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.155903 28770 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.156558 28770 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.157200 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:35.156870 28476 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.157804 28772 ts_tablet_manager.cc:1434] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:35.157773 28578 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.158850 28772 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:35.161777 28774 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:35.189042 28770 ts_tablet_manager.cc:1434] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:10:35.194849 29063 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.168591 28977 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.195384 29063 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.195760 28977 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.171066 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:35.174889 28578 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:35.200117 29063 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.202584 28774 tablet_bootstrap.cc:654] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.204445 28770 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
W20260709 13:10:35.208042 28695 leader_election.cc:343] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.212667 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:35.213599 28791 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.214072 28791 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:35.214959 28791 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.217301 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.221769 28770 tablet_bootstrap.cc:654] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.225206 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:35.228307 28772 tablet_bootstrap.cc:654] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.229907 28977 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.231714 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.232537 28577 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:35.234159 28621 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:35.235555 29079 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.236141 29079 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.237201 29079 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.240320 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:10:35.240617 28695 leader_election.cc:343] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.241107 28730 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:35.251071 29063 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.251914 29063 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.255211 29063 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.257247 29063 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:35.259895 28695 leader_election.cc:343] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.262125 28695 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:35.266245 28791 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:35.266268 29079 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.271814 29079 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.271605 28476 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.275604 28774 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:35.276091 28774 ts_tablet_manager.cc:1403] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.007s
I20260709 13:10:35.278640 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:35.279532 28572 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.280249 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:35.280954 28651 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:35.281291 28770 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:35.281769 28770 ts_tablet_manager.cc:1403] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.009s
I20260709 13:10:35.292052 28774 raft_consensus.cc:359] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.292387 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:35.293265 29063 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.293684 29063 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.294070 29063 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.295009 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.284642 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:35.295785 28730 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.292860 28774 raft_consensus.cc:385] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.298096 28774 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.299216 28791 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:35.304522 28770 raft_consensus.cc:359] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.305667 28770 raft_consensus.cc:385] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.306051 28770 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.313333 28774 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.318456 28770 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.321247 28774 ts_tablet_manager.cc:1434] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:10:35.326040 28774 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:35.326399 28572 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:35.329525 28772 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:35.330204 28772 ts_tablet_manager.cc:1403] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.172s	user 0.026s	sys 0.011s
I20260709 13:10:35.330542 28621 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:35.340883 28730 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:35.341046 28896 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.341809 28896 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.326421 29063 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.339083 29079 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.345880 28896 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:10:35.347887 28695 leader_election.cc:343] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.347787 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:35.358620 29079 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:35.351768 28770 ts_tablet_manager.cc:1434] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 13:10:35.359495 29079 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.351537 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:35.349634 29085 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.361223 29085 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.360978 28770 tablet_bootstrap.cc:492] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:35.365542 28545 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:35.365844 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:35.367367 28896 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:35.367130 28653 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:35.363268 29085 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.375459 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:35.376590 28845 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.377007 28845 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.377357 28845 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.381958 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:35.387770 28845 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.388335 28774 tablet_bootstrap.cc:654] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.391306 28845 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:10:35.391815 28695 leader_election.cc:343] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.394896 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:35.395514 28652 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.396477 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.403942 28772 raft_consensus.cc:359] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.404920 28772 raft_consensus.cc:385] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.406353 28772 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.414217 29063 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.415395 28652 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:35.409385 28772 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.418025 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:35.419211 28791 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.423074 28791 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:35.424263 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:35.424881 28652 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.405820 28572 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:35.427405 28581 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.428421 28770 tablet_bootstrap.cc:654] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.424034 28791 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.432668 28772 ts_tablet_manager.cc:1434] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.001s
I20260709 13:10:35.437281 28772 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:35.444530 28774 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:35.445056 28774 ts_tablet_manager.cc:1403] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.119s	user 0.018s	sys 0.001s
I20260709 13:10:35.445530 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:35.467823 28652 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:35.453943 28577 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.470535 28774 raft_consensus.cc:359] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.477682 28774 raft_consensus.cc:385] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.477658 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:35.478207 28774 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.477932 28772 tablet_bootstrap.cc:654] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.471029 28476 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.481595 28791 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.483119 28791 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:35.484859 28977 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.485432 28977 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.484042 28791 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.487839 28977 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.481338 28774 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.490264 28770 tablet_bootstrap.cc:492] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:35.490710 28770 ts_tablet_manager.cc:1403] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.006s
I20260709 13:10:35.492347 28774 ts_tablet_manager.cc:1434] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.003s
I20260709 13:10:35.493695 28986 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.493420 28770 raft_consensus.cc:359] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.497130 28770 raft_consensus.cc:385] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.496913 28986 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.497601 28770 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.498481 28770 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.499302 28986 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.497202 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.501324 28572 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 1: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:10:35.499660 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:35.503131 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:35.503896 28620 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:10:35.505134 28977 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.510257 29063 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.515573 28774 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:35.524145 28982 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.524677 28982 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.516228 29063 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.512935 28478 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.526784 28982 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.528280 29063 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.532969 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.533905 28572 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:35.510532 28577 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:35.538275 28621 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:35.539650 28982 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.543884 28982 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.544394 28982 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.550024 28478 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.552920 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:35.554350 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:35.556519 28772 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:35.560063 28772 ts_tablet_manager.cc:1403] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.010s
I20260709 13:10:35.565958 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.572172 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:35.572952 28730 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:35.574447 28772 raft_consensus.cc:359] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.575305 28772 raft_consensus.cc:385] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.577574 28772 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.578315 28772 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.578815 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:35.580529 28774 tablet_bootstrap.cc:654] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:35.584707 28695 leader_election.cc:343] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.585371 29084 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:35.587371 28695 leader_election.cc:343] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.587908 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:35.588737 28791 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:35.586004 29063 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:35.586043 28977 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:35.595721 28772 ts_tablet_manager.cc:1434] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.005s
I20260709 13:10:35.595829 28982 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.599694 29079 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.597092 28772 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:35.601419 28982 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.604475 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:35.605412 28728 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.617549 28770 ts_tablet_manager.cc:1434] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.126s	user 0.012s	sys 0.012s
I20260709 13:10:35.627331 28791 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:35.618466 28578 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.638386 28770 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:35.618660 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:35.620616 28728 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:35.649323 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:35.644898 28577 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.655418 28982 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:10:35.672053 28774 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:35.672618 28774 ts_tablet_manager.cc:1403] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.020s
I20260709 13:10:35.677879 28774 raft_consensus.cc:359] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.678658 28774 raft_consensus.cc:385] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.678964 28774 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.679636 28774 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.681172 29078 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.681741 29078 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.682543 28774 ts_tablet_manager.cc:1434] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:35.684278 29078 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.688782 28774 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:35.654314 28977 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:35.718581 28977 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:35.719605 28977 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.697067 28772 tablet_bootstrap.cc:654] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.698817 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:35.722038 28725 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:35.703722 28770 tablet_bootstrap.cc:654] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.703838 29063 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.709064 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:35.711401 28577 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:35.727931 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:35.735584 29078 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:35.735989 29078 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.736315 29078 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:35.737871 28621 leader_election.cc:343] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.753329 28774 tablet_bootstrap.cc:654] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.779258 29078 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.786677 28772 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:35.782891 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:35.787261 28772 ts_tablet_manager.cc:1403] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.190s	user 0.017s	sys 0.016s
I20260709 13:10:35.788316 28982 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:10:35.794026 28479 catalog_manager.cc:5697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.871047 29078 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:35.897774 28770 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:35.898244 28770 ts_tablet_manager.cc:1403] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.260s	user 0.006s	sys 0.016s
I20260709 13:10:35.896765 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:35.908661 28721 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.920805 28774 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:35.921380 28774 ts_tablet_manager.cc:1403] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.233s	user 0.024s	sys 0.005s
I20260709 13:10:35.925762 28845 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.926304 28845 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.927742 28770 raft_consensus.cc:359] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.928345 28845 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.928478 28770 raft_consensus.cc:385] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.924865 28721 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:35.933193 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:35.934549 28695 leader_election.cc:343] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:35.928850 28770 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.936978 28774 raft_consensus.cc:359] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.937537 28774 raft_consensus.cc:385] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.937708 28774 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.938212 28774 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.937950 28770 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.939859 28774 ts_tablet_manager.cc:1434] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.000s
I20260709 13:10:35.939898 28772 raft_consensus.cc:359] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.940840 28774 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:35.940776 28772 raft_consensus.cc:385] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.942884 28772 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.944077 28772 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.945797 28770 ts_tablet_manager.cc:1434] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:10:35.947754 28770 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:35.955909 28770 tablet_bootstrap.cc:654] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.958180 28774 tablet_bootstrap.cc:654] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:35.958417 28845 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.960374 28772 ts_tablet_manager.cc:1434] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.172s	user 0.005s	sys 0.002s
I20260709 13:10:35.963160 28772 tablet_bootstrap.cc:492] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:35.969676 28770 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:35.970177 28770 ts_tablet_manager.cc:1403] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.010s
I20260709 13:10:35.973481 28770 raft_consensus.cc:359] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.974160 28770 raft_consensus.cc:385] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.974489 28770 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.975268 28770 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.980170 28774 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:35.980724 28774 ts_tablet_manager.cc:1403] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.010s
I20260709 13:10:35.981405 28575 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:35.983825 28774 raft_consensus.cc:359] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.984659 28774 raft_consensus.cc:385] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:35.984969 28774 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:35.988449 28845 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.988976 28845 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.991079 28969 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:35.985790 28774 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:35.992313 28770 ts_tablet_manager.cc:1434] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 13:10:35.994555 28770 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:35.991079 28845 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:35.993395 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:10:36.001442 28695 leader_election.cc:343] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.006551 28774 ts_tablet_manager.cc:1434] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:10:36.009119 28770 tablet_bootstrap.cc:654] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.008606 28774 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:36.014205 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:10:36.033223 28621 leader_election.cc:343] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.036062 29078 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.036826 29078 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:36.038009 29078 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.051733 29141 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:36.065780 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:36.067438 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:36.023706 28772 tablet_bootstrap.cc:654] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.081637 28774 tablet_bootstrap.cc:654] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.162858 28772 tablet_bootstrap.cc:492] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
W20260709 13:10:36.163764 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49930.7us
I20260709 13:10:36.163903 28770 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:36.165086 28770 ts_tablet_manager.cc:1403] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.171s	user 0.056s	sys 0.075s
I20260709 13:10:36.164480 28772 ts_tablet_manager.cc:1403] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.202s	user 0.005s	sys 0.007s
I20260709 13:10:36.167699 28770 raft_consensus.cc:359] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.168422 29085 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:36.168577 28695 leader_election.cc:343] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.177887 28695 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:36.178574 29085 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:36.178907 28695 leader_election.cc:343] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.179318 28695 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:36.179922 29085 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.168480 28774 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:36.180444 29103 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:36.180795 28774 ts_tablet_manager.cc:1403] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.172s	user 0.027s	sys 0.025s
I20260709 13:10:36.177066 29150 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:10:36.168869 28770 raft_consensus.cc:385] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.183126 28770 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.183835 28774 raft_consensus.cc:359] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.183849 28770 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.187831 28476 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.168733 28772 raft_consensus.cc:359] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.188306 28770 ts_tablet_manager.cc:1434] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:10:36.184595 28774 raft_consensus.cc:385] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.199410 28774 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.185778 29103 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.189913 28772 raft_consensus.cc:385] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.200392 28774 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.201112 28772 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.200867 29103 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.201795 28772 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.202816 29103 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:36.203148 28774 ts_tablet_manager.cc:1434] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 13:10:36.204573 28774 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:36.206269 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:36.207145 28576 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:36.206274 28770 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:36.214003 28774 tablet_bootstrap.cc:654] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.225297 28772 ts_tablet_manager.cc:1434] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:10:36.229854 28770 tablet_bootstrap.cc:654] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.230091 28772 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:36.225919 28774 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:36.227612 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:36.233686 28774 ts_tablet_manager.cc:1403] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.000s
I20260709 13:10:36.233865 28655 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 0.
I20260709 13:10:36.238240 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:36.238926 29103 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.239274 29103 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.239666 29103 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.250851 28774 raft_consensus.cc:359] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.251694 28774 raft_consensus.cc:385] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.251973 28774 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.252727 28774 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.256772 28774 ts_tablet_manager.cc:1434] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:10:36.259761 28772 tablet_bootstrap.cc:654] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.261046 28774 tablet_bootstrap.cc:492] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Bootstrap starting.
I20260709 13:10:36.264592 28770 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:36.265276 28770 ts_tablet_manager.cc:1403] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.006s
I20260709 13:10:36.248275 29103 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.270998 28770 raft_consensus.cc:359] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.271749 29150 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:36.272132 28770 raft_consensus.cc:385] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.272781 29103 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:36.272568 28770 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.278862 28774 tablet_bootstrap.cc:654] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.273976 28770 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.288301 28772 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:36.288794 28772 ts_tablet_manager.cc:1403] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 13:10:36.289687 28770 ts_tablet_manager.cc:1434] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:10:36.290855 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:36.299463 28575 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.301062 28774 tablet_bootstrap.cc:492] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: No bootstrap required, opened a new log
I20260709 13:10:36.301584 28774 ts_tablet_manager.cc:1403] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.000s
I20260709 13:10:36.304279 28774 raft_consensus.cc:359] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.304931 28774 raft_consensus.cc:385] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.305240 28774 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.305234 28770 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:36.291461 28772 raft_consensus.cc:359] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.292239 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:36.310562 28656 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.305887 28774 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.313370 28774 ts_tablet_manager.cc:1434] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:36.317184 28772 raft_consensus.cc:385] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.317632 28772 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.318432 28772 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.326604 28656 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:36.328559 28772 ts_tablet_manager.cc:1434] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:10:36.329703 28772 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:36.319293 28770 tablet_bootstrap.cc:654] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.321980 28575 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:10:36.334453 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:36.339219 29085 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.339816 29085 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:36.342356 29085 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.348634 28772 tablet_bootstrap.cc:654] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.353926 28770 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
W20260709 13:10:36.353749 28527 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:36.354610 28770 ts_tablet_manager.cc:1403] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260709 13:10:36.354918 28772 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:36.355406 28772 ts_tablet_manager.cc:1403] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:10:36.357980 28770 raft_consensus.cc:359] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.358093 28772 raft_consensus.cc:359] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.358775 28772 raft_consensus.cc:385] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.359072 28772 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.359838 28772 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.362010 28772 ts_tablet_manager.cc:1434] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:36.363076 28772 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:36.358736 28770 raft_consensus.cc:385] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.364460 28770 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.365168 28770 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.368880 28772 tablet_bootstrap.cc:654] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.374980 28477 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.383370 28770 ts_tablet_manager.cc:1434] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:10:36.401840 28770 tablet_bootstrap.cc:492] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:36.408773 28772 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:36.409432 28772 ts_tablet_manager.cc:1403] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.021s
I20260709 13:10:36.411194 28770 tablet_bootstrap.cc:654] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.412411 28772 raft_consensus.cc:359] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.413270 28772 raft_consensus.cc:385] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.413610 28772 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.414425 28772 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.416344 28770 tablet_bootstrap.cc:492] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:36.416478 28772 ts_tablet_manager.cc:1434] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:36.416839 28770 ts_tablet_manager.cc:1403] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:10:36.417915 28772 tablet_bootstrap.cc:492] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:36.424346 28770 raft_consensus.cc:359] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.426734 28770 raft_consensus.cc:385] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.427070 28770 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.428375 28770 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.435467 28770 ts_tablet_manager.cc:1434] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:10:36.441401 28772 tablet_bootstrap.cc:654] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.447439 28770 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:36.447799 28772 tablet_bootstrap.cc:492] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:36.448221 28772 ts_tablet_manager.cc:1403] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.002s
I20260709 13:10:36.451328 28772 raft_consensus.cc:359] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.452049 28772 raft_consensus.cc:385] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.452327 28772 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.453204 28772 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.455267 28772 ts_tablet_manager.cc:1434] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:36.456262 28772 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:36.458189 29150 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.458698 29150 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.461840 29150 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.462107 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:36.462853 28581 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.465627 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:36.466123 28772 tablet_bootstrap.cc:654] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.466493 28977 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.466867 28977 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.467295 28977 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.462152 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.468441 28730 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.472218 29079 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.472750 29079 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.474881 29079 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.476675 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:36.479085 28977 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.477861 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.482317 29157 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.482429 28730 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.483067 29157 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.485293 28977 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:10:36.487226 28621 leader_election.cc:343] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.490051 29157 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.488430 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:36.487399 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:36.492406 28575 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.491479 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.498148 28545 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:36.499873 28770 tablet_bootstrap.cc:654] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.499758 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:36.500514 28730 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.500440 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:36.502324 28977 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.504254 28977 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.504922 29135 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.505218 28977 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.505486 29135 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.504735 29157 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.508029 29135 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.509373 29085 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.509419 29150 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.510154 29085 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.510205 29150 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.512545 29085 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:36.512565 29150 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.514842 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.536259 28725 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 0.
I20260709 13:10:36.519577 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.537345 28728 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.538625 28772 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:36.520004 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:36.539281 28772 ts_tablet_manager.cc:1403] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.083s	user 0.039s	sys 0.035s
I20260709 13:10:36.523268 28575 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:36.527046 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:36.532007 28977 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.532001 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:36.541320 28576 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.542455 28977 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.535390 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:10:36.545763 28695 leader_election.cc:343] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.546262 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:36.546866 28725 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.546562 28772 raft_consensus.cc:359] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.547587 28772 raft_consensus.cc:385] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.548017 28772 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.548878 28620 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:36.548954 28772 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.550595 29161 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.550982 29161 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.551332 29161 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.552304 28695 leader_election.cc:343] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.552783 28695 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:36.553524 28545 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:36.555768 29084 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.556247 29084 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.556582 29084 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.555819 28845 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.554468 28730 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
W20260709 13:10:36.559316 28546 leader_election.cc:343] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.559722 28772 ts_tablet_manager.cc:1434] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 13:10:36.560986 28772 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Bootstrap starting.
I20260709 13:10:36.561498 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:36.567270 28772 tablet_bootstrap.cc:654] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.576920 29161 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.580937 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:36.581835 29079 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.582461 29079 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:36.588807 29161 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.590894 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:36.591593 28721 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.592020 28770 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:36.592547 28770 ts_tablet_manager.cc:1403] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.145s	user 0.042s	sys 0.043s
I20260709 13:10:36.599112 28721 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:36.600382 28620 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:36.601217 28977 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.604687 28977 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:10:36.600741 28621 leader_election.cc:343] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.605764 28977 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.583518 29079 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.611490 28576 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.614845 28770 raft_consensus.cc:359] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.617624 28770 raft_consensus.cc:385] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.618000 28770 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.618568 29150 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.615911 28772 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: No bootstrap required, opened a new log
I20260709 13:10:36.619479 28772 ts_tablet_manager.cc:1403] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.017s
I20260709 13:10:36.620872 28725 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:36.618713 28770 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.619069 29150 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.624035 29084 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.626482 29150 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.626248 28772 raft_consensus.cc:359] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.627327 28772 raft_consensus.cc:385] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.627607 28772 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.628868 29084 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.629598 28772 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.630344 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:36.631361 29141 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.631309 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:36.631801 28772 ts_tablet_manager.cc:1434] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:10:36.631992 28656 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.631955 29141 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:36.647874 29141 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.637457 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.651573 28725 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.630580 28770 ts_tablet_manager.cc:1434] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:10:36.654955 28770 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:36.655536 29079 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:36.664881 28656 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:36.668565 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:36.669426 29084 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.672886 28770 tablet_bootstrap.cc:654] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.673344 28620 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:36.675778 29079 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.676159 29079 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.677191 29084 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:36.683621 29084 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.682582 29079 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.691968 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 84026.6us
I20260709 13:10:36.733069 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:36.733733 28728 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.743388 29181 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:10:36.786162 29079 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.787106 28728 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:10:36.790062 29079 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.791721 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:36.792411 28579 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.801299 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:36.802040 28581 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.806552 29141 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.807078 29141 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.810480 29141 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.810846 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.812279 28725 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.813714 28770 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:36.814301 28770 ts_tablet_manager.cc:1403] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.004s
I20260709 13:10:36.808801 28579 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:36.819907 28770 raft_consensus.cc:359] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.820791 28770 raft_consensus.cc:385] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.821079 28770 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.822484 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:36.821758 28770 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.823360 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:36.823987 28579 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.824195 29141 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.824970 29141 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:36.826102 29141 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.827543 28770 ts_tablet_manager.cc:1434] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:10:36.826794 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:36.828743 28977 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.829234 28977 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.829618 28977 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.842624 29079 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.842733 28977 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.843274 29079 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.845671 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:36.846207 28579 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.846873 29079 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.846881 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.847858 28725 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 0.
I20260709 13:10:36.855171 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:36.856912 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:36.858088 28728 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:36.857374 28621 leader_election.cc:343] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.862650 28977 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.862993 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:36.863871 28721 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.866091 28579 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:36.867660 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:36.868681 28977 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.869254 28977 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:36.869997 28977 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.879474 28581 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:36.884286 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:10:36.887774 28721 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
W20260709 13:10:36.889681 28621 consensus_peers.cc:597] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.889410 28578 raft_consensus.cc:2376] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1. Re-sending same reply.
I20260709 13:10:36.889205 28477 catalog_manager.cc:5697] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.885488 28770 tablet_bootstrap.cc:492] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:36.893183 28477 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.895424 28477 catalog_manager.cc:5697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.897362 28728 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:36.904342 28620 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:36.905586 29161 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:36.906144 29161 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.906802 29161 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.917879 28770 tablet_bootstrap.cc:654] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.923327 29161 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.928186 29161 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.928630 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:10:36.930105 28621 leader_election.cc:343] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:36.931746 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:36.932382 28721 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.939177 28770 tablet_bootstrap.cc:492] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:36.939739 28770 ts_tablet_manager.cc:1403] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.004s
I20260709 13:10:36.943698 28770 raft_consensus.cc:359] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.944402 28770 raft_consensus.cc:385] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.944686 28770 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.939122 28721 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:10:36.945457 28770 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.946409 28620 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:36.947155 29161 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.947520 28770 ts_tablet_manager.cc:1434] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:36.948532 29161 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:36.949429 29161 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.948508 28770 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:36.962595 28770 tablet_bootstrap.cc:654] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.963536 29135 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.963972 29135 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.966519 29135 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:36.966843 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:36.968307 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:36.970193 28721 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:10:36.971225 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:36.972064 28969 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:36.972366 29135 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.973917 28969 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:36.981220 28770 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:36.981844 28770 ts_tablet_manager.cc:1403] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.000s
I20260709 13:10:36.984891 29135 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:36.988385 28770 raft_consensus.cc:359] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.989326 28770 raft_consensus.cc:385] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.989665 28770 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.990378 28770 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:36.994556 28770 ts_tablet_manager.cc:1434] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:10:37.001104 28770 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: Bootstrap starting.
I20260709 13:10:37.000563 28476 catalog_manager.cc:5697] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.007896 28770 tablet_bootstrap.cc:654] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.062969 28977 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.064728 28977 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.066773 28977 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.067163 28770 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: No bootstrap required, opened a new log
I20260709 13:10:37.068735 28770 ts_tablet_manager.cc:1403] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.034s
I20260709 13:10:37.071774 28770 raft_consensus.cc:359] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:37.072508 28770 raft_consensus.cc:385] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.072803 28770 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.073513 28770 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:37.076092 28770 ts_tablet_manager.cc:1434] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:37.093675 28479 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.095901 28479 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.097584 28479 catalog_manager.cc:5697] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.102398 28575 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.105834 29150 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.155900 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:37.165779 29209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.165768 29206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.168078 29207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:37.174161 27432 server_base.cc:1061] running on GCE node
I20260709 13:10:37.175454 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:37.175688 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:37.175830 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602637175819 us; error 0 us; skew 500 ppm
I20260709 13:10:37.176537 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:37.181178 29135 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.182574 27432 webserver.cc:533] Webserver started at http://127.26.202.4:36447/ using document root <none> and password file <none>
I20260709 13:10:37.183419 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:37.183724 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:37.184170 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:37.185985 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-3-root/instance:
uuid: "d64d870625d6461b89b1fb75cd2e26e0"
format_stamp: "Formatted at 2026-07-09 13:10:37 on dist-test-slave-008w"
I20260709 13:10:37.192359 29150 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.199801 29084 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.216225 28977 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.241931 29135 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.242554 29135 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:37.246016 29135 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:37.247386 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:10:37.248939 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:10:37.249747 28730 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 1: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:10:37.250921 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.064s	user 0.010s	sys 0.023s
I20260709 13:10:37.252764 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:10:37.254164 29084 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.260643 29084 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:37.264458 28977 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.276250 29218 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.277447 27432 fs_manager.cc:730] Time spent opening block manager: real 0.023s	user 0.008s	sys 0.003s
I20260709 13:10:37.277999 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-3-root
uuid: "d64d870625d6461b89b1fb75cd2e26e0"
format_stamp: "Formatted at 2026-07-09 13:10:37 on dist-test-slave-008w"
I20260709 13:10:37.278625 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:37.289392 29078 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.295902 29078 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.323077 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:37.325215 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:37.330328 29078 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.346385 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:37.360526 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:37.360918 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:10:37.361320 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:37.361613 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.474200 28977 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:37.496984 29150 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:37.541112 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.4:38541
I20260709 13:10:37.541247 29286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.4:38541 every 8 connection(s)
I20260709 13:10:37.546970 27432 auto_leader_rebalancer-test.cc:384] add a tserver: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:37.561726 29287 heartbeater.cc:344] Connected to a master server at 127.26.202.62:36613
I20260709 13:10:37.562244 29287 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:37.563279 29287 heartbeater.cc:507] Master 127.26.202.62:36613 requested a full tablet report, sending...
I20260709 13:10:37.565407 28479 ts_manager.cc:194] Registered new tserver with Master: d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:10:37.567103 28479 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53932
I20260709 13:10:38.510538 28721 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:38.517195 28652 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.517206 28575 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.518936 29292 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.519881 29103 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.535468 28969 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.537828 28581 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:10:38.540658 28696 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb791c0c5eb14aff83f666f36ab82a30. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.542131 28652 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.557210 28476 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.570770 29287 heartbeater.cc:499] Master 127.26.202.62:36613 was elected leader, sending a full tablet report...
I20260709 13:10:38.581374 28655 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:38.597676 28581 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.601094 28730 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.603462 29161 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.611982 29078 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:10:38.643767 29161 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.648370 28575 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:10:38.650178 28622 consensus_peers.cc:597] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2a02df07d6643edb55e844cfc7fbe3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.659132 28730 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.668188 28478 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.686059 28575 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:38.696699 28730 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.699285 29291 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.704704 28652 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:38.708822 28547 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6003600bf2df4ecbaeff7fa53e044e91. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.709604 29291 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.717486 29291 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.721983 28721 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.724678 28652 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.736652 28652 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:38.739144 28476 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.775481 28730 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.775722 28575 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:38.776443 28622 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdc0b4abdc504f32a67b93235778cdbc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.777386 29078 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.778685 29306 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.788357 29308 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.790565 28581 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.790422 28730 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.810305 28478 catalog_manager.cc:5697] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:38.966450 29320 ts_tablet_manager.cc:933] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:38.969131 29320 tablet_copy_client.cc:323] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:38.986671 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet eb791c0c5eb14aff83f666f36ab82a30 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:38.987402 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet eb791c0c5eb14aff83f666f36ab82a30 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-eb791c0c5eb14aff83f666f36ab82a30
I20260709 13:10:39.000010 28740 tablet_copy_source_session.cc:215] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:39.004531 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb791c0c5eb14aff83f666f36ab82a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:39.011739 29323 ts_tablet_manager.cc:933] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:39.014019 29323 tablet_copy_client.cc:323] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:39.020283 29320 tablet_copy_client.cc:806] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:39.021173 29320 tablet_copy_client.cc:670] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:39.032786 29320 tablet_copy_client.cc:538] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:39.037668 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet f2a02df07d6643edb55e844cfc7fbe3e from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:39.038383 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet f2a02df07d6643edb55e844cfc7fbe3e from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-f2a02df07d6643edb55e844cfc7fbe3e
I20260709 13:10:39.045670 29320 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:39.046924 28666 tablet_copy_source_session.cc:215] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:39.051384 29323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a02df07d6643edb55e844cfc7fbe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:39.070046 29323 tablet_copy_client.cc:806] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:39.070693 29323 tablet_copy_client.cc:670] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:39.076361 29320 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.077644 29320 tablet_bootstrap.cc:492] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:39.078547 29323 tablet_copy_client.cc:538] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:39.078487 29320 ts_tablet_manager.cc:1403] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.009s
I20260709 13:10:39.082557 29320 raft_consensus.cc:359] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:39.083611 29320 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:39.084384 29320 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:39.087646 29320 ts_tablet_manager.cc:1434] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:39.090274 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-eb791c0c5eb14aff83f666f36ab82a30 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:39.090771 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-eb791c0c5eb14aff83f666f36ab82a30 on tablet eb791c0c5eb14aff83f666f36ab82a30 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:39.096318 29323 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:39.122188 29323 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.122967 29323 tablet_bootstrap.cc:492] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:39.123533 29323 ts_tablet_manager.cc:1403] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.014s
I20260709 13:10:39.125751 29323 raft_consensus.cc:359] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:39.126354 29323 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:39.126940 29323 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:39.128772 29323 ts_tablet_manager.cc:1434] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:10:39.130553 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-f2a02df07d6643edb55e844cfc7fbe3e received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:39.130985 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-f2a02df07d6643edb55e844cfc7fbe3e on tablet f2a02df07d6643edb55e844cfc7fbe3e with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:39.206961 29323 ts_tablet_manager.cc:933] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:10:39.208891 29323 tablet_copy_client.cc:323] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:10:39.220484 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet 6003600bf2df4ecbaeff7fa53e044e91 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:10:39.221158 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet 6003600bf2df4ecbaeff7fa53e044e91 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-6003600bf2df4ecbaeff7fa53e044e91
I20260709 13:10:39.228839 28591 tablet_copy_source_session.cc:215] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:39.231971 29323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6003600bf2df4ecbaeff7fa53e044e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:39.237890 29320 ts_tablet_manager.cc:933] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:39.239847 29320 tablet_copy_client.cc:323] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:39.241402 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet bdc0b4abdc504f32a67b93235778cdbc from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:39.241909 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet bdc0b4abdc504f32a67b93235778cdbc from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-bdc0b4abdc504f32a67b93235778cdbc
I20260709 13:10:39.249302 28666 tablet_copy_source_session.cc:215] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:39.250926 29323 tablet_copy_client.cc:806] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:39.251524 29323 tablet_copy_client.cc:670] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:39.254119 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc0b4abdc504f32a67b93235778cdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:39.256129 29323 tablet_copy_client.cc:538] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:39.266465 29323 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:39.273257 29320 tablet_copy_client.cc:806] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:39.273916 29320 tablet_copy_client.cc:670] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:39.279551 29320 tablet_copy_client.cc:538] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:39.292037 29320 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:39.343709 29320 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.344704 29320 tablet_bootstrap.cc:492] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:39.345428 29320 ts_tablet_manager.cc:1403] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.017s
I20260709 13:10:39.348385 29320 raft_consensus.cc:359] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:39.350874 29320 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:39.351563 29320 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:39.369392 29320 ts_tablet_manager.cc:1434] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:10:39.380123 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-bdc0b4abdc504f32a67b93235778cdbc received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:39.380627 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-bdc0b4abdc504f32a67b93235778cdbc on tablet bdc0b4abdc504f32a67b93235778cdbc with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:39.389456 29323 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.390452 29323 tablet_bootstrap.cc:492] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:39.391490 29323 ts_tablet_manager.cc:1403] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.125s	user 0.050s	sys 0.036s
I20260709 13:10:39.395153 29323 raft_consensus.cc:359] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:39.396024 29323 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:39.396678 29323 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:39.399022 29323 ts_tablet_manager.cc:1434] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:39.400939 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-6003600bf2df4ecbaeff7fa53e044e91 received from {username='slave'} at 127.0.0.1:54208
I20260709 13:10:39.401441 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-6003600bf2df4ecbaeff7fa53e044e91 on tablet 6003600bf2df4ecbaeff7fa53e044e91 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:39.512434 29260 raft_consensus.cc:1217] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:39.601398 29260 raft_consensus.cc:1217] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:39.765224 29260 raft_consensus.cc:1217] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:39.797942 29260 raft_consensus.cc:1217] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:39.984236 29161 raft_consensus.cc:1064] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:39.986855 29161 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:39.994685 29260 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.996730 29336 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:39.997954 28575 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.997123 28730 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.999394 29336 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.001240 29336 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.010004 29308 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.012110 28730 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.013188 28575 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.031644 29260 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.038616 28476 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.077262 29334 raft_consensus.cc:1064] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:40.078200 28652 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:40.079787 29334 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:40.083410 29260 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.085036 29308 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:40.086879 28730 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.091045 29336 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:40.093557 29161 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.096017 29259 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.102308 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2a02df07d6643edb55e844cfc7fbe3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:40.110153 28479 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.117847 28730 raft_consensus.cc:2955] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.132416 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet f2a02df07d6643edb55e844cfc7fbe3e with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:10:40.135116 29259 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.136750 28969 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.140895 28655 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.141963 28575 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.144032 29103 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.145085 28969 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.195362 29336 raft_consensus.cc:1064] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:40.201371 29336 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:40.210009 29345 tablet_replica.cc:333] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:10:40.211067 29345 raft_consensus.cc:2243] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.208527 29346 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.222247 28581 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.230196 29345 raft_consensus.cc:2272] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.233384 29308 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:40.239378 29345 ts_tablet_manager.cc:1916] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:40.241362 29260 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.216228 28575 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.268061 28478 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.270838 29259 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.271817 29345 ts_tablet_manager.cc:1929] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:40.272298 29345 log.cc:1199] T f2a02df07d6643edb55e844cfc7fbe3e P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/f2a02df07d6643edb55e844cfc7fbe3e
I20260709 13:10:40.272746 29306 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:40.275535 28721 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.281265 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet f2a02df07d6643edb55e844cfc7fbe3e (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:40.286936 28652 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.292594 28721 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:40.312266 29308 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.320171 29260 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.320300 29336 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.324007 28572 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.326681 29346 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:40.332695 29298 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:10:40.364322 28575 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.366228 29135 raft_consensus.cc:1064] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:40.366988 29298 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.368654 29135 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:40.371343 29260 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.388193 28478 catalog_manager.cc:5697] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.395210 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb791c0c5eb14aff83f666f36ab82a30 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:10:40.397545 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61835.5us
I20260709 13:10:40.397030 28479 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.415308 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet eb791c0c5eb14aff83f666f36ab82a30 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:10:40.417964 29360 tablet_replica.cc:333] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:10:40.419198 29360 raft_consensus.cc:2243] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.419981 29360 raft_consensus.cc:2272] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.423844 29360 ts_tablet_manager.cc:1916] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:40.423116 28725 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.436367 28730 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.438125 29357 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:40.442729 29260 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.443759 28581 raft_consensus.cc:2955] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.449966 28652 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:40.464876 29260 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.466822 29356 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:40.483783 28650 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:40.488523 29291 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.496516 29356 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.504266 29260 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.530498 29352 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:40.531929 28581 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.538817 29308 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:40.542999 28652 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.544423 29308 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.549731 29260 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.568849 28721 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.577466 29258 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.613709 28479 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.627971 28577 raft_consensus.cc:2955] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:40.628194 28478 catalog_manager.cc:5697] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:10:40.642670 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52596.6us
I20260709 13:10:40.659344 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bdc0b4abdc504f32a67b93235778cdbc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:40.661280 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet bdc0b4abdc504f32a67b93235778cdbc with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:10:40.673180 29366 tablet_replica.cc:333] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:10:40.674396 29366 raft_consensus.cc:2243] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.675541 29366 raft_consensus.cc:2272] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.690953 29360 ts_tablet_manager.cc:1929] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:40.691457 29360 log.cc:1199] T eb791c0c5eb14aff83f666f36ab82a30 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/eb791c0c5eb14aff83f666f36ab82a30
I20260709 13:10:40.692924 29366 ts_tablet_manager.cc:1916] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:40.703779 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet eb791c0c5eb14aff83f666f36ab82a30 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:40.710719 29366 ts_tablet_manager.cc:1929] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:40.711256 29366 log.cc:1199] T bdc0b4abdc504f32a67b93235778cdbc P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/bdc0b4abdc504f32a67b93235778cdbc
I20260709 13:10:40.713068 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet bdc0b4abdc504f32a67b93235778cdbc (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:41.164968 28577 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:41.174577 29258 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:41.174994 28650 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:41.176631 29357 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:41.177871 29291 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:41.194484 29291 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:41.200400 29258 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:41.208418 28650 raft_consensus.cc:2955] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:41.220183 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6003600bf2df4ecbaeff7fa53e044e91 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:41.234407 28479 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:41.257498 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet 6003600bf2df4ecbaeff7fa53e044e91 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:10:41.261524 29375 tablet_replica.cc:333] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:10:41.264789 29375 raft_consensus.cc:2243] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:41.265868 29375 raft_consensus.cc:2272] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:41.270493 29375 ts_tablet_manager.cc:1916] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:41.285147 29375 ts_tablet_manager.cc:1929] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:41.285562 29375 log.cc:1199] T 6003600bf2df4ecbaeff7fa53e044e91 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/6003600bf2df4ecbaeff7fa53e044e91
I20260709 13:10:41.287385 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet 6003600bf2df4ecbaeff7fa53e044e91 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:42.346783 28721 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:42.353343 28656 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:42.353768 28575 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:42.353911 28696 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9f7022e7f24efaa9b25cb129729504. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.354729 29349 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.356140 29369 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:42.365928 29349 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.369774 28656 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.378479 28575 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.391084 28477 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.394457 28655 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:10:42.419998 28622 consensus_peers.cc:597] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de05bba072764f32aeb479edb07a9d4b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.420163 28577 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:42.422072 29370 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:42.424983 28721 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:42.433426 29370 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.456120 29306 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.458937 28721 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.462692 28581 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.481412 28728 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:10:42.491910 28696 consensus_peers.cc:597] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55ea2a86b4ee4d399b9b439246c9d92a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.492960 28655 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:42.496469 28581 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:42.497237 29369 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.498045 28478 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.500115 29369 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.511714 29369 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.514605 28655 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.530468 28655 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:42.526748 28581 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.534844 28478 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:10:42.547458 28622 consensus_peers.cc:597] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 299a315de86c44c0a3613934339689e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.548623 28577 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:42.553726 29306 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:42.564586 28730 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:42.569043 29370 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.586561 29390 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.592724 28728 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.594726 28577 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.613376 28478 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:42.793690 29394 ts_tablet_manager.cc:933] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:42.795598 29394 tablet_copy_client.cc:323] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:42.797614 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 7c9f7022e7f24efaa9b25cb129729504 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:42.798110 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 7c9f7022e7f24efaa9b25cb129729504 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-7c9f7022e7f24efaa9b25cb129729504
I20260709 13:10:42.804782 28740 tablet_copy_source_session.cc:215] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:42.808053 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9f7022e7f24efaa9b25cb129729504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:42.820786 29394 tablet_copy_client.cc:806] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:42.821449 29394 tablet_copy_client.cc:670] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:42.825491 29394 tablet_copy_client.cc:538] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:42.835409 29394 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:42.860008 29394 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:42.860988 29394 tablet_bootstrap.cc:492] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:42.861788 29394 ts_tablet_manager.cc:1403] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.008s
I20260709 13:10:42.864971 29394 raft_consensus.cc:359] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:42.865852 29394 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:42.866801 29394 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:42.871519 29394 ts_tablet_manager.cc:1434] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:10:42.874068 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-7c9f7022e7f24efaa9b25cb129729504 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:42.874574 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-7c9f7022e7f24efaa9b25cb129729504 on tablet 7c9f7022e7f24efaa9b25cb129729504 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:42.883558 29394 ts_tablet_manager.cc:933] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:42.889901 29394 tablet_copy_client.cc:323] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:42.891945 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet de05bba072764f32aeb479edb07a9d4b from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:42.892532 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet de05bba072764f32aeb479edb07a9d4b from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-de05bba072764f32aeb479edb07a9d4b
I20260709 13:10:42.901947 28666 tablet_copy_source_session.cc:215] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:42.904991 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de05bba072764f32aeb479edb07a9d4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:42.924431 29394 tablet_copy_client.cc:806] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:42.925411 29394 tablet_copy_client.cc:670] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:42.929708 29394 tablet_copy_client.cc:538] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:42.938580 29394 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:42.957422 29394 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:42.958196 29394 tablet_bootstrap.cc:492] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:42.958760 29394 ts_tablet_manager.cc:1403] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.005s
I20260709 13:10:42.960983 29394 raft_consensus.cc:359] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:42.961697 29394 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:42.962221 29394 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:42.964491 29394 ts_tablet_manager.cc:1434] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:10:42.966768 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-de05bba072764f32aeb479edb07a9d4b received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:42.967252 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-de05bba072764f32aeb479edb07a9d4b on tablet de05bba072764f32aeb479edb07a9d4b with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:43.062309 29394 ts_tablet_manager.cc:933] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:43.063982 29394 tablet_copy_client.cc:323] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:43.065717 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 55ea2a86b4ee4d399b9b439246c9d92a from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:43.066270 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 55ea2a86b4ee4d399b9b439246c9d92a from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-55ea2a86b4ee4d399b9b439246c9d92a
I20260709 13:10:43.079717 28740 tablet_copy_source_session.cc:215] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:43.085246 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ea2a86b4ee4d399b9b439246c9d92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.102787 29394 tablet_copy_client.cc:806] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:43.103487 29394 tablet_copy_client.cc:670] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:43.107462 29394 tablet_copy_client.cc:538] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:43.116951 29394 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:43.145634 29394 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:43.146391 29394 tablet_bootstrap.cc:492] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:43.146929 29394 ts_tablet_manager.cc:1403] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.012s
I20260709 13:10:43.150920 29394 raft_consensus.cc:359] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:43.151793 29394 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:43.152366 29394 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:43.159067 29394 ts_tablet_manager.cc:1434] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:43.161278 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-55ea2a86b4ee4d399b9b439246c9d92a received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:43.161814 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-55ea2a86b4ee4d399b9b439246c9d92a on tablet 55ea2a86b4ee4d399b9b439246c9d92a with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:43.171259 29403 ts_tablet_manager.cc:933] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:43.178901 29403 tablet_copy_client.cc:323] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:43.180748 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet 299a315de86c44c0a3613934339689e4 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:43.181313 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet 299a315de86c44c0a3613934339689e4 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-299a315de86c44c0a3613934339689e4
I20260709 13:10:43.193058 28666 tablet_copy_source_session.cc:215] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:43.196455 29403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299a315de86c44c0a3613934339689e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.213635 29403 tablet_copy_client.cc:806] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:43.214262 29403 tablet_copy_client.cc:670] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:43.218106 29403 tablet_copy_client.cc:538] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:43.226503 29403 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:43.253588 29403 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:43.254685 29403 tablet_bootstrap.cc:492] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:43.256119 29403 ts_tablet_manager.cc:1403] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.030s	user 0.025s	sys 0.004s
I20260709 13:10:43.262116 29403 raft_consensus.cc:359] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:43.263130 29403 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:43.263829 29403 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:43.270188 29403 ts_tablet_manager.cc:1434] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:10:43.272794 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-299a315de86c44c0a3613934339689e4 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:43.273658 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-299a315de86c44c0a3613934339689e4 on tablet 299a315de86c44c0a3613934339689e4 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:43.277442 29258 raft_consensus.cc:1217] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:43.318001 29258 raft_consensus.cc:1217] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:43.625553 29258 raft_consensus.cc:1217] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:43.669931 29349 raft_consensus.cc:1064] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:43.672387 29349 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:43.682667 29258 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:43.686442 28575 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:43.686970 28656 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:43.689682 29369 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:43.691880 29258 raft_consensus.cc:1217] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:43.692821 29369 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:43.696358 29369 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:43.722923 28655 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.727335 28577 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.721937 29349 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.745520 28478 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.754565 29260 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.798496 29306 raft_consensus.cc:1064] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:43.801466 29306 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:43.810334 29260 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:43.810772 28728 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:43.812917 28575 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:43.817651 29406 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:43.819629 29406 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:43.822055 29406 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:43.825941 28728 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:43.835417 29258 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:43.837344 28578 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:43.839509 29349 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:43.846868 29369 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:43.851949 29409 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.854360 29258 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.866439 29306 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.869664 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c9f7022e7f24efaa9b25cb129729504 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:43.874132 28577 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.878392 28479 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.879108 29260 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.893319 28476 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:43.895614 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 44983.6us
I20260709 13:10:43.899824 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c9f7022e7f24efaa9b25cb129729504 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:10:43.916867 28721 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.935083 28577 raft_consensus.cc:2955] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:43.947748 29422 tablet_replica.cc:333] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:10:43.948978 29422 raft_consensus.cc:2243] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:43.949756 29422 raft_consensus.cc:2272] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:43.954419 29422 ts_tablet_manager.cc:1916] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:43.975013 28655 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:43.976198 29422 ts_tablet_manager.cc:1929] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:43.976730 29422 log.cc:1199] T 7c9f7022e7f24efaa9b25cb129729504 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/7c9f7022e7f24efaa9b25cb129729504
I20260709 13:10:43.978760 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 7c9f7022e7f24efaa9b25cb129729504 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:43.982472 29260 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:43.984460 29406 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:43.994438 28721 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:43.997272 29306 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:44.006714 29391 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.013329 29260 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.020045 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de05bba072764f32aeb479edb07a9d4b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:44.022989 28721 raft_consensus.cc:2955] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.030341 28479 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.048437 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet de05bba072764f32aeb479edb07a9d4b with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:10:44.059842 29424 tablet_replica.cc:333] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:10:44.061297 29424 raft_consensus.cc:2243] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.062295 29424 raft_consensus.cc:2272] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.067934 29424 ts_tablet_manager.cc:1916] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:44.071535 29406 raft_consensus.cc:1064] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:44.082396 29406 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:44.099191 29424 ts_tablet_manager.cc:1929] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:44.099598 29260 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:44.099864 29424 log.cc:1199] T de05bba072764f32aeb479edb07a9d4b P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/de05bba072764f32aeb479edb07a9d4b
I20260709 13:10:44.101203 28730 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:44.101598 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet de05bba072764f32aeb479edb07a9d4b (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:44.102733 29406 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.103765 28572 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:44.103587 29306 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.105194 29391 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.122910 29391 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.131752 29260 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.136775 28721 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.150525 28575 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.152417 28479 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.154157 29423 raft_consensus.cc:1064] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:44.158332 29423 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:44.170614 28655 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:44.175918 29260 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:44.177726 29391 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:44.195796 28728 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:44.198715 29390 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:44.216512 29260 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:44.217062 29258 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.218729 29390 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.222877 29369 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.224257 28655 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:44.226207 28575 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:44.226450 29409 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.230850 28721 raft_consensus.cc:2955] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.238565 29409 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:44.242623 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 299a315de86c44c0a3613934339689e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:44.254258 29421 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.259860 28478 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.264477 28655 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.288036 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet 299a315de86c44c0a3613934339689e4 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:10:44.289250 29424 tablet_replica.cc:333] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:10:44.290336 29424 raft_consensus.cc:2243] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.289463 29260 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.291121 29424 raft_consensus.cc:2272] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.303846 29424 ts_tablet_manager.cc:1916] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:44.311815 28479 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.326412 29424 ts_tablet_manager.cc:1929] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:44.327034 29424 log.cc:1199] T 299a315de86c44c0a3613934339689e4 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/299a315de86c44c0a3613934339689e4
I20260709 13:10:44.337286 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet 299a315de86c44c0a3613934339689e4 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:44.351181 28578 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.371114 28721 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:44.393952 29260 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:44.396572 29409 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:44.403649 28969 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.405330 29260 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.413770 28577 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:44.418524 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55ea2a86b4ee4d399b9b439246c9d92a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:44.421550 28477 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.425069 29369 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:44.430433 28577 raft_consensus.cc:2955] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:44.434264 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 55ea2a86b4ee4d399b9b439246c9d92a with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:10:44.435767 29422 tablet_replica.cc:333] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:10:44.436896 29422 raft_consensus.cc:2243] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.437629 29422 raft_consensus.cc:2272] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.447405 29422 ts_tablet_manager.cc:1916] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:44.461516 29422 ts_tablet_manager.cc:1929] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:44.461813 29422 log.cc:1199] T 55ea2a86b4ee4d399b9b439246c9d92a P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/55ea2a86b4ee4d399b9b439246c9d92a
I20260709 13:10:44.463306 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 55ea2a86b4ee4d399b9b439246c9d92a (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:45.512192 28578 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:45.519811 28730 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:45.519901 28655 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:45.520411 28547 consensus_peers.cc:597] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8522d0aafd845c3b071def21aaaec24. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.521502 29402 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:45.522379 29434 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:45.533010 29434 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.534245 28721 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.535602 28655 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.554854 28478 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.561178 28730 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:45.570039 28655 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:45.570199 28696 consensus_peers.cc:597] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b445e2209eb343cf9d87aa63ba0becbc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.571159 28578 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:45.571587 29409 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:45.572564 29421 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:45.596984 29409 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.598769 28655 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.611034 28578 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.623369 28477 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.630878 28655 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:45.645452 28730 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:45.647019 28578 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:45.647259 28622 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd08c8d0651d4f21937f0b958dcaaba7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.648675 29433 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:45.656912 29406 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:45.733557 29452 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.740304 28572 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.747607 28721 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.766842 28479 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.773566 28578 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:10:45.788900 28547 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed9ebd651cf34b18b29911e247dc9834. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:45.789441 28652 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:45.788932 28721 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:45.791057 29402 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:45.792004 29436 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:45.809967 29439 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.812075 28655 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.812069 28728 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:45.829188 28479 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.950798 29458 ts_tablet_manager.cc:933] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:10:45.955056 29458 tablet_copy_client.cc:323] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:10:45.956938 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet a8522d0aafd845c3b071def21aaaec24 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:10:45.957538 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet a8522d0aafd845c3b071def21aaaec24 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-a8522d0aafd845c3b071def21aaaec24
I20260709 13:10:45.964188 28591 tablet_copy_source_session.cc:215] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:45.967309 29458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8522d0aafd845c3b071def21aaaec24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:45.980130 29458 tablet_copy_client.cc:806] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:45.980726 29458 tablet_copy_client.cc:670] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:45.984501 29458 tablet_copy_client.cc:538] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:45.993326 29458 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:46.019455 29458 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.020372 29458 tablet_bootstrap.cc:492] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:46.021071 29461 ts_tablet_manager.cc:933] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:46.021350 29458 ts_tablet_manager.cc:1403] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.012s
I20260709 13:10:46.025446 29458 raft_consensus.cc:359] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:46.027076 29458 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:46.027940 29458 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:46.033309 29458 ts_tablet_manager.cc:1434] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:10:46.034128 29461 tablet_copy_client.cc:323] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:46.035430 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-a8522d0aafd845c3b071def21aaaec24 received from {username='slave'} at 127.0.0.1:54208
I20260709 13:10:46.035899 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-a8522d0aafd845c3b071def21aaaec24 on tablet a8522d0aafd845c3b071def21aaaec24 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:46.036190 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet b445e2209eb343cf9d87aa63ba0becbc from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:46.036783 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet b445e2209eb343cf9d87aa63ba0becbc from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-b445e2209eb343cf9d87aa63ba0becbc
I20260709 13:10:46.048569 28740 tablet_copy_source_session.cc:215] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:46.052356 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b445e2209eb343cf9d87aa63ba0becbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.070395 29461 tablet_copy_client.cc:806] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:46.071118 29461 tablet_copy_client.cc:670] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:46.075145 29461 tablet_copy_client.cc:538] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:46.083256 29461 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:46.110044 29461 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.110780 29461 tablet_bootstrap.cc:492] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:46.111337 29461 ts_tablet_manager.cc:1403] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.008s
I20260709 13:10:46.113503 29461 raft_consensus.cc:359] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:46.114130 29461 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:46.114622 29461 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:46.116755 29461 ts_tablet_manager.cc:1434] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:46.120558 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-b445e2209eb343cf9d87aa63ba0becbc received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:46.120994 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-b445e2209eb343cf9d87aa63ba0becbc on tablet b445e2209eb343cf9d87aa63ba0becbc with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:46.224695 29461 ts_tablet_manager.cc:933] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:46.228097 29461 tablet_copy_client.cc:323] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:46.229897 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet bd08c8d0651d4f21937f0b958dcaaba7 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:46.230626 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet bd08c8d0651d4f21937f0b958dcaaba7 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-bd08c8d0651d4f21937f0b958dcaaba7
I20260709 13:10:46.238935 28666 tablet_copy_source_session.cc:215] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:46.242312 29461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd08c8d0651d4f21937f0b958dcaaba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.261384 29461 tablet_copy_client.cc:806] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:46.263353 29461 tablet_copy_client.cc:670] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:46.277148 29461 tablet_copy_client.cc:538] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:46.288426 29461 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:46.296228 29458 ts_tablet_manager.cc:933] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:10:46.317538 29461 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.318529 29461 tablet_bootstrap.cc:492] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:46.319250 29461 ts_tablet_manager.cc:1403] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.008s
I20260709 13:10:46.321411 29458 tablet_copy_client.cc:323] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:10:46.322211 29461 raft_consensus.cc:359] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:46.323004 29461 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:46.323269 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet ed9ebd651cf34b18b29911e247dc9834 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:10:46.323813 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet ed9ebd651cf34b18b29911e247dc9834 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-ed9ebd651cf34b18b29911e247dc9834
I20260709 13:10:46.323729 29461 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:46.326666 29461 ts_tablet_manager.cc:1434] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:10:46.328433 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-bd08c8d0651d4f21937f0b958dcaaba7 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:46.328850 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-bd08c8d0651d4f21937f0b958dcaaba7 on tablet bd08c8d0651d4f21937f0b958dcaaba7 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:46.335880 28591 tablet_copy_source_session.cc:215] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:46.339845 29458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9ebd651cf34b18b29911e247dc9834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:46.356935 29458 tablet_copy_client.cc:806] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:46.357645 29458 tablet_copy_client.cc:670] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:46.361526 29458 tablet_copy_client.cc:538] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:46.375970 29458 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:46.396550 29458 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:46.397605 29458 tablet_bootstrap.cc:492] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:46.398350 29458 ts_tablet_manager.cc:1403] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.003s
I20260709 13:10:46.401309 29458 raft_consensus.cc:359] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:46.402187 29458 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:46.402837 29458 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:46.408562 29458 ts_tablet_manager.cc:1434] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:46.410530 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-ed9ebd651cf34b18b29911e247dc9834 received from {username='slave'} at 127.0.0.1:54208
I20260709 13:10:46.411042 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-ed9ebd651cf34b18b29911e247dc9834 on tablet ed9ebd651cf34b18b29911e247dc9834 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:46.465305 29260 raft_consensus.cc:1217] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:46.491739 29260 raft_consensus.cc:1217] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:46.630998 29258 raft_consensus.cc:1217] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:46.795828 29258 raft_consensus.cc:1217] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:46.846444 29402 raft_consensus.cc:1064] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:46.849817 29402 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:46.856900 29258 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:46.857554 28728 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:46.858351 29436 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:46.859558 29439 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:46.871031 28655 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:46.875155 29439 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:46.877163 29402 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:46.879062 29258 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:46.885802 28655 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:46.890617 28728 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:46.922407 28479 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:46.933756 29421 raft_consensus.cc:1064] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:46.937816 29421 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:46.992586 29258 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:46.994733 29479 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:46.997802 28578 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:46.998720 28655 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:47.000881 29481 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:47.004756 29481 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.019130 29421 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.032866 28578 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.030454 28655 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.040261 29258 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.044515 28478 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.081868 28728 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:47.090989 29258 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:47.091332 28655 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:47.092908 29421 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:47.094177 29480 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:47.110615 29480 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.112861 29258 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.114063 28652 raft_consensus.cc:2955] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.132623 28478 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.134311 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b445e2209eb343cf9d87aa63ba0becbc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:47.144300 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet b445e2209eb343cf9d87aa63ba0becbc with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:10:47.162539 29486 tablet_replica.cc:333] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:10:47.164510 29486 raft_consensus.cc:2243] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.166814 29486 raft_consensus.cc:2272] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.170140 29452 raft_consensus.cc:1064] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:47.170588 29486 ts_tablet_manager.cc:1916] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:47.175477 29452 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:47.184041 29258 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:47.185804 29433 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.187256 28728 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:47.188670 28578 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:47.189415 29486 ts_tablet_manager.cc:1929] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:47.190382 29486 log.cc:1199] T b445e2209eb343cf9d87aa63ba0becbc P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/b445e2209eb343cf9d87aa63ba0becbc
I20260709 13:10:47.190083 29487 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.191047 29433 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.192020 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet b445e2209eb343cf9d87aa63ba0becbc (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:47.234655 29487 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.236280 29258 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.254648 28479 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.280330 29402 raft_consensus.cc:1064] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:47.281213 28572 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.284690 29402 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:47.305094 28656 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:47.309825 28728 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.335500 28572 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:47.337373 29493 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:47.338449 28730 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:47.341291 29258 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:47.342964 29493 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:47.349208 29439 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:47.358899 29492 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.367128 29260 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:47.370496 28572 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.372983 29259 raft_consensus.cc:2955] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.385108 28652 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:47.398927 29436 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.401249 29439 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.408151 28476 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.421339 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet bd08c8d0651d4f21937f0b958dcaaba7 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:10:47.443073 29498 tablet_replica.cc:333] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:10:47.452126 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd08c8d0651d4f21937f0b958dcaaba7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:47.444461 29498 raft_consensus.cc:2243] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.457728 29498 raft_consensus.cc:2272] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.467329 29473 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.472270 29498 ts_tablet_manager.cc:1916] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:47.471786 28656 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.489759 28728 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.498288 28578 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:47.501873 29498 ts_tablet_manager.cc:1929] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:47.502388 29498 log.cc:1199] T bd08c8d0651d4f21937f0b958dcaaba7 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/bd08c8d0651d4f21937f0b958dcaaba7
I20260709 13:10:47.504166 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet bd08c8d0651d4f21937f0b958dcaaba7 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:47.505244 29260 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:47.510589 29439 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:47.508500 28478 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.523569 29436 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.537680 29260 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.547034 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8522d0aafd845c3b071def21aaaec24 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:47.550418 29258 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.562255 28656 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:47.566500 29501 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:47.574332 28656 raft_consensus.cc:2955] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.584429 28479 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.600736 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet a8522d0aafd845c3b071def21aaaec24 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:10:47.601893 29498 tablet_replica.cc:333] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:10:47.603009 29498 raft_consensus.cc:2243] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.603057 28572 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:47.603902 29498 raft_consensus.cc:2272] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.607120 29498 ts_tablet_manager.cc:1916] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:47.611785 29260 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:47.612666 28728 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:47.614334 29473 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:47.616549 29473 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:10:47.629860 29436 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.631585 28728 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.638857 29260 raft_consensus.cc:2955] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.646971 29498 ts_tablet_manager.cc:1929] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:47.648151 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ed9ebd651cf34b18b29911e247dc9834 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:47.649540 29498 log.cc:1199] T a8522d0aafd845c3b071def21aaaec24 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/a8522d0aafd845c3b071def21aaaec24
I20260709 13:10:47.652166 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet a8522d0aafd845c3b071def21aaaec24 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:47.656248 28479 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:47.670575 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet ed9ebd651cf34b18b29911e247dc9834 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:10:47.672118 29502 tablet_replica.cc:333] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:10:47.673211 29502 raft_consensus.cc:2243] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.674072 29502 raft_consensus.cc:2272] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.677228 29502 ts_tablet_manager.cc:1916] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:47.688426 29502 ts_tablet_manager.cc:1929] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:47.688799 29502 log.cc:1199] T ed9ebd651cf34b18b29911e247dc9834 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/ed9ebd651cf34b18b29911e247dc9834
I20260709 13:10:47.690467 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet ed9ebd651cf34b18b29911e247dc9834 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:48.744841 28655 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:48.752380 28728 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:48.752508 28577 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:48.753831 28622 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 220dd03eba974f23a47374679c6d2fb7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.753952 29492 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.760470 29505 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.765499 29492 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.770316 28577 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.775043 28728 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.782193 28655 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:48.787274 28476 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.791918 28578 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:48.792743 28622 consensus_peers.cc:597] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b051a542445141ae99fc26201430f3ae. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.794188 29507 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.797729 28728 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:48.799319 29507 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.810891 29492 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.813472 28577 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.819953 28728 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.824937 28721 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:10:48.833248 28696 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fc836b2fe6541889bfb8d09a2bc3d2c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.835489 28655 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:48.836109 28577 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:48.837795 29421 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.838629 29480 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.849429 28479 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.862316 29480 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.868937 28655 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.873661 28577 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.881357 28728 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:48.892534 28476 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.931978 28577 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:48.936441 28696 consensus_peers.cc:597] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 908e88869b314709ad606ff91b8da799. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.939780 28655 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:48.940052 29480 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.945693 29520 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.953806 29520 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.955488 28577 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.959854 28655 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:48.976589 28479 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:49.197839 29525 ts_tablet_manager.cc:933] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:49.199743 29525 tablet_copy_client.cc:323] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:49.201525 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet b051a542445141ae99fc26201430f3ae from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:49.202170 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet b051a542445141ae99fc26201430f3ae from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-b051a542445141ae99fc26201430f3ae
I20260709 13:10:49.211323 28666 tablet_copy_source_session.cc:215] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:49.214259 29525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b051a542445141ae99fc26201430f3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.234000 29525 tablet_copy_client.cc:806] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:49.234690 29525 tablet_copy_client.cc:670] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:49.241962 29525 tablet_copy_client.cc:538] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:49.251401 29525 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:49.274852 29525 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:49.276137 29525 tablet_bootstrap.cc:492] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:49.277312 29525 ts_tablet_manager.cc:1403] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.016s
I20260709 13:10:49.280586 29525 raft_consensus.cc:359] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:49.281829 29525 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:49.282555 29525 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:49.286290 29525 ts_tablet_manager.cc:1434] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:10:49.288707 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-b051a542445141ae99fc26201430f3ae received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:49.289201 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-b051a542445141ae99fc26201430f3ae on tablet b051a542445141ae99fc26201430f3ae with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:49.340142 29525 ts_tablet_manager.cc:933] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:49.341770 29525 tablet_copy_client.cc:323] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:49.343515 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet 220dd03eba974f23a47374679c6d2fb7 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:49.344056 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet 220dd03eba974f23a47374679c6d2fb7 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-220dd03eba974f23a47374679c6d2fb7
I20260709 13:10:49.351364 29530 ts_tablet_manager.cc:933] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:49.352053 28666 tablet_copy_source_session.cc:215] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:49.353704 29530 tablet_copy_client.cc:323] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:49.355391 29525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220dd03eba974f23a47374679c6d2fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.355722 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 908e88869b314709ad606ff91b8da799 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:49.356287 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 908e88869b314709ad606ff91b8da799 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-908e88869b314709ad606ff91b8da799
I20260709 13:10:49.364579 28740 tablet_copy_source_session.cc:215] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:49.380227 29525 tablet_copy_client.cc:806] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:49.381023 29525 tablet_copy_client.cc:670] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:49.386763 29525 tablet_copy_client.cc:538] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:49.386785 29532 ts_tablet_manager.cc:933] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:49.404661 29525 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:49.416213 29532 tablet_copy_client.cc:323] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:49.417623 29530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908e88869b314709ad606ff91b8da799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.418089 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:49.418635 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 1fc836b2fe6541889bfb8d09a2bc3d2c from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-1fc836b2fe6541889bfb8d09a2bc3d2c
I20260709 13:10:49.430809 28740 tablet_copy_source_session.cc:215] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:49.434257 29532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:49.454735 29532 tablet_copy_client.cc:806] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:49.455405 29532 tablet_copy_client.cc:670] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:49.459496 29532 tablet_copy_client.cc:538] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:49.463817 29525 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:49.464916 29525 tablet_bootstrap.cc:492] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:49.465791 29525 ts_tablet_manager.cc:1403] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.014s
I20260709 13:10:49.469177 29525 raft_consensus.cc:359] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:49.470201 29525 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:49.471267 29532 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:49.470960 29525 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:49.482625 29525 ts_tablet_manager.cc:1434] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:49.491525 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-220dd03eba974f23a47374679c6d2fb7 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:49.492193 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-220dd03eba974f23a47374679c6d2fb7 on tablet 220dd03eba974f23a47374679c6d2fb7 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:49.500368 29530 tablet_copy_client.cc:806] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:49.501068 29530 tablet_copy_client.cc:670] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:49.505313 29530 tablet_copy_client.cc:538] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:49.511930 29532 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:49.512967 29532 tablet_bootstrap.cc:492] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:49.513744 29532 ts_tablet_manager.cc:1403] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.003s
I20260709 13:10:49.517129 29532 raft_consensus.cc:359] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:49.517758 29532 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:49.518287 29532 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:49.521162 29532 ts_tablet_manager.cc:1434] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:49.522862 29530 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:49.523190 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-1fc836b2fe6541889bfb8d09a2bc3d2c received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:49.523659 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-1fc836b2fe6541889bfb8d09a2bc3d2c on tablet 1fc836b2fe6541889bfb8d09a2bc3d2c with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:49.545732 29530 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:49.546602 29530 tablet_bootstrap.cc:492] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:49.547258 29530 ts_tablet_manager.cc:1403] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.005s
I20260709 13:10:49.549819 29530 raft_consensus.cc:359] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:49.550674 29530 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:49.551250 29530 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:49.553875 29530 ts_tablet_manager.cc:1434] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:49.555734 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-908e88869b314709ad606ff91b8da799 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:49.556169 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-908e88869b314709ad606ff91b8da799 on tablet 908e88869b314709ad606ff91b8da799 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:49.749264 29258 raft_consensus.cc:1217] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:49.769097 29258 raft_consensus.cc:1217] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:49.943395 29258 raft_consensus.cc:1217] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:10:49.996603 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 64154.6us
I20260709 13:10:50.013916 29258 raft_consensus.cc:1217] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:50.148644 29520 raft_consensus.cc:1064] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:50.154181 29520 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:50.167042 28655 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.167819 29258 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.168329 28572 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.168465 29480 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.169241 29542 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.171051 29548 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.194603 29480 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.198094 28572 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.201745 28655 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.216961 29258 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.223388 28478 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.256096 28721 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:50.263628 29258 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:50.266353 28572 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:50.267881 29548 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:50.269984 29548 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:50.283176 29520 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.284467 29258 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.295921 28572 raft_consensus.cc:2955] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.305949 28476 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.319595 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:50.322780 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fc836b2fe6541889bfb8d09a2bc3d2c with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:10:50.331414 29557 tablet_replica.cc:333] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:10:50.333132 29557 raft_consensus.cc:2243] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.333837 29557 raft_consensus.cc:2272] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.338790 29557 ts_tablet_manager.cc:1916] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:50.357838 29557 ts_tablet_manager.cc:1929] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:50.358292 29557 log.cc:1199] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/1fc836b2fe6541889bfb8d09a2bc3d2c
I20260709 13:10:50.360082 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 1fc836b2fe6541889bfb8d09a2bc3d2c (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:50.374579 29537 raft_consensus.cc:1064] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:50.377595 29537 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:50.384979 28725 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.386639 28572 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.386709 29539 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:50.389767 29258 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.393158 29537 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:50.394930 29539 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.395562 29492 raft_consensus.cc:1064] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:50.398202 29492 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:50.417723 29258 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.416642 29538 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.421401 28728 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.422619 28725 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.426710 28572 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.427013 28577 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.431768 29539 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.433800 29539 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:50.438067 29507 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.447727 28476 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.455639 29542 raft_consensus.cc:1064] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:50.458235 29542 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:50.462724 29258 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.481602 28651 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:50.482146 29539 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.486809 28728 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.500801 28725 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:50.506933 29537 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:50.516134 29260 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.520428 29260 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.523392 28479 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.524557 29507 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.540541 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b051a542445141ae99fc26201430f3ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:50.547600 29259 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:50.552587 29507 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:50.561640 28651 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:50.572772 28577 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:50.574098 29538 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.580452 28476 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.518663 29480 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:10:50.574098 29259 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.575409 28572 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.607333 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet b051a542445141ae99fc26201430f3ae with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:10:50.614460 28730 raft_consensus.cc:2955] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.625453 29258 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:50.633102 29537 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:50.650898 29571 tablet_replica.cc:333] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:10:50.652436 29571 raft_consensus.cc:2243] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.653539 29571 raft_consensus.cc:2272] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.660290 29571 ts_tablet_manager.cc:1916] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:50.661783 29537 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.664534 28651 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.670527 28575 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:50.669735 29260 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.691633 29542 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:50.754738 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 58314.4us
I20260709 13:10:50.764272 29571 ts_tablet_manager.cc:1929] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:50.765694 29571 log.cc:1199] T b051a542445141ae99fc26201430f3ae P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/b051a542445141ae99fc26201430f3ae
I20260709 13:10:50.769066 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet b051a542445141ae99fc26201430f3ae (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:50.769861 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 220dd03eba974f23a47374679c6d2fb7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:50.773952 28476 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.784482 29520 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:50.787626 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet 220dd03eba974f23a47374679c6d2fb7 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:10:50.797370 28575 raft_consensus.cc:2955] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:50.953263 29574 tablet_replica.cc:333] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:10:50.988121 29574 raft_consensus.cc:2243] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.988960 29574 raft_consensus.cc:2272] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.995293 29574 ts_tablet_manager.cc:1916] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:50.996637 29520 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:51.024389 28574 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:51.026552 28653 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:51.038748 29260 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:51.042266 29574 ts_tablet_manager.cc:1929] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:51.042760 29574 log.cc:1199] T 220dd03eba974f23a47374679c6d2fb7 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/220dd03eba974f23a47374679c6d2fb7
I20260709 13:10:51.071341 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet 220dd03eba974f23a47374679c6d2fb7 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:51.120009 28479 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:10:51.190119 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 83327.8us
I20260709 13:10:51.196961 28725 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:51.204730 29260 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:51.204694 28575 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:51.209067 29568 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:51.210263 29572 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:51.239789 29480 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:51.248446 29257 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:51.253993 28575 raft_consensus.cc:2955] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:51.286578 28477 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:51.293920 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 908e88869b314709ad606ff91b8da799 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:51.331346 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 908e88869b314709ad606ff91b8da799 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:10:51.334936 29580 tablet_replica.cc:333] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:10:51.336349 29580 raft_consensus.cc:2243] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:51.337647 29580 raft_consensus.cc:2272] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:51.342855 29580 ts_tablet_manager.cc:1916] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:51.357873 29580 ts_tablet_manager.cc:1929] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:51.358486 29580 log.cc:1199] T 908e88869b314709ad606ff91b8da799 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/908e88869b314709ad606ff91b8da799
I20260709 13:10:51.360834 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 908e88869b314709ad606ff91b8da799 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:52.415752 28725 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:52.422168 28653 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:52.424141 28696 consensus_peers.cc:597] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c23648b5c68c4f9584b74b6a8ff47454. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.424913 28575 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:52.424746 29568 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.426831 29480 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:52.434909 29584 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.437490 28572 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.437258 28653 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.453500 28653 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:52.460156 28477 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.485623 28725 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:52.486233 28622 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fce221ba4bb64300a7d2ae39b8b95b77. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.487319 29563 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.488741 28572 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:52.490229 29563 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:52.498412 29563 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.505703 28725 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.516330 28721 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:52.507079 28572 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.543063 28476 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.559018 28575 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:52.559333 28696 consensus_peers.cc:597] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1404e4e726904b9da0d047a2f50142f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.559020 28653 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:52.562040 29568 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.563108 29583 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:52.577540 28653 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.577968 29480 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.577579 28572 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.598280 28477 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.614174 28653 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:10:52.623245 28622 consensus_peers.cc:597] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07a2389891a145aeb0c85e04f061855a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:52.625830 28724 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:52.627522 29507 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.629405 28572 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:52.631035 29507 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.641278 29563 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.648075 28724 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.646579 28572 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:52.663117 28479 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.814364 29601 ts_tablet_manager.cc:933] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:52.816450 29601 tablet_copy_client.cc:323] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:52.818405 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet c23648b5c68c4f9584b74b6a8ff47454 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:52.818929 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet c23648b5c68c4f9584b74b6a8ff47454 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-c23648b5c68c4f9584b74b6a8ff47454
I20260709 13:10:52.825500 28740 tablet_copy_source_session.cc:215] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:52.829769 29601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23648b5c68c4f9584b74b6a8ff47454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:52.844995 29601 tablet_copy_client.cc:806] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:52.845646 29601 tablet_copy_client.cc:670] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:52.851682 29601 tablet_copy_client.cc:538] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:52.860656 29601 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:52.882331 29601 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:52.883380 29601 tablet_bootstrap.cc:492] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:52.884104 29601 ts_tablet_manager.cc:1403] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.012s
I20260709 13:10:52.887290 29601 raft_consensus.cc:359] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:52.888136 29601 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:52.888788 29601 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:52.892338 29601 ts_tablet_manager.cc:1434] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:52.894479 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-c23648b5c68c4f9584b74b6a8ff47454 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:52.894909 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-c23648b5c68c4f9584b74b6a8ff47454 on tablet c23648b5c68c4f9584b74b6a8ff47454 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:52.944728 29601 ts_tablet_manager.cc:933] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:52.947007 29601 tablet_copy_client.cc:323] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:52.948794 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 1404e4e726904b9da0d047a2f50142f0 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:52.949440 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 1404e4e726904b9da0d047a2f50142f0 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-1404e4e726904b9da0d047a2f50142f0
I20260709 13:10:52.959673 28740 tablet_copy_source_session.cc:215] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:52.963052 29601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1404e4e726904b9da0d047a2f50142f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:52.967244 29606 ts_tablet_manager.cc:933] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:52.969399 29606 tablet_copy_client.cc:323] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:52.971792 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet fce221ba4bb64300a7d2ae39b8b95b77 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:52.972455 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet fce221ba4bb64300a7d2ae39b8b95b77 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-fce221ba4bb64300a7d2ae39b8b95b77
I20260709 13:10:52.977134 29601 tablet_copy_client.cc:806] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:52.977826 29601 tablet_copy_client.cc:670] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:52.983224 29601 tablet_copy_client.cc:538] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:52.985543 28666 tablet_copy_source_session.cc:215] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:52.990195 29606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce221ba4bb64300a7d2ae39b8b95b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:52.993337 29601 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:53.008157 29606 tablet_copy_client.cc:806] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:53.009074 29606 tablet_copy_client.cc:670] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:53.013692 29606 tablet_copy_client.cc:538] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:53.015321 29601 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:53.016573 29601 tablet_bootstrap.cc:492] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:53.017347 29601 ts_tablet_manager.cc:1403] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 13:10:53.020710 29601 raft_consensus.cc:359] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:53.021544 29601 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:53.022240 29601 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:53.024183 29606 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:53.025410 29601 ts_tablet_manager.cc:1434] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:10:53.032073 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-1404e4e726904b9da0d047a2f50142f0 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:53.032532 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-1404e4e726904b9da0d047a2f50142f0 on tablet 1404e4e726904b9da0d047a2f50142f0 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:53.053896 29606 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:53.054899 29606 tablet_bootstrap.cc:492] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:53.055595 29606 ts_tablet_manager.cc:1403] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.004s
I20260709 13:10:53.058538 29606 raft_consensus.cc:359] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:53.059351 29606 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:53.060032 29606 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:53.062391 29606 ts_tablet_manager.cc:1434] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:53.064563 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-fce221ba4bb64300a7d2ae39b8b95b77 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:53.065205 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-fce221ba4bb64300a7d2ae39b8b95b77 on tablet fce221ba4bb64300a7d2ae39b8b95b77 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:53.189237 29606 ts_tablet_manager.cc:933] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:53.191712 29606 tablet_copy_client.cc:323] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:53.193444 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet 07a2389891a145aeb0c85e04f061855a from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:53.193989 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet 07a2389891a145aeb0c85e04f061855a from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-07a2389891a145aeb0c85e04f061855a
I20260709 13:10:53.202013 28666 tablet_copy_source_session.cc:215] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:53.206646 29606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a2389891a145aeb0c85e04f061855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:53.234372 29260 raft_consensus.cc:1217] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:53.240906 29606 tablet_copy_client.cc:806] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:53.241662 29606 tablet_copy_client.cc:670] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:53.250300 29606 tablet_copy_client.cc:538] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:53.260532 29606 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:53.283574 29606 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:53.284608 29606 tablet_bootstrap.cc:492] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:53.285351 29606 ts_tablet_manager.cc:1403] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.025s	user 0.024s	sys 0.003s
I20260709 13:10:53.288733 29606 raft_consensus.cc:359] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:53.289762 29606 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:53.290473 29606 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:53.293367 29606 ts_tablet_manager.cc:1434] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:10:53.295162 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-07a2389891a145aeb0c85e04f061855a received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:53.295600 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-07a2389891a145aeb0c85e04f061855a on tablet 07a2389891a145aeb0c85e04f061855a with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:53.387619 29260 raft_consensus.cc:1217] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:53.553653 29257 raft_consensus.cc:1217] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:53.629520 29568 raft_consensus.cc:1064] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:53.631983 29568 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:53.638816 28653 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:53.639179 28575 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:53.639719 29257 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:53.640532 29583 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.642280 29480 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.644819 29480 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.668434 29568 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.669529 28653 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.677312 28581 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.693779 28477 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.690791 29257 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.752159 28724 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:53.760975 29257 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:53.763628 28653 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:53.763952 29613 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:53.771377 29480 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:53.774649 29613 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.778596 29260 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.785866 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c23648b5c68c4f9584b74b6a8ff47454 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:53.787098 28653 raft_consensus.cc:2955] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.799850 29259 raft_consensus.cc:1217] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:53.805725 28479 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.816754 29480 raft_consensus.cc:1064] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:53.819211 29480 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:53.819757 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet c23648b5c68c4f9584b74b6a8ff47454 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:10:53.843961 29622 tablet_replica.cc:333] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:10:53.847712 29622 raft_consensus.cc:2243] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:53.848636 29622 raft_consensus.cc:2272] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:53.852793 29260 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:53.853760 28581 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:53.854259 28653 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:53.857247 29613 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.858516 29622 ts_tablet_manager.cc:1916] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:53.859645 29568 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.865690 29583 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.906319 29622 ts_tablet_manager.cc:1929] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:53.906925 29622 log.cc:1199] T c23648b5c68c4f9584b74b6a8ff47454 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/c23648b5c68c4f9584b74b6a8ff47454
I20260709 13:10:53.908639 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet c23648b5c68c4f9584b74b6a8ff47454 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:53.910321 29480 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.913125 28651 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.917042 28581 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.925364 29260 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.939508 28479 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.969290 28724 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:53.974723 29260 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:53.975109 28653 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:53.976225 29480 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:53.978989 29625 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:53.989676 29480 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:53.994515 29259 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.015983 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1404e4e726904b9da0d047a2f50142f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:54.027961 28476 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.032456 29563 raft_consensus.cc:1064] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:54.035014 28653 raft_consensus.cc:2955] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.035231 29563 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:54.040750 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet 1404e4e726904b9da0d047a2f50142f0 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:10:54.042474 29622 tablet_replica.cc:333] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:10:54.043524 29622 raft_consensus.cc:2243] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.043947 29259 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:54.044225 29622 raft_consensus.cc:2272] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.049633 28581 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:54.051811 29594 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:54.052659 29622 ts_tablet_manager.cc:1916] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:54.055467 29618 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:54.059551 28730 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:54.063601 29563 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:54.126562 29618 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.130290 28572 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.135146 29260 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.141589 29622 ts_tablet_manager.cc:1929] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:54.142233 29622 log.cc:1199] T 1404e4e726904b9da0d047a2f50142f0 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/1404e4e726904b9da0d047a2f50142f0
I20260709 13:10:54.153728 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet 1404e4e726904b9da0d047a2f50142f0 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:54.155640 28477 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.190253 28653 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:54.193329 28730 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.197311 29260 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:54.198880 29563 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:54.200079 28581 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:54.201825 29618 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:54.209138 29633 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.214592 29260 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.229246 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fce221ba4bb64300a7d2ae39b8b95b77 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:54.220124 28572 raft_consensus.cc:2955] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.243346 28477 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.257051 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet fce221ba4bb64300a7d2ae39b8b95b77 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:10:54.259656 29634 tablet_replica.cc:333] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:10:54.260682 29634 raft_consensus.cc:2243] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.261427 29634 raft_consensus.cc:2272] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.266264 29634 ts_tablet_manager.cc:1916] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:54.282114 29634 ts_tablet_manager.cc:1929] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:54.282527 29634 log.cc:1199] T fce221ba4bb64300a7d2ae39b8b95b77 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/fce221ba4bb64300a7d2ae39b8b95b77
I20260709 13:10:54.284583 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet fce221ba4bb64300a7d2ae39b8b95b77 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:54.286172 29507 raft_consensus.cc:1064] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:54.288561 29507 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:54.294981 29260 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:54.295831 28728 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:54.296445 29618 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:54.297263 28581 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:54.299188 29594 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:54.300968 29563 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:54.335954 29594 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.338016 29259 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.342964 28572 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.353595 28477 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.357223 28728 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.397035 28653 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:54.411463 29259 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:54.412998 29563 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:54.416414 28572 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:54.417750 29507 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:54.429651 28581 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.427035 29563 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.438761 29259 raft_consensus.cc:2955] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.458220 28478 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:54.461171 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07a2389891a145aeb0c85e04f061855a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:54.475927 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet 07a2389891a145aeb0c85e04f061855a with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:10:54.477324 29634 tablet_replica.cc:333] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:10:54.478343 29634 raft_consensus.cc:2243] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.479153 29634 raft_consensus.cc:2272] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.484280 29634 ts_tablet_manager.cc:1916] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:54.499085 29634 ts_tablet_manager.cc:1929] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:54.499382 29634 log.cc:1199] T 07a2389891a145aeb0c85e04f061855a P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/07a2389891a145aeb0c85e04f061855a
I20260709 13:10:54.500702 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet 07a2389891a145aeb0c85e04f061855a (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:55.556026 28572 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:55.562561 28728 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:55.563820 28547 consensus_peers.cc:597] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8259ae9bad54fb1b2f26e7b813a8bd6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.563989 29643 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.565289 28651 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:55.566931 29643 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.571445 29581 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.574847 28728 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.582502 28653 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.599377 28478 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.621382 28651 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:55.641607 28728 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:55.642015 28622 consensus_peers.cc:597] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 788a727f92304a5a9926b2f15933af88. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.642361 28581 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:55.643038 29507 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.643834 29641 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.655014 29507 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.661664 28581 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.666232 28728 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.673830 28730 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:55.678385 28477 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:55.700945 28696 consensus_peers.cc:597] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fbdeb3c093d412b871d55add092cb37. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.702033 28651 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:55.703369 28572 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:55.703786 29480 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.706105 29639 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.712503 29657 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.714443 28651 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.715740 28581 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.729180 28730 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:55.733925 28478 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.744498 28653 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:55.744897 28581 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:55.745704 28696 consensus_peers.cc:597] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8877b0f244204425983fb5d505497cf3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.747066 29639 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.749171 29480 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:55.765600 29653 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.783397 28581 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.785624 28653 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:55.789443 28477 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:56.025700 29663 ts_tablet_manager.cc:933] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:10:56.056043 29663 tablet_copy_client.cc:323] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:10:56.058313 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet f8259ae9bad54fb1b2f26e7b813a8bd6 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:10:56.058903 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet f8259ae9bad54fb1b2f26e7b813a8bd6 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-f8259ae9bad54fb1b2f26e7b813a8bd6
I20260709 13:10:56.067734 28591 tablet_copy_source_session.cc:215] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:56.071118 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8259ae9bad54fb1b2f26e7b813a8bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.090494 29663 tablet_copy_client.cc:806] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:56.091216 29663 tablet_copy_client.cc:670] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:56.095938 29663 tablet_copy_client.cc:538] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:56.105932 29663 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:56.129603 29663 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:56.130928 29663 tablet_bootstrap.cc:492] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:56.131654 29663 ts_tablet_manager.cc:1403] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 13:10:56.135488 29663 raft_consensus.cc:359] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:56.136616 29663 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:56.137302 29663 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:56.147970 29667 ts_tablet_manager.cc:933] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:56.154124 29663 ts_tablet_manager.cc:1434] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 13:10:56.158288 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-f8259ae9bad54fb1b2f26e7b813a8bd6 received from {username='slave'} at 127.0.0.1:54208
I20260709 13:10:56.158814 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-f8259ae9bad54fb1b2f26e7b813a8bd6 on tablet f8259ae9bad54fb1b2f26e7b813a8bd6 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:56.163015 29667 tablet_copy_client.cc:323] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:56.165211 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 4fbdeb3c093d412b871d55add092cb37 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:56.165782 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 4fbdeb3c093d412b871d55add092cb37 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-4fbdeb3c093d412b871d55add092cb37
I20260709 13:10:56.174073 28740 tablet_copy_source_session.cc:215] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:56.178340 29667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fbdeb3c093d412b871d55add092cb37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.201875 29667 tablet_copy_client.cc:806] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:56.202597 29667 tablet_copy_client.cc:670] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:56.209275 29667 tablet_copy_client.cc:538] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:56.220916 29667 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:56.232926 29663 ts_tablet_manager.cc:933] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:56.235105 29663 tablet_copy_client.cc:323] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:10:56.238323 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet 788a727f92304a5a9926b2f15933af88 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:10:56.238955 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet 788a727f92304a5a9926b2f15933af88 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-788a727f92304a5a9926b2f15933af88
I20260709 13:10:56.242000 29667 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:56.242949 29667 tablet_bootstrap.cc:492] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:56.243594 29667 ts_tablet_manager.cc:1403] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.001s
I20260709 13:10:56.246945 29667 raft_consensus.cc:359] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:56.247851 29667 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:56.248590 29667 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:56.252202 29667 ts_tablet_manager.cc:1434] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:10:56.253587 29671 ts_tablet_manager.cc:933] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:56.255638 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-4fbdeb3c093d412b871d55add092cb37 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:56.256135 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-4fbdeb3c093d412b871d55add092cb37 on tablet 4fbdeb3c093d412b871d55add092cb37 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:56.258805 28666 tablet_copy_source_session.cc:215] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:56.269132 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788a727f92304a5a9926b2f15933af88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.275820 29671 tablet_copy_client.cc:323] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:56.277971 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 8877b0f244204425983fb5d505497cf3 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:56.278618 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 8877b0f244204425983fb5d505497cf3 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-8877b0f244204425983fb5d505497cf3
I20260709 13:10:56.286826 29663 tablet_copy_client.cc:806] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:56.287601 29663 tablet_copy_client.cc:670] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:56.287739 28740 tablet_copy_source_session.cc:215] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:56.291307 29663 tablet_copy_client.cc:538] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:56.294054 29671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8877b0f244204425983fb5d505497cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:56.301203 29663 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:56.344187 29671 tablet_copy_client.cc:806] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:56.344888 29671 tablet_copy_client.cc:670] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:56.350034 29671 tablet_copy_client.cc:538] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:56.351662 29663 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:56.352727 29663 tablet_bootstrap.cc:492] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:56.353504 29663 ts_tablet_manager.cc:1403] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.027s
I20260709 13:10:56.356678 29663 raft_consensus.cc:359] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:56.357455 29663 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:56.358175 29663 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:56.360852 29663 ts_tablet_manager.cc:1434] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:56.361497 29671 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:56.364339 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-788a727f92304a5a9926b2f15933af88 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:10:56.364777 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-788a727f92304a5a9926b2f15933af88 on tablet 788a727f92304a5a9926b2f15933af88 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:56.389911 29671 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:56.390878 29671 tablet_bootstrap.cc:492] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:56.391584 29671 ts_tablet_manager.cc:1403] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.001s
I20260709 13:10:56.394712 29671 raft_consensus.cc:359] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:56.395640 29671 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:56.396327 29671 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:56.398885 29671 ts_tablet_manager.cc:1434] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:56.400673 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-8877b0f244204425983fb5d505497cf3 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:56.401134 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-8877b0f244204425983fb5d505497cf3 on tablet 8877b0f244204425983fb5d505497cf3 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:56.616704 29260 raft_consensus.cc:1217] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:56.639375 29260 raft_consensus.cc:1217] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:56.699470 29260 raft_consensus.cc:1217] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:56.730479 29260 raft_consensus.cc:1217] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:57.035051 29675 raft_consensus.cc:1064] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:57.037712 29675 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.046514 29260 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.047549 28651 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.047829 28730 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.048182 29643 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:57.050176 29647 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.051957 29643 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.087481 29643 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.089187 28730 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.102207 29639 raft_consensus.cc:1064] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:57.101373 29259 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.104962 29639 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.115942 28478 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.116297 28655 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.161590 28655 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.161733 29259 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.163461 29480 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.167079 29653 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.177591 28575 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.179384 29657 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.198808 29688 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.200924 28581 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.210155 28572 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.218994 29639 raft_consensus.cc:1064] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:57.222512 29639 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.224412 29260 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:57.227530 29678 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:57.231284 29259 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.247048 29257 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.249128 28575 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.249377 29687 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:57.252139 29639 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.249372 28655 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.256189 29687 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.262069 28651 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.262900 28477 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.271559 28730 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:57.273445 29678 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:57.278931 29678 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.297297 28728 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.301241 28730 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.297448 29259 raft_consensus.cc:2955] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.317459 28651 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:57.317652 29258 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:57.319438 29480 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:57.320465 29687 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.323812 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8259ae9bad54fb1b2f26e7b813a8bd6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:57.327241 28479 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.328490 28651 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.330508 29688 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:57.348328 29639 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.353911 28653 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.359925 28581 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.363137 29640 raft_consensus.cc:1064] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:10:57.364276 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8877b0f244204425983fb5d505497cf3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:57.366811 29258 raft_consensus.cc:2955] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.375478 29640 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.377897 29255 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.392379 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet f8259ae9bad54fb1b2f26e7b813a8bd6 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:10:57.414554 28478 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.419781 28478 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.432046 28728 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.432070 28572 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.430743 29258 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:57.433934 29696 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:57.429634 29697 tablet_replica.cc:333] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:10:57.436738 29640 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.438287 29641 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.452191 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet 8877b0f244204425983fb5d505497cf3 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:10:57.465583 29697 raft_consensus.cc:2243] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.466543 29697 raft_consensus.cc:2272] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.472625 29697 ts_tablet_manager.cc:1916] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:57.476472 28730 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.486033 29258 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:57.484627 29701 tablet_replica.cc:333] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:10:57.488219 29480 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:57.502225 29653 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.504838 28575 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:57.504106 29259 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.510349 29701 raft_consensus.cc:2243] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.511209 29701 raft_consensus.cc:2272] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.516058 29701 ts_tablet_manager.cc:1916] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:57.527827 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fbdeb3c093d412b871d55add092cb37 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:57.527767 28478 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.527570 29641 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.539876 29687 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:57.541226 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fbdeb3c093d412b871d55add092cb37 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:10:57.548748 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.553926 28730 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.546763 28575 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.557456 28581 raft_consensus.cc:2955] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.548353 29697 ts_tablet_manager.cc:1929] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:57.566941 29697 log.cc:1199] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/f8259ae9bad54fb1b2f26e7b813a8bd6
I20260709 13:10:57.572190 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet f8259ae9bad54fb1b2f26e7b813a8bd6 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:57.576764 29701 ts_tablet_manager.cc:1929] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:57.583706 29259 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.579945 29697 tablet_replica.cc:333] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:10:57.590950 29701 log.cc:1199] T 8877b0f244204425983fb5d505497cf3 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/8877b0f244204425983fb5d505497cf3
I20260709 13:10:57.603870 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet 8877b0f244204425983fb5d505497cf3 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:57.592164 29697 raft_consensus.cc:2243] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.594436 28478 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.607888 29697 raft_consensus.cc:2272] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.620012 28653 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.625659 29697 ts_tablet_manager.cc:1916] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:57.630546 28575 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:57.630559 29259 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:57.632227 29640 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:57.633424 29641 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:57.644804 29507 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.654222 28575 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.659260 29259 raft_consensus.cc:2955] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:10:57.669561 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 788a727f92304a5a9926b2f15933af88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:57.660229 29697 ts_tablet_manager.cc:1929] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:57.670236 29697 log.cc:1199] T 4fbdeb3c093d412b871d55add092cb37 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/4fbdeb3c093d412b871d55add092cb37
I20260709 13:10:57.677892 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 4fbdeb3c093d412b871d55add092cb37 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:57.676447 28477 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.697072 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet 788a727f92304a5a9926b2f15933af88 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:10:57.708371 29705 tablet_replica.cc:333] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:10:57.709879 29705 raft_consensus.cc:2243] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.710500 29705 raft_consensus.cc:2272] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.714100 29705 ts_tablet_manager.cc:1916] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:57.721728 28730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:10:57.722591 28730 raft_consensus.cc:606] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:57.746376 29705 ts_tablet_manager.cc:1929] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:57.746970 29705 log.cc:1199] T 788a727f92304a5a9926b2f15933af88 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/788a727f92304a5a9926b2f15933af88
I20260709 13:10:57.749250 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet 788a727f92304a5a9926b2f15933af88 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:10:57.755676 28653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788a727f92304a5a9926b2f15933af88"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:57.756326 28653 raft_consensus.cc:606] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:57.759814 28655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:57.760376 28655 raft_consensus.cc:606] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:57.762789 28653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b051a542445141ae99fc26201430f3ae"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:57.763257 28653 raft_consensus.cc:606] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:57.766528 28653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:57.767092 28653 raft_consensus.cc:606] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:57.767117 29480 raft_consensus.cc:993] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:10:57.767740 29687 raft_consensus.cc:1081] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:10:57.769634 29259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:10:57.770192 29259 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.770524 29259 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.775951 28653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:57.776547 28653 raft_consensus.cc:606] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:57.777746 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:57.779184 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:57.777683 29259 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.782719 29259 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:57.783187 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:57.783918 28724 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.783783 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:57.784233 28724 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:57.784416 28575 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.785174 28724 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.786465 28724 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.792934 28575 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:10:57.794742 28724 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:10:57.796998 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:57.798035 29666 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.799284 29666 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:10:57.800086 29666 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.808663 28476 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.891880 29507 raft_consensus.cc:993] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:10:57.892364 29641 raft_consensus.cc:1081] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:10:57.893953 29259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46388
I20260709 13:10:57.894407 29259 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.894706 29259 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.899855 29259 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.902417 29259 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:10:57.903182 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:57.903530 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:57.903795 28581 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.904093 28653 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.904387 28653 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:57.905179 28653 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.906234 28653 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.909901 28581 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:10:57.911345 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:10:57.912293 28653 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:10:57.912392 29666 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.913022 29666 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:10:57.913769 29666 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.919013 29507 raft_consensus.cc:993] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:57.919492 29507 raft_consensus.cc:1081] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:57.921840 28581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:10:57.922510 28581 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.922868 28581 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.923003 28476 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.929504 28581 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:57.931694 28581 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:57.933086 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:57.933712 28724 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.934515 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:57.935086 28653 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.935357 28653 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:57.936023 28653 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:57.937155 28653 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.940317 28724 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:57.942663 28653 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:57.943243 28545 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:57.944144 29647 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.944605 29647 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:57.945385 29647 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:57.958475 28476 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.963246 29641 raft_consensus.cc:993] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:10:57.963804 29507 raft_consensus.cc:1081] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:10:57.965297 29259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b051a542445141ae99fc26201430f3ae"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46388
I20260709 13:10:57.965801 29259 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.966101 29259 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.970934 29259 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.972558 29259 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:57.973776 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:57.974341 28724 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.974474 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:57.975123 28653 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.975517 28653 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:57.976574 28653 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.977726 28653 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.981056 28724 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:10:57.982070 29223 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:57.982949 29666 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.983412 29666 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:10:57.983462 28653 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:10:57.984313 29666 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:57.993712 28476 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:58.128182 29641 raft_consensus.cc:993] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:58.128719 29641 raft_consensus.cc:1081] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:58.132319 28581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:10:58.132859 28581 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.133234 28581 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.138168 28581 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:58.140581 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:58.140908 28581 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:58.141233 28655 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:58.141590 28655 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:58.142257 28655 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:58.143466 28655 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.143388 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:58.144018 28724 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.149693 28655 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:58.149905 28724 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:58.150955 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:58.151824 29647 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:58.152318 29647 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:58.153546 29647 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:58.157080 29641 raft_consensus.cc:993] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:58.157732 29641 raft_consensus.cc:1081] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:58.161975 28581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "788a727f92304a5a9926b2f15933af88"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:10:58.162518 28581 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:58.162865 28581 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.165391 28476 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.169180 28581 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:58.170827 28581 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:10:58.171546 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:58.172123 28655 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:58.172457 28655 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:58.172441 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:10:58.173168 29255 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.173439 28655 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:58.174751 28655 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.180836 29255 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:58.181655 28655 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:58.182521 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:10:58.183539 29647 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:58.184022 29647 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:58.184828 29647 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:58.195402 28476 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.288918 28724 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.290392 29666 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.301044 28575 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.302505 29666 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.322667 28655 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.324148 29666 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.343982 28575 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.347211 29666 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.405766 28724 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.406978 29666 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.417476 28651 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.419201 29666 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:58.422457 28651 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.424176 29647 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.436473 28724 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.442045 29647 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.552589 28651 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.554148 29678 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.565032 28724 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.567670 29728 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.581799 28653 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.583241 29728 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.596405 29255 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:58.598404 29733 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.780432 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:58.782047 28724 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:58.791513 28653 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:58.793049 28575 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:58.793467 29480 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:58.795758 28696 consensus_peers.cc:597] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31c48009ac1c494fac1b2eb14ee5e90e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.801717 29722 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.805514 29724 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.807566 28653 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.820205 28581 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:58.822746 28478 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:58.827607 28724 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:58.829617 28651 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:10:58.829818 28547 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1d00e421d5e40fb93fa17b07c0e88a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.831229 29733 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.831920 29647 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.838938 28575 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.843464 29729 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.847733 28655 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.857430 28724 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.860790 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:58.902779 28728 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:58.927774 28655 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:58.929334 29722 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.934042 28653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:58.934643 28653 raft_consensus.cc:606] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:58.935091 28581 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:58.936623 28696 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a8a47d75d1241b7acc3796f628c9196. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.941196 28724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:10:58.941833 28724 raft_consensus.cc:606] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:10:58.941937 28478 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.944413 29480 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.950145 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:58.950711 28656 raft_consensus.cc:606] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:58.956585 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:58.957080 28656 raft_consensus.cc:606] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:10:58.960788 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:10:58.961347 28656 raft_consensus.cc:606] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:58.964603 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:58.966245 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:58.970810 29480 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.973219 28581 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.974560 28655 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:58.983821 28575 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:58.986848 28477 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:59.001902 28547 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ed00f783ec545f7a156d77cd9062498. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:59.004922 28728 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:59.005681 28655 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:59.013188 29729 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.014434 29647 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.028432 29507 raft_consensus.cc:993] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:59.028900 29507 raft_consensus.cc:1081] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:59.030597 28575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:10:59.030395 29729 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:59.032438 28724 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:59.036456 28575 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.036967 28575 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.046242 28575 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.053853 28655 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:59.057963 28479 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:10:59.057973 29641 raft_consensus.cc:993] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:59.076274 29641 raft_consensus.cc:1081] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:59.077286 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:59.077877 28656 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.078161 28656 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:59.078222 28575 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:59.078959 28656 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.080112 28656 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.082289 29722 raft_consensus.cc:993] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:10:59.082791 29722 raft_consensus.cc:1081] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:10:59.082841 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:59.083643 28728 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.085246 28653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50992
I20260709 13:10:59.085844 28653 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.086179 28653 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.089454 28656 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:59.093591 28728 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:59.096439 28653 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.098024 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:59.098798 28575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:10:59.099334 28575 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.099663 28575 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.100188 29647 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.105993 28575 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.108659 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:10:59.111328 29647 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:59.111807 28578 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.112845 28575 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:59.115816 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:59.116355 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:59.116894 28728 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.117220 28728 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:10:59.117913 28728 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.118916 28728 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.118824 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:59.119480 28730 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.120760 29647 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.116384 28651 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.125427 28728 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:10:59.125726 28651 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:59.100284 28653 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:59.127365 28651 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.129144 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:59.130051 28651 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.130098 29641 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.130641 29641 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:59.131335 29641 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.135752 28477 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.136786 28730 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:59.139636 28578 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:10:59.144071 28651 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:59.145260 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:10:59.146086 29729 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.146564 29729 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:59.147399 29729 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.173437 28477 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.174755 29507 raft_consensus.cc:993] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:59.175182 29507 raft_consensus.cc:1081] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:10:59.176694 28578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:10:59.177225 28578 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.177552 28578 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.172163 28478 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.184181 28578 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.186379 28578 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:59.187738 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:59.188309 28724 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.190776 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:59.191358 28653 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.191648 28653 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:59.192394 28653 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.193580 28653 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.195372 28724 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:59.196592 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:10:59.197381 29729 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.197826 29729 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:10:59.198623 29729 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:10:59.199589 28653 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:10:59.211506 28478 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.233265 29750 ts_tablet_manager.cc:933] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:10:59.235656 29750 tablet_copy_client.cc:323] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:10:59.237495 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet e1d00e421d5e40fb93fa17b07c0e88a3 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:10:59.238061 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet e1d00e421d5e40fb93fa17b07c0e88a3 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-e1d00e421d5e40fb93fa17b07c0e88a3
I20260709 13:10:59.243271 28591 tablet_copy_source_session.cc:215] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:59.246438 29750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d00e421d5e40fb93fa17b07c0e88a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.262552 29750 tablet_copy_client.cc:806] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:59.263226 29750 tablet_copy_client.cc:670] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:59.269413 29750 tablet_copy_client.cc:538] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:59.279341 29750 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:59.306625 29750 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:59.307576 29750 tablet_bootstrap.cc:492] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:59.308234 29750 ts_tablet_manager.cc:1403] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.011s
I20260709 13:10:59.311213 29750 raft_consensus.cc:359] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:59.312089 29750 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:59.312827 29750 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:59.313990 29753 ts_tablet_manager.cc:933] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:59.315934 29750 ts_tablet_manager.cc:1434] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:10:59.318162 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-e1d00e421d5e40fb93fa17b07c0e88a3 received from {username='slave'} at 127.0.0.1:54208
I20260709 13:10:59.318619 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-e1d00e421d5e40fb93fa17b07c0e88a3 on tablet e1d00e421d5e40fb93fa17b07c0e88a3 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:59.320709 29753 tablet_copy_client.cc:323] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:59.322474 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 31c48009ac1c494fac1b2eb14ee5e90e from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:59.322999 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 31c48009ac1c494fac1b2eb14ee5e90e from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-31c48009ac1c494fac1b2eb14ee5e90e
I20260709 13:10:59.332504 29750 ts_tablet_manager.cc:933] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:59.341802 28740 tablet_copy_source_session.cc:215] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:59.345542 29753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c48009ac1c494fac1b2eb14ee5e90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.363124 29750 tablet_copy_client.cc:323] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:10:59.364825 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 8a8a47d75d1241b7acc3796f628c9196 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:10:59.365341 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 8a8a47d75d1241b7acc3796f628c9196 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-8a8a47d75d1241b7acc3796f628c9196
I20260709 13:10:59.375192 29753 tablet_copy_client.cc:806] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:59.377168 28740 tablet_copy_source_session.cc:215] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:59.378458 29753 tablet_copy_client.cc:670] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:59.382968 29753 tablet_copy_client.cc:538] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:59.384969 29750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8a47d75d1241b7acc3796f628c9196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.395854 29753 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:59.404763 29750 tablet_copy_client.cc:806] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:59.405508 29750 tablet_copy_client.cc:670] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:59.410180 29750 tablet_copy_client.cc:538] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:59.425238 29750 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:59.425384 29753 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:59.426290 29753 tablet_bootstrap.cc:492] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:59.427003 29753 ts_tablet_manager.cc:1403] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.009s
I20260709 13:10:59.435779 29753 raft_consensus.cc:359] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:59.436636 29753 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:59.437331 29753 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:59.439875 29753 ts_tablet_manager.cc:1434] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:59.453365 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-31c48009ac1c494fac1b2eb14ee5e90e received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:59.453859 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-31c48009ac1c494fac1b2eb14ee5e90e on tablet 31c48009ac1c494fac1b2eb14ee5e90e with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:59.456378 29757 ts_tablet_manager.cc:933] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:10:59.462504 29640 raft_consensus.cc:993] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:10:59.463088 29640 raft_consensus.cc:1081] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:10:59.465777 29259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46388
I20260709 13:10:59.466341 29259 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.466704 29259 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.471176 29750 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:59.474428 29750 tablet_bootstrap.cc:492] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:59.475188 29750 ts_tablet_manager.cc:1403] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.051s	user 0.027s	sys 0.007s
I20260709 13:10:59.477103 29259 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:59.478691 29750 raft_consensus.cc:359] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:59.480166 29750 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:59.481305 29750 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:59.482189 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:10:59.482926 28653 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:59.483238 28653 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:10:59.484068 28653 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:59.484773 29750 ts_tablet_manager.cc:1434] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:59.487018 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-8a8a47d75d1241b7acc3796f628c9196 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:10:59.487476 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-8a8a47d75d1241b7acc3796f628c9196 on tablet 8a8a47d75d1241b7acc3796f628c9196 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:59.494417 28653 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.505420 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:10:59.506124 28730 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:59.507249 29259 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:10:59.515743 29757 tablet_copy_client.cc:323] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:10:59.517710 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet 6ed00f783ec545f7a156d77cd9062498 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:10:59.518293 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet 6ed00f783ec545f7a156d77cd9062498 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-6ed00f783ec545f7a156d77cd9062498
I20260709 13:10:59.519098 28653 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:10:59.520190 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:10:59.521095 29719 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:59.523003 29719 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:10:59.523115 28730 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:10:59.523916 29719 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:10:59.527519 28591 tablet_copy_source_session.cc:215] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:59.565944 29757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed00f783ec545f7a156d77cd9062498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:59.570791 28478 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:59.589600 29757 tablet_copy_client.cc:806] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:59.590080 29757 tablet_copy_client.cc:670] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:59.594409 29757 tablet_copy_client.cc:538] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:59.608206 29757 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:10:59.630476 29757 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:59.631723 29757 tablet_bootstrap.cc:492] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:10:59.632488 29757 ts_tablet_manager.cc:1403] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.008s
I20260709 13:10:59.635844 29757 raft_consensus.cc:359] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:59.636802 29757 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:10:59.637508 29757 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:10:59.641578 29757 ts_tablet_manager.cc:1434] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:10:59.644124 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-6ed00f783ec545f7a156d77cd9062498 received from {username='slave'} at 127.0.0.1:54208
I20260709 13:10:59.644586 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-6ed00f783ec545f7a156d77cd9062498 on tablet 6ed00f783ec545f7a156d77cd9062498 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:10:59.659763 28724 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.661157 29641 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.679371 28578 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.680785 29507 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.692582 28653 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.694914 28730 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.698585 29647 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.701431 29258 raft_consensus.cc:1217] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:59.715544 28724 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.718539 29770 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:59.721530 29259 raft_consensus.cc:1217] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:59.721519 29647 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:59.728930 28653 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.742072 29678 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.745642 28725 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.747555 29647 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.760833 28656 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.768594 29729 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.789907 29258 raft_consensus.cc:1217] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:59.887668 29258 raft_consensus.cc:1217] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:59.967175 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:00.023363 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:00.035070 28730 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:00.036790 29763 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:00.083503 28651 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:00.084959 29763 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:00.098986 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:00.099852 28656 raft_consensus.cc:606] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:00.103600 28730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:00.112768 29641 raft_consensus.cc:993] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:00.114219 29507 raft_consensus.cc:1081] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:00.116048 29258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46388
I20260709 13:11:00.104174 28730 raft_consensus.cc:606] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:00.116806 29258 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.117446 29258 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.126359 29258 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.128978 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:00.129599 28575 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.135946 28575 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:00.139667 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:00.140559 29763 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:00.141062 29763 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:00.141645 29480 raft_consensus.cc:1064] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:00.141906 29763 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.144124 29480 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.156796 28730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:00.157469 28730 raft_consensus.cc:606] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:00.159044 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:00.159763 28651 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:00.160069 28651 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:00.160740 28651 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.162077 29653 raft_consensus.cc:1064] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:00.162079 28651 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.168483 29653 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.170145 29258 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:00.173425 28651 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:00.184767 29258 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.184669 28477 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.186389 29724 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.198252 28656 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.199002 28581 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.200489 29722 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.205202 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:00.205619 29258 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.205816 28581 raft_consensus.cc:606] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:00.207329 28653 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.210400 28730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:00.211069 28730 raft_consensus.cc:606] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:00.212303 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:00.213514 29722 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.214071 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:00.215672 29722 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.207338 29480 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.229461 29770 raft_consensus.cc:1064] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:00.235548 29770 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.266311 29724 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.275723 28730 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:00.277699 29647 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:00.292312 28653 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:00.294109 29770 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:00.303586 29259 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:00.310365 28575 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.324286 29647 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:00.332864 29801 raft_consensus.cc:1064] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:00.343722 28477 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.352612 29258 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.352934 29647 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:00.374670 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 65183.2us
I20260709 13:11:00.375958 28651 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.383744 28575 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.384872 28655 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.386235 29802 raft_consensus.cc:993] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:00.386726 29802 raft_consensus.cc:1081] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:00.388350 28653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:00.389174 28653 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.389614 28653 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:00.396749 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65426.4us
I20260709 13:11:00.397440 28653 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.398797 28730 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.400578 28653 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:00.407473 29653 raft_consensus.cc:993] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:00.407953 29653 raft_consensus.cc:1081] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:00.409669 29258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:11:00.409122 28656 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.410251 29258 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.410655 29258 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.412632 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:00.413242 28725 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.420210 28725 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:00.422001 29789 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.422103 29255 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.427836 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:00.428419 28581 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:00.428725 28581 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:00.429229 28620 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:00.431213 29507 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:00.431645 29507 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:00.432353 29507 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.432415 29258 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.429543 28581 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.375099 29724 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.439396 28581 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.441385 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:00.441998 28578 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.447548 29653 raft_consensus.cc:993] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:00.448849 29653 raft_consensus.cc:1081] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:00.450519 28651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50992
I20260709 13:11:00.451123 28651 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.451511 28651 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.454102 28578 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:00.455416 29224 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:00.457059 29762 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:00.457612 29762 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:00.458334 28581 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:00.458460 29762 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.460037 28479 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.462796 28728 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.481555 29255 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:00.482923 29791 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:00.436312 29801 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.484784 28651 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.493268 29258 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:00.494247 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:00.494858 28725 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:00.495142 28725 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:00.495685 28655 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:00.495931 28725 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.497797 28725 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.497500 28476 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.499226 28651 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:00.501924 29480 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:00.502830 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:00.503527 28728 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:00.503942 28728 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:00.504695 28728 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.506214 28728 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.507586 28575 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.504473 28725 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:00.520424 28655 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.555199 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:00.556074 28572 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.550673 28728 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:00.517710 29722 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.553771 29260 raft_consensus.cc:2955] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.557272 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:00.558090 29507 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:00.555137 29257 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.520395 29258 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.574321 28581 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:00.573853 28478 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.576036 29763 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:00.577587 29803 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:00.580771 28572 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:00.591485 28728 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.605355 29802 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.613634 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 31c48009ac1c494fac1b2eb14ee5e90e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:00.613826 29791 raft_consensus.cc:993] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:00.614409 29789 raft_consensus.cc:1081] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:00.611917 28477 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.616336 28575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50024
I20260709 13:11:00.616971 28575 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.617437 28575 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.627739 29770 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.628944 28478 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.630502 29260 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.646668 28655 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:00.652004 28581 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.658748 29507 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:00.659651 29507 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.669883 28728 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.675936 28477 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.683808 28575 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.685608 29801 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.691942 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:00.692514 28728 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:00.693099 28728 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:00.694056 28728 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.695099 28728 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.698057 28575 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:00.699607 29260 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:00.701702 29647 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:00.708765 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet 31c48009ac1c494fac1b2eb14ee5e90e with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:11:00.707660 28728 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:00.715138 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:00.715560 28653 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:00.715759 28656 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.715704 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:00.717743 29647 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:00.718176 29647 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:00.718886 29647 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:00.742009 28656 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:00.775400 28476 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.783607 28655 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.784878 29817 tablet_replica.cc:333] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:11:00.786039 29817 raft_consensus.cc:2243] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:00.739128 29770 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:11:00.794147 28656 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:00.832392 29763 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:11:00.851433 28725 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:00.857537 29817 raft_consensus.cc:2272] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:00.857870 29260 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:00.859589 29791 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:00.859527 29678 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.862107 29817 ts_tablet_manager.cc:1916] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:11:00.870147 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 60113.9us
I20260709 13:11:00.870491 29724 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.879920 29258 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.883044 28650 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.893399 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a8a47d75d1241b7acc3796f628c9196 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:00.938971 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1d00e421d5e40fb93fa17b07c0e88a3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:00.943602 28581 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:00.940472 28476 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:00.969616 28479 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.975034 28728 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:00.976539 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a8a47d75d1241b7acc3796f628c9196 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:00.961364 29640 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:00.978286 29763 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:00.978610 29818 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260709 13:11:01.003201 29258 raft_consensus.cc:2955] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:01.005481 28578 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:01.014525 29791 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:01.022198 29825 tablet_replica.cc:333] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:11:01.024051 28575 raft_consensus.cc:2955] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:01.035096 29825 raft_consensus.cc:2243] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.035931 29825 raft_consensus.cc:2272] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.036811 28730 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:01.041882 29825 ts_tablet_manager.cc:1916] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:01.042892 28578 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:01.039978 29640 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:11:01.048025 28479 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.056209 29810 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:11:01.078697 29817 ts_tablet_manager.cc:1929] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:01.079165 29817 log.cc:1199] T 31c48009ac1c494fac1b2eb14ee5e90e P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/31c48009ac1c494fac1b2eb14ee5e90e
I20260709 13:11:01.108196 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet 31c48009ac1c494fac1b2eb14ee5e90e (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:01.109112 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d00e421d5e40fb93fa17b07c0e88a3 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33252
I20260709 13:11:01.113747 28575 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:01.115643 29822 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:01.125802 29825 ts_tablet_manager.cc:1929] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:01.126268 29825 log.cc:1199] T 8a8a47d75d1241b7acc3796f628c9196 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/8a8a47d75d1241b7acc3796f628c9196
I20260709 13:11:01.128106 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 8a8a47d75d1241b7acc3796f628c9196 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:01.133720 28728 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:01.144999 28650 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:01.149133 29831 tablet_replica.cc:333] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:11:01.150436 29831 raft_consensus.cc:2243] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.151314 29831 raft_consensus.cc:2272] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.157500 29678 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:01.162328 29831 ts_tablet_manager.cc:1916] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:01.163529 29821 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:01.181061 29831 ts_tablet_manager.cc:1929] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:11:01.181720 29831 log.cc:1199] T e1d00e421d5e40fb93fa17b07c0e88a3 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/e1d00e421d5e40fb93fa17b07c0e88a3
I20260709 13:11:01.184085 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet e1d00e421d5e40fb93fa17b07c0e88a3 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:01.213076 28728 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:01.221653 29823 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:01.308305 28574 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:01.282805 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:01.321264 29258 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:01.323781 29647 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:01.339800 29801 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:01.350802 28653 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:01.354984 29678 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:01.363793 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ed00f783ec545f7a156d77cd9062498 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:01.350128 29258 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:01.416342 28479 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.422068 28653 raft_consensus.cc:2955] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:01.480377 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ed00f783ec545f7a156d77cd9062498 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:11:01.483409 29831 tablet_replica.cc:333] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:11:01.491890 29831 raft_consensus.cc:2243] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.496919 29831 raft_consensus.cc:2272] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.508812 29831 ts_tablet_manager.cc:1916] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:01.545771 29831 ts_tablet_manager.cc:1929] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:01.546555 29831 log.cc:1199] T 6ed00f783ec545f7a156d77cd9062498 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/6ed00f783ec545f7a156d77cd9062498
I20260709 13:11:01.551586 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet 6ed00f783ec545f7a156d77cd9062498 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:01.593364 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:01.631865 28650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "299a315de86c44c0a3613934339689e4"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:01.632654 28650 raft_consensus.cc:606] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:01.635990 28728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:01.636538 28728 raft_consensus.cc:606] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:01.639390 28650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:01.639917 28650 raft_consensus.cc:606] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:01.642539 28728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:01.643013 28728 raft_consensus.cc:606] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:01.645977 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:01.646589 28580 raft_consensus.cc:606] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:01.647780 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:01.649392 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:01.784516 29800 raft_consensus.cc:993] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:01.785066 29647 raft_consensus.cc:1081] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:01.786665 28653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:01.787308 28653 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:01.787648 28653 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.792532 28653 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:01.794310 28653 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:01.795194 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:01.795849 28574 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:01.796077 28574 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:01.796806 28574 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:01.797407 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:01.798233 28730 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.798455 28574 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.806577 28574 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:01.806577 28730 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:01.808372 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:01.809290 29821 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:01.809834 29821 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:01.810710 29821 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:01.822965 28479 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.962888 29641 raft_consensus.cc:993] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:01.963460 29641 raft_consensus.cc:1081] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:01.964972 28574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:11:01.965546 28574 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:01.965888 28574 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.970875 28574 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:01.973310 28574 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:01.973361 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:01.974632 28650 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:01.974953 28650 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:01.975660 28650 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:01.976660 28650 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.982798 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:01.984542 29653 raft_consensus.cc:993] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:01.984644 28730 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.985155 29653 raft_consensus.cc:1081] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:01.986912 29258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:11:01.987512 29258 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:01.987762 28650 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:01.987920 29258 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.989202 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:01.990197 29800 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:01.990749 29800 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:01.991724 29800 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:02.002841 28730 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:02.007599 29258 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.010793 29258 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:02.011111 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:02.010620 28479 catalog_manager.cc:5697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.011492 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:02.011775 28574 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.012269 28730 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.012972 28730 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:02.013878 28730 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.015286 28730 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.024032 28574 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:02.025590 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:02.027187 29763 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.030598 28730 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:02.047163 29641 raft_consensus.cc:993] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:02.047878 29641 raft_consensus.cc:1081] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:02.047099 29763 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:02.049985 29763 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.052884 29258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "299a315de86c44c0a3613934339689e4"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46388
I20260709 13:11:02.053578 29258 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:02.056816 29258 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.068100 29258 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.072228 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:02.072395 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:02.072870 28653 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.073067 28725 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.073314 28653 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:02.072646 28479 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.074154 28653 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.075060 28653 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.082026 28725 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:02.082965 29258 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:02.083180 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:02.084028 29763 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.084614 29763 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:02.084995 28653 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:02.085636 29763 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.091276 29653 raft_consensus.cc:993] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:02.091876 29653 raft_consensus.cc:1081] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:02.093443 28653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50992
I20260709 13:11:02.093961 28653 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:02.094321 28653 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.100389 28653 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:02.102461 28653 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:02.102969 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:02.103395 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:02.103559 28581 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.103940 28725 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.104562 28725 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:02.105377 28725 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:02.106928 28725 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.112151 28479 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.114959 28581 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:02.116166 28621 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:02.116219 28725 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:02.117203 29822 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.117727 29822 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:02.118585 29822 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:02.132504 28479 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.210430 28581 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:02.211649 29822 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:02.231845 28725 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:02.233237 29822 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:02.464257 28730 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:02.465708 29800 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:02.472877 28581 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:02.474180 28730 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:02.474548 29841 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:02.484754 29841 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:02.486964 28653 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:02.488356 29678 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.511099 28725 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:02.513338 29842 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:02.620610 28581 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:02.624794 28653 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:02.624804 29822 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:02.626513 29842 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:02.633456 28730 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:02.647964 29822 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.650298 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:02.746836 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:02.747922 28728 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:11:02.755100 28696 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7cf5b8cf3c9a478da7deba36d7acbe96. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.756569 28650 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:02.758345 28581 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:02.758432 29857 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:02.760206 29789 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.770268 29857 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.772714 28581 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.781948 28650 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.789426 28651 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:02.799047 28479 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:11:02.807493 28622 consensus_peers.cc:597] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4380fb261ad646d49d956c3ba5036856. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.808326 28728 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:02.811098 28728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:02.811779 28728 raft_consensus.cc:606] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:02.816202 28581 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:02.814106 29822 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:02.816236 28728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:02.817404 28728 raft_consensus.cc:606] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:02.818594 29822 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:02.820350 28650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:02.820948 28650 raft_consensus.cc:606] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:02.824925 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:02.825533 28580 raft_consensus.cc:606] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:02.827427 29822 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.829316 28581 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.839990 28650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:02.840626 28650 raft_consensus.cc:606] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:02.843750 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:02.845270 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:02.847524 28725 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.862176 28730 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:02.866534 28479 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:11:02.880774 28696 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35fc728c038d4d8d8827779516ffce5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.882511 28650 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:02.882783 28581 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:02.884220 29857 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.885699 29858 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:02.894222 29789 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.897184 28650 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.899441 28580 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:02.906867 29653 raft_consensus.cc:993] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:02.907352 29653 raft_consensus.cc:1081] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:02.912580 28574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50024
I20260709 13:11:02.913329 28574 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:02.913707 28574 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.923234 29678 raft_consensus.cc:993] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:02.923797 29800 raft_consensus.cc:1081] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:02.921353 28479 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.925688 28650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:02.928874 28650 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:02.929490 28650 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.931881 28581 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:02.946460 28650 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.950006 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:02.950727 29260 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.950024 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:02.951563 28575 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.951859 28575 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:02.952575 28575 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.954290 28574 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:02.954638 28575 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.955417 28650 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:02.959422 29260 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:02.960731 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:02.961779 29641 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.962289 29641 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:02.963186 28574 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:02.963090 29641 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:02.964749 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:02.965425 28725 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:02.965752 28725 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:02.964774 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:02.967133 28651 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.976083 29789 raft_consensus.cc:993] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:02.976629 28725 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:02.977200 29857 raft_consensus.cc:1081] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:02.983811 28725 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.989861 29868 raft_consensus.cc:993] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:02.989995 28651 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:02.990633 29868 raft_consensus.cc:1081] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:02.991555 28546 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:02.995414 28655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50992
I20260709 13:11:02.996122 28655 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:02.996479 28655 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.998162 29647 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.998741 29647 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:02.999832 29647 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:03.016625 28574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:11:03.017701 28574 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:03.018229 28574 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.030280 28655 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:03.108006 28725 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
W20260709 13:11:03.110134 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 105377us
I20260709 13:11:03.193271 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:03.193912 28576 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.210140 28576 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:03.639309 29879 ts_tablet_manager.cc:933] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:03.756556 28655 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:03.216339 29868 raft_consensus.cc:993] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:03.826315 29880 raft_consensus.cc:1081] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:03.827631 29879 tablet_copy_client.cc:323] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:11:03.849970 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:03.851774 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:03.853049 29878 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:03.853868 29878 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:03.854722 29878 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:03.868888 28478 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:03.887944 28581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.011s	sys 0.016s
W20260709 13:11:03.888366 28581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.011s	sys 0.016s
I20260709 13:11:03.897569 28724 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:03.950387 29880 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:03.951032 29880 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:03.958827 29880 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:03.966398 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:03.974381 29887 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:03.981524 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet 4380fb261ad646d49d956c3ba5036856 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:11:03.982196 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet 4380fb261ad646d49d956c3ba5036856 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-4380fb261ad646d49d956c3ba5036856
I20260709 13:11:03.997679 29884 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:11:04.000118 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.017s	sys 0.013s
W20260709 13:11:04.000531 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.017s	sys 0.013s
W20260709 13:11:04.000849 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.00155e+06us
I20260709 13:11:04.008780 28666 tablet_copy_source_session.cc:215] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:04.009936 28654 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:04.036027 28574 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.017s	user 0.012s	sys 0.016s
I20260709 13:11:04.036473 28574 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.037616 28572 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.040627 28574 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:04.042739 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50032 (request call id 1397) took 1032 ms. Trace:
I20260709 13:11:04.046272 29257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46388
I20260709 13:11:04.052152 29257 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.052649 29257 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.054371 29897 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:04.056303 28547 consensus_peers.cc:597] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50de2f4297b44d57a1acdb6f6af1f02f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:02.989861 28575 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:04.057453 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 1394) took 1107 ms. Trace:
I20260709 13:11:04.057780 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:04.057852 28575 rpcz_store.cc:276] 0709 13:11:02.949545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.949687 (+   142us) service_pool.cc:224] Handling call
0709 13:11:04.057360 (+1107673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.059720 28581 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:04.060002 29898 ts_tablet_manager.cc:933] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:04.048367 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:04.048151 28724 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:04.061404 28574 rpcz_store.cc:276] 0709 13:11:03.010481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.016414 (+  5933us) service_pool.cc:224] Handling call
0709 13:11:04.042665 (+1026251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.062623 29256 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:04.064419 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:04.065373 29821 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.068183 29868 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:04.074194 29821 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:04.075398 29868 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:04.075785 29868 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:04.076624 29868 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.078145 29868 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:04.079344 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 94699.9us
I20260709 13:11:04.084208 29879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4380fb261ad646d49d956c3ba5036856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.093849 28575 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.055028 29897 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:04.120249 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:04.121026 28728 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.132148 28728 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:04.134457 29893 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:04.135016 29893 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:04.135172 29868 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:04.137253 29893 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:04.138444 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:04.141319 29874 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:04.141788 29874 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:04.142724 29874 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.151952 29884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54192 (request call id 6) took 1239 ms. Trace:
I20260709 13:11:04.152489 29884 rpcz_store.cc:276] 0709 13:11:02.912310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.929146 (+ 16836us) service_pool.cc:224] Handling call
0709 13:11:02.958176 (+ 29030us) log.cc:844] Serialized 499 byte log entry
0709 13:11:04.151860 (+1193684us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":495,"raft.run_wall_time_us":495,"thread_start_us":926513,"threads_started":1,"wal-append.queue_time_us":149846}
I20260709 13:11:04.155385 29893 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:04.155927 29893 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.156715 29897 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:04.158033 29893 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:04.158262 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:04.144582 28479 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.192122 28653 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:04.206295 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 179351us
I20260709 13:11:04.211337 29678 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:04.221287 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:04.256664 28651 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:04.262425 29879 tablet_copy_client.cc:806] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:04.264681 29879 tablet_copy_client.cc:670] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
W20260709 13:11:04.269836 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.269744 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.269922 29898 tablet_copy_client.cc:323] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:11:04.189141 29257 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:04.281775 29905 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:04.282498 29905 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.285463 29641 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:04.280821 29257 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:04.290958 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61454.4us
I20260709 13:11:04.220338 29868 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:04.293533 29641 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.309434 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:04.310081 28730 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:04.303725 29901 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:11:04.315742 29641 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:04.318998 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:04.311970 29905 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:04.301067 29868 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:04.334964 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 95195.2us
I20260709 13:11:04.337584 29868 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:04.337849 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 35fc728c038d4d8d8827779516ffce5f from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:11:04.338457 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 35fc728c038d4d8d8827779516ffce5f from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-35fc728c038d4d8d8827779516ffce5f
I20260709 13:11:04.347142 29763 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.349699 29903 ts_tablet_manager.cc:933] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:04.368377 28730 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:04.378968 29892 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:04.379541 29892 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.381713 29892 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:04.383177 28724 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.386140 28725 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.386433 29257 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.387599 28656 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:04.383777 29905 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:11:04.395606 29905 consensus_queue.cc:1243] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:04.395973 29894 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:04.393128 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:04.394124 29893 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:04.394694 28740 tablet_copy_source_session.cc:215] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:04.408788 29905 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:04.409309 29905 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:04.424639 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:04.425045 29905 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.426853 29905 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.427369 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:04.436532 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:04.437233 28654 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:04.437547 28654 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:04.444109 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:04.396720 29894 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.447434 29894 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:04.448261 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:04.408867 29893 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.448966 28654 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:04.441825 29841 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:04.460434 29841 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:04.459147 28654 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.461401 29841 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:04.472154 29898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35fc728c038d4d8d8827779516ffce5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.472894 29893 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:04.473021 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.474509 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.474979 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:04.475747 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:04.480405 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.484594 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.495141 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.529738 29900 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:04.530587 29900 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:04.542058 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 235162us
I20260709 13:11:04.544067 29885 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.544634 29885 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.546895 29885 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:04.549551 28476 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:04.542933 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:04.557819 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:04.550900 28479 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.542362 29903 tablet_copy_client.cc:323] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:11:04.542758 29880 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:04.579851 28724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:04.580540 28724 raft_consensus.cc:606] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:04.570703 29905 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.582957 29900 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:04.584556 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:04.561272 29894 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.588989 28728 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
W20260709 13:11:04.601222 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 43512.5us
I20260709 13:11:04.584551 29879 tablet_copy_client.cc:538] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:11:04.654795 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 111811us
I20260709 13:11:04.657251 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:04.636934 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 51019.7us
I20260709 13:11:04.661749 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.586143 29880 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:04.677199 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:04.695394 28579 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:04.703251 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 137434us
I20260709 13:11:04.725793 28651 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:04.728018 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.733721 28725 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:04.738018 29930 ts_tablet_manager.cc:933] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:11:04.711254 29889 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:04.724746 28729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
W20260709 13:11:04.758000 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.776435 28651 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:04.777124 28729 raft_consensus.cc:606] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:04.751310 29889 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.780807 29889 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:04.782078 29678 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:04.782514 29879 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:04.783967 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:04.788931 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:04.792622 29641 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:04.793292 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:04.795135 29881 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.795701 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:04.814286 29923 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.816617 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:04.820647 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:04.821203 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:04.824245 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:04.825431 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:04.825692 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:04.826042 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 7cf5b8cf3c9a478da7deba36d7acbe96 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:11:04.826611 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 7cf5b8cf3c9a478da7deba36d7acbe96 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-7cf5b8cf3c9a478da7deba36d7acbe96
I20260709 13:11:04.832614 29888 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.829999 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:04.839567 28721 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:04.840154 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800147f80 after lost signal to thread 27435
W20260709 13:11:04.841511 28677 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9380 after lost signal to thread 28513
W20260709 13:11:04.843021 28677 debug-util.cc:398] Leaking SignalData structure 0x7b08002cad20 after lost signal to thread 28605
W20260709 13:11:04.844417 28677 debug-util.cc:398] Leaking SignalData structure 0x7b080031b5e0 after lost signal to thread 28680
I20260709 13:11:04.845167 29919 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.795629 29881 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:04.851840 28651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:04.823695 29889 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.865141 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:04.872618 29928 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:04.481276 29891 consensus_queue.cc:1175] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d64d870625d6461b89b1fb75cd2e26e0" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:11:04.878160 28677 debug-util.cc:398] Leaking SignalData structure 0x7b080034f6c0 after lost signal to thread 28754
I20260709 13:11:04.900835 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:04.903203 29647 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.907698 29678 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:04.911258 28654 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:04.911795 28651 raft_consensus.cc:606] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:04.912175 28651 raft_consensus.cc:614] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:04.925158 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800107700 after lost signal to thread 29286
I20260709 13:11:04.975836 28651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:04.984603 28651 raft_consensus.cc:606] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:04.973589 29898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46376 (request call id 378) took 1045 ms. Trace:
W20260709 13:11:04.996740 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 139493us
I20260709 13:11:04.981232 29930 tablet_copy_client.cc:323] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:11:04.998508 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:04.993732 29898 rpcz_store.cc:276] 0709 13:11:03.926978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.994235 (+ 67257us) service_pool.cc:224] Handling call
0709 13:11:04.060325 (+ 66090us) ts_tablet_manager.cc:934] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
0709 13:11:04.344971 (+284646us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4c001f0200. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a260e2a20 00007f4a260f3a29 00007f4a260f413f 00007f4a260b82ab 00007f4a260e5f3c 00007f4a260e6461 00007f4a260e6768 00007f4a2be6c2eb 00007f4a2cd91d3b 00007f4a2cd8c008 00007f4a2cd8b405
0709 13:11:04.470795 (+125824us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:04.735929 (+265134us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:04.736045 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:04.921918 (+185873us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:04.922225 (+   307us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:04.936500 (+ 14275us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:04.972042 (+ 35542us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":45113,"spinlock_wait_cycles":28802432,"tablet-copy.queue_time_us":65167,"thread_start_us":336857,"threads_started":2}
I20260709 13:11:05.002559 29898 tablet_copy_client.cc:806] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:05.004369 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:05.005350 28574 raft_consensus.cc:606] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:05.003165 29898 tablet_copy_client.cc:670] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:05.035666 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:05.040215 28740 tablet_copy_source_session.cc:215] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:05.023047 29928 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.057425 29903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cf5b8cf3c9a478da7deba36d7acbe96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.057729 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:05.058658 29905 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.061815 29888 raft_consensus.cc:993] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:05.062547 29888 raft_consensus.cc:1081] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
W20260709 13:11:04.973297 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 275073us
I20260709 13:11:05.062855 29880 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:05.069643 28572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50024
I20260709 13:11:05.070313 28572 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.070688 28572 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.081758 28572 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:05.085670 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:05.085266 28479 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.083727 28478 catalog_manager.cc:5697] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:05.095314 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52208.9us
W20260709 13:11:05.095233 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 71269.5us
I20260709 13:11:05.119585 28572 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:05.132407 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 307248us
I20260709 13:11:05.139999 29868 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:05.140806 29881 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:05.145815 28621 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:05.168205 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:05.168957 28729 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.169358 28729 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:05.150714 29891 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.179898 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:05.170781 28729 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:05.198489 28729 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.206290 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:05.209415 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet 50de2f4297b44d57a1acdb6f6af1f02f from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:11:05.210160 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet 50de2f4297b44d57a1acdb6f6af1f02f from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-50de2f4297b44d57a1acdb6f6af1f02f
W20260709 13:11:05.255795 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 81842.7us
I20260709 13:11:05.267990 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:05.254628 28729 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:05.283936 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:05.290418 29898 tablet_copy_client.cc:538] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:05.315311 29877 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:11:05.342495 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:05.343281 28655 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.345366 29879 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:05.374711 29678 raft_consensus.cc:993] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:05.375174 29678 raft_consensus.cc:1081] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:05.381940 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:05.384047 28655 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:05.385985 29941 raft_consensus.cc:993] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:05.386173 29899 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.386686 29941 raft_consensus.cc:1081] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:05.396013 28591 tablet_copy_source_session.cc:215] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:05.409421 28655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50992
I20260709 13:11:05.410112 28655 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.410491 28655 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.408735 29879 tablet_bootstrap.cc:492] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:05.417412 29879 ts_tablet_manager.cc:1403] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.635s	user 0.027s	sys 0.013s
I20260709 13:11:05.406858 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:05.384966 29903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46376 (request call id 380) took 1445 ms. Trace:
I20260709 13:11:05.430423 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:05.433048 29930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50de2f4297b44d57a1acdb6f6af1f02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:05.439309 28655 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:05.448398 28655 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:05.454485 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 47746.4us
I20260709 13:11:05.460094 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:05.460912 28722 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.461292 28722 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:05.461153 28654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:05.464777 28654 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.462200 28722 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:05.469803 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:05.474948 28575 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.454936 29885 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.463290 29874 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.488806 28722 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.474438 28654 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.426687 29903 rpcz_store.cc:276] 0709 13:11:03.935783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.058009 (+122226us) service_pool.cc:224] Handling call
0709 13:11:04.350051 (+292042us) ts_tablet_manager.cc:934] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
0709 13:11:04.774385 (+424334us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b4c001f0200. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a260e2a20 00007f4a260f3a29 00007f4a260f413f 00007f4a260b82ab 00007f4a260e5f3c 00007f4a260e6461 00007f4a260e6768 00007f4a2be6c2eb 00007f4a2cd91d3b 00007f4a2cd8c008 00007f4a2cd8b405
0709 13:11:05.042539 (+268154us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:05.187941 (+145402us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:05.188090 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:05.359137 (+171047us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:05.359449 (+   312us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:05.359971 (+   522us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:05.373227 (+ 13256us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":82628,"spinlock_wait_cycles":92778368,"tablet-copy.queue_time_us":264872,"thread_start_us":265726,"threads_started":2}
I20260709 13:11:05.497077 29903 tablet_copy_client.cc:806] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:05.497664 29903 tablet_copy_client.cc:670] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:05.497831 29879 raft_consensus.cc:359] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:05.498728 29879 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:05.493721 29874 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:05.507124 29874 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:05.512225 29885 raft_consensus.cc:993] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:05.512766 29885 raft_consensus.cc:1081] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:05.513336 29898 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:05.528765 28575 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:05.549597 28575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:11:05.550274 28575 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.550972 28575 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.547446 28621 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:05.556217 29885 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.556850 29885 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:05.561365 29903 tablet_copy_client.cc:538] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:05.570935 28575 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:05.521857 29879 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:05.583206 28575 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:05.589571 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:05.590255 28652 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.590569 28652 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:05.629794 28652 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:05.631125 28652 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.634354 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:05.634990 28726 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.591419 28722 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:05.636085 29879 ts_tablet_manager.cc:1434] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.218s	user 0.007s	sys 0.003s
I20260709 13:11:05.676662 28654 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:05.678958 28654 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:05.682869 28647 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:05.592074 29885 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:05.708762 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-4380fb261ad646d49d956c3ba5036856 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:11:05.709444 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-4380fb261ad646d49d956c3ba5036856 on tablet 4380fb261ad646d49d956c3ba5036856 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:05.717453 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:05.718047 28581 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:05.718334 28581 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:05.719026 28581 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:05.732955 28581 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.757375 28652 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
W20260709 13:11:05.733865 29881 consensus_queue.cc:1175] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ed517a03edd141a798f07798667c1c04" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:11:05.775555 29903 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:05.788038 28546 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:05.760162 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:05.805444 28722 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.811760 29930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46396 (request call id 206) took 1211 ms. Trace:
I20260709 13:11:05.812233 29930 rpcz_store.cc:276] 0709 13:11:04.600038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.606704 (+  6666us) service_pool.cc:224] Handling call
0709 13:11:04.738402 (+131698us) ts_tablet_manager.cc:934] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
0709 13:11:05.425903 (+687501us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:05.677251 (+251348us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:05.677367 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:05.772148 (+ 94781us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:05.779250 (+  7102us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:05.811641 (+ 32391us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:05.811702 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":34913,"tablet-copy.queue_time_us":111250,"thread_start_us":278080,"threads_started":2}
I20260709 13:11:05.813601 29930 tablet_copy_client.cc:806] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:05.814106 29930 tablet_copy_client.cc:670] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:05.800719 29647 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.823578 29647 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:05.802160 28581 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
W20260709 13:11:05.826756 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 95400.7us
I20260709 13:11:05.828783 29647 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:05.891175 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 52799.4us
I20260709 13:11:05.919276 28726 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:05.932521 28477 catalog_manager.cc:5697] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.969918 29257 raft_consensus.cc:1217] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:11:05.975778 28722 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:05.980252 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:05.991820 29938 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:06.009979 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 83110.5us
I20260709 13:11:06.011008 29938 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:06.073401 29938 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:06.077704 29930 tablet_copy_client.cc:538] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:11:06.108340 29961 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:11:06.149433 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:06.196449 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 153543us
W20260709 13:11:06.233143 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 140521us
I20260709 13:11:06.245229 29930 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:06.260421 28656 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:06.335420 28622 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:06.353561 28722 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:06.358796 29924 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:06.360942 29903 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:06.362147 29903 tablet_bootstrap.cc:492] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:06.363039 29903 ts_tablet_manager.cc:1403] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.588s	user 0.030s	sys 0.000s
I20260709 13:11:06.367630 29903 raft_consensus.cc:359] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:06.369977 29903 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:06.370857 29903 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:06.374140 29903 ts_tablet_manager.cc:1434] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260709 13:11:06.375438 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 116905us
W20260709 13:11:06.388430 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 69349.4us
I20260709 13:11:06.386174 28478 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:06.404693 28579 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:06.407250 28730 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.413527 28729 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.417989 29881 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.420594 29881 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.410908 29898 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:06.428555 29898 tablet_bootstrap.cc:492] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:06.429569 29898 ts_tablet_manager.cc:1403] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.917s	user 0.024s	sys 0.015s
I20260709 13:11:06.449127 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-7cf5b8cf3c9a478da7deba36d7acbe96 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:11:06.450011 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-7cf5b8cf3c9a478da7deba36d7acbe96 on tablet 7cf5b8cf3c9a478da7deba36d7acbe96 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:06.481779 29967 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:06.490679 29899 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.494668 29898 raft_consensus.cc:359] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:06.510499 28654 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.519110 29900 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.506683 29898 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:06.523708 29898 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:06.541278 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:06.553305 29938 raft_consensus.cc:1064] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:06.574134 29938 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:06.655488 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67489.8us
I20260709 13:11:06.673659 29898 ts_tablet_manager.cc:1434] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.244s	user 0.009s	sys 0.000s
I20260709 13:11:06.679786 29930 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:06.699519 28479 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:11:06.706444 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-35fc728c038d4d8d8827779516ffce5f received from {username='slave'} at 127.0.0.1:44608
I20260709 13:11:06.727344 28572 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.726418 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-35fc728c038d4d8d8827779516ffce5f on tablet 35fc728c038d4d8d8827779516ffce5f with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:06.746824 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:06.747713 28656 raft_consensus.cc:606] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:11:06.767771 29257 raft_consensus.cc:1217] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:06.742030 29939 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:11:06.782042 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:06.782737 28656 raft_consensus.cc:606] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:11:06.772970 29930 tablet_bootstrap.cc:492] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
W20260709 13:11:06.803318 28465 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 7cf5b8cf3c9a478da7deba36d7acbe96 already in progress
I20260709 13:11:06.804059 29880 raft_consensus.cc:993] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:06.804621 29880 raft_consensus.cc:1081] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
W20260709 13:11:06.809065 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 65115.1us
I20260709 13:11:06.810976 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:06.811595 28581 raft_consensus.cc:606] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:06.802999 28729 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.837975 28575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:11:06.838644 28575 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:06.839038 28575 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:06.843422 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75949.2us
I20260709 13:11:06.870875 28575 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:06.862546 29930 ts_tablet_manager.cc:1403] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.618s	user 0.032s	sys 0.033s
W20260709 13:11:06.945755 29986 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:11:06.921418 29684 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:11:06.863894 29939 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:11:06.957270 29988 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.152s	user 0.004s	sys 0.001s
W20260709 13:11:06.865263 28465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61970.5us
I20260709 13:11:06.963960 28575 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:06.966308 28579 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:11:06.981983 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 118294us
I20260709 13:11:06.987453 28654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:06.988102 28654 raft_consensus.cc:606] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:06.992556 28724 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:06.992756 29885 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:06.995875 29930 raft_consensus.cc:359] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:06.996873 29930 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:07.013231 28647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:07.013960 28647 raft_consensus.cc:606] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:11:07.015790 29257 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Advancing to term 2
I20260709 13:11:07.016672 29258 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:07.028445 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:07.028673 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:07.029094 28651 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:07.029387 28723 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.029425 28651 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:07.030478 28651 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:07.053176 29938 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:07.056430 29930 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:07.058400 29930 ts_tablet_manager.cc:1434] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.000s
I20260709 13:11:07.060160 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-50de2f4297b44d57a1acdb6f6af1f02f received from {username='slave'} at 127.0.0.1:54208
I20260709 13:11:07.060662 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-50de2f4297b44d57a1acdb6f6af1f02f on tablet 50de2f4297b44d57a1acdb6f6af1f02f with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:07.061870 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b905a9410ce147d093be203901159c35"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:07.062449 28656 raft_consensus.cc:606] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:07.069689 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:07.071039 28581 raft_consensus.cc:606] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:07.076442 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:07.076674 29891 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:07.078996 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:07.080571 28651 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.074615 28476 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.096920 28651 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
W20260709 13:11:07.119897 28527 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0c0ecde0af494dc9b152dee191c6d3e6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:11:07.120425 28527 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 7cf5b8cf3c9a478da7deba36d7acbe96 already in progress
W20260709 13:11:07.120721 28527 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 7cf5b8cf3c9a478da7deba36d7acbe96 already in progress
I20260709 13:11:07.122071 28546 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:07.103184 28723 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:07.111435 28575 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:07.134727 29877 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.135270 29877 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:07.136163 29877 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:07.155223 29900 raft_consensus.cc:993] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:07.155736 29900 raft_consensus.cc:1081] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:07.156862 28729 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:07.157330 28654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:07.157892 28654 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:07.158272 28654 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.165259 29913 raft_consensus.cc:993] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:07.165828 29913 raft_consensus.cc:1081] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:07.175225 28654 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:07.183717 28725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b905a9410ce147d093be203901159c35"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33274
I20260709 13:11:07.188103 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:07.188755 28575 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:07.190598 28575 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:07.191330 28575 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:07.192571 28575 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.200147 28575 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:07.186625 28579 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.203650 29927 raft_consensus.cc:1064] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:07.205371 29967 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.210232 28621 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:07.208015 29927 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.234517 29939 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:07.235116 29939 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:07.235989 29939 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:07.209174 28730 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.227824 28725 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:07.220641 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:07.240741 28723 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.216387 28654 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:07.240132 28725 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.261562 28725 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:07.336910 28476 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.397997 28654 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:07.398625 28579 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:07.398873 28476 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.345742 28478 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.365477 29967 raft_consensus.cc:993] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:07.403347 29967 raft_consensus.cc:1081] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:07.407187 29892 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.368384 29258 raft_consensus.cc:1217] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:11:07.371395 29252 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:07.374064 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 109026us
I20260709 13:11:07.326607 28723 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:07.388044 29257 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:07.425838 29927 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:07.432022 28726 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:07.441895 29874 raft_consensus.cc:993] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:07.442416 29874 raft_consensus.cc:1081] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:07.444455 29258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:11:07.446648 29258 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:07.447208 29258 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.449213 28722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33274
I20260709 13:11:07.449833 28722 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:07.450277 28722 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.458748 29892 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:07.468235 29919 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.469313 29919 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:07.469681 29919 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:07.470575 29919 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:07.471585 29919 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.476256 28725 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:07.470449 28722 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.480626 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:07.481238 28575 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.493244 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:07.495766 28722 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:07.497294 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:07.498013 29257 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.507648 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:07.508379 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:07.508551 28581 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.508953 28654 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:07.509384 28654 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:07.510315 28654 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.512243 28654 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.547070 28579 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.544139 29927 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.552971 28581 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:07.561157 29257 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:07.553920 28648 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.566480 28651 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
W20260709 13:11:07.568015 28465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 70326.4us
I20260709 13:11:07.558405 28575 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:07.569486 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:07.571112 29892 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:07.572338 29892 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:07.558605 28654 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:07.573665 29892 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:07.575281 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:07.576246 29931 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.576728 29931 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:07.577046 29252 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Advancing to term 3
I20260709 13:11:07.577634 29931 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.580662 29259 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:07.587567 28465 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4380fb261ad646d49d956c3ba5036856 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0c0ecde0af494dc9b152dee191c6d3e6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.553227 29258 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.610666 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:07.611286 28575 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:07.611613 28575 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:07.612309 28575 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.613746 28575 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.622110 28575 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:07.626551 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:07.626019 28477 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.627718 28722 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.627055 29258 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:07.636461 28722 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:07.637938 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:07.645850 29252 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:07.666036 29897 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:07.664531 29874 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:11:07.697294 28479 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.709487 28655 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:07.706527 29897 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:07.711501 29897 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.723016 28579 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.742089 29938 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:07.742674 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 63284.6us
W20260709 13:11:07.750798 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 73151us
I20260709 13:11:07.751758 29962 raft_consensus.cc:1064] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
W20260709 13:11:07.752223 29962 raft_consensus.cc:1068] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Unable to promote non-voter d64d870625d6461b89b1fb75cd2e26e0: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:07.764532 28479 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.799750 29962 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:07.811849 28477 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:07.822692 28722 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:07.826864 29877 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:07.838590 28722 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.845516 30012 raft_consensus.cc:1064] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:07.845810 29891 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:07.848187 30012 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.862569 28722 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:07.892793 29258 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:07.894423 29927 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:07.902573 29931 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.907683 28579 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:07.908902 29257 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.910684 29892 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:07.923666 28579 raft_consensus.cc:2955] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.954659 28476 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:07.960283 29257 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:07.962247 30012 raft_consensus.cc:1064] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:07.962558 28722 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:07.964198 29962 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.966260 28655 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:07.980080 29257 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:11:07.966699 30019 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:07.974455 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35fc728c038d4d8d8827779516ffce5f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:07.982349 29892 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:07.984284 29896 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.986876 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 35fc728c038d4d8d8827779516ffce5f with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:07.987893 29896 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:08.009907 30012 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:08.047430 28725 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:08.052078 29896 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:08.053289 29252 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:08.055573 28648 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:08.055737 29962 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.060745 28725 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.076365 29874 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:08.077723 30012 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:08.084172 28579 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:08.087452 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:08.098062 29892 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:11:08.114043 30025 tablet_replica.cc:333] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:11:08.115240 30025 raft_consensus.cc:2243] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:08.116086 30025 raft_consensus.cc:2272] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:08.113962 29874 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.130046 28655 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.157807 28725 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:08.160789 28648 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:08.176692 29990 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:08.183729 30025 ts_tablet_manager.cc:1916] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:08.184916 29892 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:08.191311 29257 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.192569 28575 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.199240 28654 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:08.252756 28477 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.289496 28476 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 2 to 5, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.265581 29941 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:11:08.300701 28723 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:08.326110 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 90851.4us
I20260709 13:11:08.330826 28729 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:08.326579 29931 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:11:08.402637 28575 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:11:08.401744 30000 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:11:08.456753 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:08.443936 29897 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:11:08.461547 30029 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:11:08.464252 30020 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:08.616694 29252 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:08.657333 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 317774us
I20260709 13:11:08.668953 28655 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.656491 30051 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:11:08.813565 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 97061.6us
I20260709 13:11:08.824568 30053 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.818228 30025 ts_tablet_manager.cc:1929] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:11:08.864550 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 148843us
I20260709 13:11:08.871217 29259 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:08.875432 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.867902 30025 log.cc:1199] T 35fc728c038d4d8d8827779516ffce5f P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/35fc728c038d4d8d8827779516ffce5f
I20260709 13:11:08.901964 29252 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.961639 28729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:09.003960 28648 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:09.024169 28729 raft_consensus.cc:606] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:09.027552 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 128005us
I20260709 13:11:09.048242 29941 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:11:09.083566 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4380fb261ad646d49d956c3ba5036856 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 13:11:09.093248 28576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:09.094039 28576 raft_consensus.cc:606] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:09.112015 28656 raft_consensus.cc:2955] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:08.968809 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 35fc728c038d4d8d8827779516ffce5f (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
W20260709 13:11:09.156996 28465 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 188202us
I20260709 13:11:09.171186 28651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:09.171838 28651 raft_consensus.cc:606] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:09.180994 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:09.182446 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:09.215618 29892 raft_consensus.cc:993] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:09.216194 29892 raft_consensus.cc:1081] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:09.226385 28581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50024
I20260709 13:11:09.227008 28581 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:09.227489 28581 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.240495 30037 raft_consensus.cc:993] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:09.241355 30037 raft_consensus.cc:1081] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:09.245584 28725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33274
I20260709 13:11:09.246234 28725 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:09.246665 28725 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.256422 28477 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 4 to 6, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:09.264081 28725 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:09.270040 28576 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:09.271936 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 78337.7us
I20260709 13:11:09.285555 28581 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:09.286895 29256 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:09.288146 28581 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:09.293303 28725 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:09.318149 28651 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:09.324373 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:09.325156 28576 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.313308 30068 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:11:09.334164 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:09.334895 28725 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:09.335243 28725 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:09.346616 28725 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:09.319932 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:09.348846 30011 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:09.367684 28648 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:09.368100 28648 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:09.368942 28648 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:09.370347 28648 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.352279 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet 4380fb261ad646d49d956c3ba5036856 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50022
I20260709 13:11:09.317183 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:09.374185 29256 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.375479 28579 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:09.388662 28576 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:09.406329 30080 tablet_replica.cc:333] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:11:09.413815 28725 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.415300 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:09.419201 29892 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:09.420008 29892 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:09.421329 29892 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:09.435217 28651 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:09.441164 30080 raft_consensus.cc:2243] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:09.442567 30080 raft_consensus.cc:2272] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:09.445464 30080 ts_tablet_manager.cc:1916] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:09.448427 29256 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:09.450838 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:09.453539 30011 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:09.454120 30011 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:09.468468 30049 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:09.483692 28725 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:09.486999 28722 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:09.491655 30011 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:09.503670 29962 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:09.479815 28648 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:09.538609 29252 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:09.541208 29259 raft_consensus.cc:2955] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:09.549620 30068 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:09.739771 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 50de2f4297b44d57a1acdb6f6af1f02f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:09.763633 29896 raft_consensus.cc:993] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:09.764233 30012 raft_consensus.cc:1081] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:09.766098 28654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:09.766819 28654 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:09.767247 28654 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.775497 28654 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:09.777859 28654 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:09.779403 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:09.780176 29252 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.786873 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:09.787758 28572 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:09.788098 28572 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:09.790007 28572 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:09.791185 28572 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.795184 30068 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:09.795908 28723 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:09.814656 29252 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:09.815975 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:09.816928 30066 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:09.817446 30066 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:09.818264 30066 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:09.822553 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7cf5b8cf3c9a478da7deba36d7acbe96 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:09.850956 28572 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:09.908186 28581 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:09.939738 29941 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:10.000568 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46412.9us
I20260709 13:11:10.011584 30080 ts_tablet_manager.cc:1929] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:11:10.012107 30080 log.cc:1199] T 4380fb261ad646d49d956c3ba5036856 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/4380fb261ad646d49d956c3ba5036856
I20260709 13:11:10.004900 28478 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.024070 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet 4380fb261ad646d49d956c3ba5036856 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:10.010836 28479 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.031996 28723 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:10.038069 30038 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:10.039616 28477 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:10.055841 29259 raft_consensus.cc:2955] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:10.076650 29256 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:10.078573 30049 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:10.089808 28651 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:10.091550 29931 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:10.140556 28476 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.142071 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet 50de2f4297b44d57a1acdb6f6af1f02f with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:11:10.165694 30101 tablet_replica.cc:333] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:11:10.167872 28477 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 5 to 6, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:10.169860 30101 raft_consensus.cc:2243] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:10.171352 30101 raft_consensus.cc:2272] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:10.174314 30101 ts_tablet_manager.cc:1916] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:10.186080 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:10.192492 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cf5b8cf3c9a478da7deba36d7acbe96 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:10.205436 30102 tablet_replica.cc:333] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:11:10.206527 30102 raft_consensus.cc:2243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:10.207329 30102 raft_consensus.cc:2272] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:10.209895 30102 ts_tablet_manager.cc:1916] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:10.228408 30102 ts_tablet_manager.cc:1929] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:11:10.228840 30102 log.cc:1199] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/7cf5b8cf3c9a478da7deba36d7acbe96
I20260709 13:11:10.230799 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 7cf5b8cf3c9a478da7deba36d7acbe96 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:10.244973 29256 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:10.247146 30071 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:10.255775 30101 ts_tablet_manager.cc:1929] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:11:10.265260 30101 log.cc:1199] T 50de2f4297b44d57a1acdb6f6af1f02f P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/50de2f4297b44d57a1acdb6f6af1f02f
I20260709 13:11:10.268406 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet 50de2f4297b44d57a1acdb6f6af1f02f (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:10.288156 28581 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:10.292289 30035 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:10.423442 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:10.507158 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:10.507930 28579 raft_consensus.cc:606] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:10.523015 28648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:10.523694 28648 raft_consensus.cc:606] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:10.532747 28722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b905a9410ce147d093be203901159c35"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:10.533411 28722 raft_consensus.cc:606] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:10.538527 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:10.539139 28579 raft_consensus.cc:606] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:10.546038 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:10.548043 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:10.603571 28510 debug-util.cc:398] Leaking SignalData structure 0x7b080003cd20 after lost signal to thread 27435
W20260709 13:11:10.604544 28510 debug-util.cc:398] Leaking SignalData structure 0x7b0800091fe0 after lost signal to thread 28513
W20260709 13:11:10.605669 28510 debug-util.cc:398] Leaking SignalData structure 0x7b0800285800 after lost signal to thread 28605
W20260709 13:11:10.606622 28510 debug-util.cc:398] Leaking SignalData structure 0x7b0800248080 after lost signal to thread 28680
W20260709 13:11:10.607527 28510 debug-util.cc:398] Leaking SignalData structure 0x7b0800193ae0 after lost signal to thread 28754
W20260709 13:11:10.608444 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea140 after lost signal to thread 29286
I20260709 13:11:10.678089 30049 raft_consensus.cc:993] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:10.678809 30049 raft_consensus.cc:1081] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:10.680323 28729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:11:10.680835 28729 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.681165 28729 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.688301 28729 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:10.691087 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:10.691650 28574 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:10.691943 28574 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:10.692669 28574 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:10.693668 28574 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.697985 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:10.698685 29259 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.711867 29259 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:10.713129 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:10.713945 28729 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:10.716096 29941 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:10.716691 29941 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:10.717574 29941 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:10.726358 30055 raft_consensus.cc:993] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:10.726917 30055 raft_consensus.cc:1081] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:10.733068 28581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b905a9410ce147d093be203901159c35"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50024
I20260709 13:11:10.733752 28581 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.734184 28581 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.741994 28581 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:10.743633 28574 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:10.744059 28581 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:10.745301 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:10.753031 28729 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.753402 28729 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:10.754179 28729 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:10.755342 28729 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.747742 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:10.758976 28651 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.761621 28477 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 2, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.772924 30066 raft_consensus.cc:993] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:10.773509 30066 raft_consensus.cc:1081] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:10.782644 28729 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:10.785972 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:10.788333 30049 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.788882 30049 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:10.789741 30049 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:10.796110 29259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46388
I20260709 13:11:10.796739 29259 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.797170 29259 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.804590 29259 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:10.811642 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:10.812302 28579 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.825969 28476 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 3, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.827497 28651 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:10.830909 28579 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:10.832823 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:10.834116 28648 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.834622 28648 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:10.835739 28648 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:10.838143 28648 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.847177 28574 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.847723 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:10.848827 30010 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.849361 30010 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:10.850386 30049 raft_consensus.cc:993] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:10.850229 30010 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:10.850901 30049 raft_consensus.cc:1081] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:10.854281 28656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:10.854923 28656 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.855301 28656 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.833346 29259 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:10.866084 28479 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 3 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.869549 28656 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:10.875270 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:10.875869 28729 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.878371 28648 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:10.885779 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:10.890969 28579 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:10.891950 28579 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:10.893219 28579 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:10.902710 28579 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:10.909118 28656 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:10.903167 28729 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:10.910974 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:10.911811 30035 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:10.912295 30035 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:10.913214 30035 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:10.931403 28579 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:10.958045 28478 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:11.139801 29259 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:11.141427 30108 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:11.187319 28579 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:11.192003 29941 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:11.238159 28579 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:11.240087 30030 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:11.264861 28648 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:11.268074 30030 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:11.278851 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49187.2us
I20260709 13:11:11.295884 28579 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.297658 30066 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:11.305172 28651 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:11.306778 29874 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:11.335326 28527 auto_rebalancer.cc:629] Failed to schedule move for tablet 04a304ac38c74ef5af43514ad1732e01: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:11.344645 28579 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:11.427749 28722 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:11.433547 30035 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:11.462265 28547 consensus_peers.cc:597] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b0cf1ebd07944b7aec6c6ff6e22de83. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:11.468313 28648 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:11.470216 30049 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:11.482664 28729 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:11.485798 28730 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:11.501746 30038 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:11.503756 29874 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:11.508184 29874 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:11.510879 28651 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:11.570431 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:11.577713 28479 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:11:11.756721 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44302.8us
W20260709 13:11:11.818936 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 102609us
I20260709 13:11:11.851521 28729 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:11.869143 28730 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:11:11.908171 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 84520.8us
I20260709 13:11:11.912335 30147 ts_tablet_manager.cc:933] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:11:11.920312 30147 tablet_copy_client.cc:323] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:11:11.923995 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:11:11.924804 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-2b0cf1ebd07944b7aec6c6ff6e22de83
I20260709 13:11:11.946480 28591 tablet_copy_source_session.cc:215] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:11.951086 30147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:11.957247 28574 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:11.958389 28656 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:11:11.959770 28696 consensus_peers.cc:597] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f19fc0b4baf8421e9b460fa2e2eb4b8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:11.962487 30128 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:11.964826 30128 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:12.015311 30055 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:12.025720 28574 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:12.041054 30147 tablet_copy_client.cc:806] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:12.041875 30147 tablet_copy_client.cc:670] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:12.043408 28479 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.048034 30147 tablet_copy_client.cc:538] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:11:12.056806 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52963.9us
I20260709 13:11:12.059397 30147 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:12.070387 28650 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:12.071434 28648 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:12.112861 30147 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:12.114189 30147 tablet_bootstrap.cc:492] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:12.114984 30147 ts_tablet_manager.cc:1403] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.008s
I20260709 13:11:12.118455 30147 raft_consensus.cc:359] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:12.119447 30147 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:12.120254 30147 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:12.123438 30147 ts_tablet_manager.cc:1434] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:11:12.126039 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-2b0cf1ebd07944b7aec6c6ff6e22de83 received from {username='slave'} at 127.0.0.1:54208
I20260709 13:11:12.126827 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-2b0cf1ebd07944b7aec6c6ff6e22de83 on tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:12.160672 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:12.213578 28622 consensus_peers.cc:597] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ce0ec29e76b45f59ccace895ac58f28. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:12.238722 28730 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:12.263213 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:12.264214 28574 raft_consensus.cc:606] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:12.268990 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:12.269698 28656 raft_consensus.cc:606] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:12.271093 30138 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:12.278291 28722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:12.278928 28722 raft_consensus.cc:606] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:12.281607 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:12.283473 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:12.296576 28574 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:12.323021 30055 raft_consensus.cc:993] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:12.323776 30126 raft_consensus.cc:1081] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:12.325768 28648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50992
I20260709 13:11:12.326509 28648 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.326995 28648 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.335065 29256 raft_consensus.cc:1217] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:11:12.337062 30071 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:12.403669 30071 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:12.412601 28729 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:12.429046 30012 raft_consensus.cc:993] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:12.429559 30012 raft_consensus.cc:1081] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:12.432366 28479 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:12.433400 28648 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:12.444772 30147 ts_tablet_manager.cc:933] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:12.452859 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:12.453204 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:12.453655 28722 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.453732 29256 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.454041 28722 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:12.455124 28722 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:12.456269 28722 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.462414 29256 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:12.468534 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:12.477566 30035 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:12.478107 30035 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:12.479049 30035 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:12.484704 28574 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:12.503147 28650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:12.503906 28650 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.505348 28650 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.512383 30137 raft_consensus.cc:993] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:12.513193 28722 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:12.465415 28648 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:12.527093 28650 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:12.529603 28650 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:12.529783 30138 raft_consensus.cc:1081] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:12.532632 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:12.533269 28729 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.533308 30147 tablet_copy_client.cc:323] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:11:12.549283 28729 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:12.549500 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:12.550643 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:12.551857 30157 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:12.551174 28479 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.552361 30157 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:12.550170 28574 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:12.553246 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:11:12.557804 28574 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:12.561196 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet f19fc0b4baf8421e9b460fa2e2eb4b8c from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-f19fc0b4baf8421e9b460fa2e2eb4b8c
I20260709 13:11:12.562333 30157 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:12.561355 28579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:11:12.565030 28579 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.565500 28579 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.564961 28574 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:12.577431 28574 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.595167 28574 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:12.595389 28740 tablet_copy_source_session.cc:215] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:12.595312 28579 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:12.598937 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:12.599149 28579 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:12.599602 28650 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:12.599992 28650 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:12.600679 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:12.601507 28729 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.602864 28650 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:12.604154 28650 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.611095 28729 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:12.612697 28545 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:12.615281 30012 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:12.615869 30012 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:12.616971 30012 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:12.638124 30161 ts_tablet_manager.cc:933] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:12.652380 30161 tablet_copy_client.cc:323] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:11:12.654461 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet 4ce0ec29e76b45f59ccace895ac58f28 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:11:12.655141 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet 4ce0ec29e76b45f59ccace895ac58f28 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-4ce0ec29e76b45f59ccace895ac58f28
I20260709 13:11:12.688175 28650 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:12.689721 28666 tablet_copy_source_session.cc:215] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:12.694778 30161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce0ec29e76b45f59ccace895ac58f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.695478 30147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:12.712953 30139 raft_consensus.cc:1064] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:12.723006 30139 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:12.739053 28479 catalog_manager.cc:5697] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.743888 30147 tablet_copy_client.cc:806] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:12.744635 30147 tablet_copy_client.cc:670] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:12.749675 30161 tablet_copy_client.cc:806] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:12.750010 30147 tablet_copy_client.cc:538] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:12.750418 30161 tablet_copy_client.cc:670] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:12.760030 30161 tablet_copy_client.cc:538] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:12.814685 30147 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:12.817309 30161 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:12.856036 29260 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:12.858136 30012 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:11:12.898607 28479 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.915604 29256 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:12.917836 30157 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:12.915807 30147 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:12.930207 28729 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:12.930835 30147 tablet_bootstrap.cc:492] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:12.931996 30071 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:12.932677 28722 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:12.934103 30147 ts_tablet_manager.cc:1403] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.020s
I20260709 13:11:12.939050 30147 raft_consensus.cc:359] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:12.948807 30147 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:12.943948 30166 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:12.961359 28648 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:12.952292 30147 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:12.980317 30139 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:12.982067 28729 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:12.991734 29260 raft_consensus.cc:1217] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:11:13.008692 30147 ts_tablet_manager.cc:1434] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.004s
I20260709 13:11:13.011874 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-f19fc0b4baf8421e9b460fa2e2eb4b8c received from {username='slave'} at 127.0.0.1:44608
I20260709 13:11:13.012365 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-f19fc0b4baf8421e9b460fa2e2eb4b8c on tablet f19fc0b4baf8421e9b460fa2e2eb4b8c with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:13.036517 30159 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:13.054821 28578 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:13.057857 30157 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:13.088732 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 67302.2us
I20260709 13:11:13.112397 28656 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:13.139925 30161 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:13.146754 30161 tablet_bootstrap.cc:492] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
W20260709 13:11:13.147729 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62698.7us
I20260709 13:11:13.151085 28729 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:13.136327 30012 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:11:13.161466 30161 ts_tablet_manager.cc:1403] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.344s	user 0.043s	sys 0.043s
I20260709 13:11:13.179237 30169 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:13.180612 30173 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:11:13.193992 30139 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:13.209720 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61015.2us
W20260709 13:11:13.222527 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 63519.1us
W20260709 13:11:13.226493 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62442.3us
W20260709 13:11:13.249850 30182 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:11:13.258316 30161 raft_consensus.cc:359] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:13.259284 30161 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:13.260012 30161 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:13.284492 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:13.292986 28730 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:13.386948 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 93087.6us
I20260709 13:11:13.512662 29256 raft_consensus.cc:1217] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 13:11:13.514392 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 136460us
I20260709 13:11:13.491735 30161 ts_tablet_manager.cc:1434] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.292s	user 0.007s	sys 0.001s
I20260709 13:11:13.556981 29259 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:13.581624 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-4ce0ec29e76b45f59ccace895ac58f28 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:11:13.582293 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-4ce0ec29e76b45f59ccace895ac58f28 on tablet 4ce0ec29e76b45f59ccace895ac58f28 with peer d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:13.684865 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 167544us
W20260709 13:11:13.704313 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 217726us
I20260709 13:11:13.765065 28651 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:13.767769 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 96191.1us
W20260709 13:11:13.792008 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 82889us
W20260709 13:11:13.860245 28696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.019s
W20260709 13:11:13.860592 28696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.014s	sys 0.019s
W20260709 13:11:13.860868 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 547395us
W20260709 13:11:13.948300 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 73050.5us
I20260709 13:11:13.950626 28478 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.997192 30035 raft_consensus.cc:1064] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:14.000826 30035 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:14.052796 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.053102 30196 raft_consensus.cc:1064] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:14.059302 29259 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:14.062867 28574 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:14.061292 30157 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:11:14.056339 30196 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:14.065819 30184 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:14.073379 28721 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:14.076117 30214 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:14.165078 30071 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.169693 28721 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.171772 29259 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.176654 28574 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:14.188737 29256 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:14.201032 30211 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:14.211923 28722 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:14.213668 30166 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:14.217723 30139 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.232723 28572 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.250440 29256 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.258114 29252 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:14.274305 28652 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:14.278743 30196 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:14.287433 30203 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:14.311827 28574 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:14.329197 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:14.328745 30196 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:11:14.360257 28477 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.381438 28721 raft_consensus.cc:2955] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.394323 28651 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:14.462581 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:14.463210 28656 raft_consensus.cc:606] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:14.470209 29255 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:14.486671 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:14.487187 28579 raft_consensus.cc:606] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:14.501698 30219 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:14.519384 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47635.8us
I20260709 13:11:14.520443 30071 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:14.521044 28575 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.529717 28572 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:14.518801 28476 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 4 to 5, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.533354 28652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:14.534039 28652 raft_consensus.cc:606] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:14.540570 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:14.542846 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:14.547638 30157 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.574721 29256 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.576366 30214 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:14.589905 28575 raft_consensus.cc:2955] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.518178 29255 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.593850 28652 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.611048 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:14.615687 28476 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.623490 30234 tablet_replica.cc:333] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:11:14.662564 30174 raft_consensus.cc:993] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:14.684212 30174 raft_consensus.cc:1081] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:14.684650 30234 raft_consensus.cc:2243] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.685570 30234 raft_consensus.cc:2272] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.686324 28651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:14.686913 28651 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.687332 28651 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.688935 30234 ts_tablet_manager.cc:1916] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:14.694448 28651 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:14.703250 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:14.703447 28651 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:14.703864 28575 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:14.704197 28575 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:14.704960 28575 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:14.706146 28575 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.738428 28477 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.741062 28575 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:14.745078 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:14.745802 28721 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.748080 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:14.749507 30234 ts_tablet_manager.cc:1929] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:11:14.750124 30234 log.cc:1199] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/2b0cf1ebd07944b7aec6c6ff6e22de83
I20260709 13:11:14.751935 30071 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:14.752120 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 2b0cf1ebd07944b7aec6c6ff6e22de83 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:14.752694 30071 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:14.753630 30071 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:14.755194 28721 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:14.803617 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ce0ec29e76b45f59ccace895ac58f28 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:14.842679 30233 raft_consensus.cc:993] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:14.843266 30189 raft_consensus.cc:1081] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:14.864488 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ce0ec29e76b45f59ccace895ac58f28 with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33252
I20260709 13:11:14.881357 30236 tablet_replica.cc:333] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:11:14.882747 30214 raft_consensus.cc:993] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:14.903760 30236 raft_consensus.cc:2243] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.904721 30236 raft_consensus.cc:2272] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.903621 28721 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:14.911531 28722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33274
I20260709 13:11:14.912101 28722 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.912467 28722 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.913262 28479 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.919867 28722 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:14.921905 28722 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:14.927928 30236 ts_tablet_manager.cc:1916] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:14.945981 29255 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:14.952095 30191 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:14.961809 30055 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.910832 30071 raft_consensus.cc:1081] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:14.981215 28572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:11:14.981912 28572 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.982328 28572 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.988250 29256 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:14.995494 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:14.996148 28651 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:14.996444 28651 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:14.997431 28651 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:14.968222 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:14.998554 28579 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.998859 28651 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.015312 28572 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:15.022184 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:15.022989 28647 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:15.023401 28647 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:15.024427 28652 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:15.024315 28647 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:15.026880 28647 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.027669 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:15.032259 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:15.042394 28722 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.033604 28572 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:15.035156 28651 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:15.035851 28479 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 4 to 5, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 2 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:15.029749 28579 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:15.061647 28647 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:15.062248 28722 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:15.063280 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:15.065253 30211 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:15.065284 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet f19fc0b4baf8421e9b460fa2e2eb4b8c with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50022
I20260709 13:11:15.065915 30211 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:15.066776 30211 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:15.078680 30055 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:15.080000 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:15.085319 30236 ts_tablet_manager.cc:1929] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:11:15.086229 30236 log.cc:1199] T 4ce0ec29e76b45f59ccace895ac58f28 P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/4ce0ec29e76b45f59ccace895ac58f28
I20260709 13:11:15.082653 30219 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:15.087920 30240 tablet_replica.cc:333] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:11:15.089390 30219 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:15.091166 30240 raft_consensus.cc:2243] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.091192 30219 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:15.106222 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet 4ce0ec29e76b45f59ccace895ac58f28 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:15.099263 28651 raft_consensus.cc:2955] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:15.114770 30240 raft_consensus.cc:2272] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.131141 30240 ts_tablet_manager.cc:1916] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:15.149395 28476 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 3 to 4, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 4 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.159729 28479 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 4, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 4 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.201342 30240 ts_tablet_manager.cc:1929] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:11:15.213284 30240 log.cc:1199] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/f19fc0b4baf8421e9b460fa2e2eb4b8c
I20260709 13:11:15.215431 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet f19fc0b4baf8421e9b460fa2e2eb4b8c (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:15.265739 28572 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.271158 30189 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:15.311777 28721 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.313979 30237 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:15.503743 28572 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:15.506069 30055 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:15.519958 28651 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:15.532296 30055 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:15.543876 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:15.650724 28722 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:11:15.651803 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61515.5us
I20260709 13:11:15.653566 30211 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:15.653638 28651 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:15.658489 30211 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:16.179697 28651 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:16.195226 28721 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:11:16.195844 28622 consensus_peers.cc:597] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0817000b219d44bc891d4c9a50a56999. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.200242 30254 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:16.209690 28574 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:16.211635 30254 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:16.288657 28722 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.309432 28572 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.287068 30233 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.358573 28477 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.400453 28574 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:11:16.427038 28547 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e868dee9130744a3bc9fab23a236b03a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.457185 28722 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:16.461931 30198 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:16.466787 28647 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:16.469225 30198 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:16.497884 30198 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.500018 28647 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.558274 28647 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:16.566970 28476 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:11:16.573877 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44963.9us
I20260709 13:11:16.582029 28722 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.642046 30271 ts_tablet_manager.cc:933] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:16.656659 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:16.662163 28622 consensus_peers.cc:597] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1210d5a904b4f328048e3c924967b95. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.666885 28722 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:16.669744 30233 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:16.670333 28572 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:16.671283 30271 tablet_copy_client.cc:323] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:11:16.673271 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet 0817000b219d44bc891d4c9a50a56999 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:11:16.673872 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet 0817000b219d44bc891d4c9a50a56999 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-0817000b219d44bc891d4c9a50a56999
I20260709 13:11:16.684614 30233 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:16.687098 28666 tablet_copy_source_session.cc:215] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:16.691071 30271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0817000b219d44bc891d4c9a50a56999. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.732668 30233 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.746913 28722 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.741509 28572 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.753137 30271 tablet_copy_client.cc:806] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:16.753916 30271 tablet_copy_client.cc:670] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:16.762586 30271 tablet_copy_client.cc:538] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:16.767208 28574 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:16.771505 28476 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.784153 30271 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:16.806666 28722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:16.807441 28722 raft_consensus.cc:606] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:16.810909 28647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:16.811498 28647 raft_consensus.cc:606] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership to TS 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:16.816651 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:16.817217 28572 raft_consensus.cc:606] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:16.821274 28647 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:16.823025 30270 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:16.827099 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:11:16.827162 28547 consensus_peers.cc:597] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5e88af67eea4aa588b7cf82a03a9c3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:16.828884 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:16.849279 28722 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:16.850685 30271 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:16.850885 30211 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:16.851842 30271 tablet_bootstrap.cc:492] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:16.852703 30271 ts_tablet_manager.cc:1403] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.080s	user 0.031s	sys 0.000s
I20260709 13:11:16.857933 30271 raft_consensus.cc:359] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:16.859932 30271 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:16.861244 30271 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:16.871274 30271 ts_tablet_manager.cc:1434] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:11:16.891805 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-0817000b219d44bc891d4c9a50a56999 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:11:16.892325 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-0817000b219d44bc891d4c9a50a56999 on tablet 0817000b219d44bc891d4c9a50a56999 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:16.947660 30198 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.954770 30260 raft_consensus.cc:993] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:16.955439 30233 raft_consensus.cc:1081] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Signalling peer 178f22d83287460fb8c0db0ba2799895 to start an election
I20260709 13:11:16.966712 28575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
 from {username='slave'} at 127.0.0.1:50032
I20260709 13:11:16.967306 28575 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.967674 28575 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.969965 28723 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:16.979565 28575 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:16.982832 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:16.983398 28721 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.986739 30271 ts_tablet_manager.cc:933] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:11:16.991470 28721 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:16.992939 28476 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.992930 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:16.996582 30251 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:16.997133 30251 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:16.998059 30251 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:17.003335 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:16.998011 28575 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:17.007431 28647 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:17.012089 28647 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:17.011660 28652 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:17.018894 28647 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:17.020246 28647 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.026733 30271 tablet_copy_client.cc:323] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:11:17.030368 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet e868dee9130744a3bc9fab23a236b03a from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:11:17.031010 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet e868dee9130744a3bc9fab23a236b03a from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-e868dee9130744a3bc9fab23a236b03a
I20260709 13:11:17.044760 30251 raft_consensus.cc:993] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:17.045472 30270 raft_consensus.cc:1081] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:17.047240 29259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46396
I20260709 13:11:17.047755 29259 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.048089 29259 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.061604 30055 raft_consensus.cc:993] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:17.062330 30055 raft_consensus.cc:1081] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:17.067243 29259 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:17.079088 28591 tablet_copy_source_session.cc:215] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:17.079922 29259 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:17.081696 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:17.087528 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:17.088201 28572 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:17.088371 28721 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.088624 28572 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:17.092155 28572 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:17.093691 28572 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.084848 28647 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:17.081398 28477 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.105445 28572 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
W20260709 13:11:17.108042 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 52376us
I20260709 13:11:17.111773 28647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50992
I20260709 13:11:17.112432 28647 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.112867 28647 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.114327 30271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e868dee9130744a3bc9fab23a236b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.115527 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:17.116459 28721 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:17.118387 30280 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:17.118979 30280 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:17.119871 30280 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:17.138046 28647 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:17.146346 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:17.147059 28721 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:17.147396 28721 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:17.148358 28721 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:17.149698 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:17.149901 28721 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.150393 29259 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:17.151520 28647 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:17.141811 30286 ts_tablet_manager.cc:933] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:17.160158 29259 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:17.161616 28721 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:17.161577 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:17.178123 30189 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.178663 30189 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:17.162371 28479 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 3 to 4, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 4 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.179665 30189 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:17.193048 30271 tablet_copy_client.cc:806] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:17.193938 30271 tablet_copy_client.cc:670] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:17.196182 30286 tablet_copy_client.cc:323] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
W20260709 13:11:17.228956 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 67456.6us
I20260709 13:11:17.229312 28479 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.240531 30271 tablet_copy_client.cc:538] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:17.282558 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet e1210d5a904b4f328048e3c924967b95 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:11:17.283128 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet e1210d5a904b4f328048e3c924967b95 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-e1210d5a904b4f328048e3c924967b95
I20260709 13:11:17.291512 28666 tablet_copy_source_session.cc:215] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:17.315647 29259 raft_consensus.cc:1217] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:11:17.326560 30286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1210d5a904b4f328048e3c924967b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.351751 30271 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:17.362808 30286 tablet_copy_client.cc:806] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:17.363656 30286 tablet_copy_client.cc:670] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:17.373104 30286 tablet_copy_client.cc:538] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:17.384112 30286 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:17.440790 30271 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:17.441838 30271 tablet_bootstrap.cc:492] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:17.446942 30271 ts_tablet_manager.cc:1403] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.095s	user 0.028s	sys 0.000s
I20260709 13:11:17.450201 30271 raft_consensus.cc:359] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:17.451160 30271 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:17.451905 30271 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:17.456578 30271 ts_tablet_manager.cc:1434] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:11:17.459112 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-e868dee9130744a3bc9fab23a236b03a received from {username='slave'} at 127.0.0.1:54208
I20260709 13:11:17.459568 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-e868dee9130744a3bc9fab23a236b03a on tablet e868dee9130744a3bc9fab23a236b03a with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:17.470028 30271 ts_tablet_manager.cc:933] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
I20260709 13:11:17.497210 28723 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:17.501689 30198 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:17.558701 28721 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:17.560078 30207 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:17.585543 28647 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:17.595206 29259 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:17.595227 29256 raft_consensus.cc:1217] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:11:17.598441 30259 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:17.689611 30198 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:17.709728 28575 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:17.711560 30207 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:17.714239 30233 raft_consensus.cc:1064] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:17.716784 30233 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:17.739468 29259 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:17.741297 30260 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:17.755524 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 54745.6us
I20260709 13:11:17.830363 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:17.851804 30297 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:11:17.875618 30298 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:11:17.890074 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 157324us
I20260709 13:11:17.920538 28723 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:17.951908 28723 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:11:17.952528 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 57733.7us
W20260709 13:11:18.119203 30271 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.121s	sys 0.175s
W20260709 13:11:18.119601 30271 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.122s	sys 0.175s
I20260709 13:11:18.120234 30271 tablet_copy_client.cc:323] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
W20260709 13:11:18.127928 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 84542.5us
W20260709 13:11:18.146304 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 114194us
I20260709 13:11:18.166893 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet c5e88af67eea4aa588b7cf82a03a9c3d from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:11:18.167565 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet c5e88af67eea4aa588b7cf82a03a9c3d from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-c5e88af67eea4aa588b7cf82a03a9c3d
I20260709 13:11:18.176914 28591 tablet_copy_source_session.cc:215] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:18.211891 30271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e88af67eea4aa588b7cf82a03a9c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.227234 30312 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:18.237749 30286 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:18.238737 30286 tablet_bootstrap.cc:492] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:18.239423 30286 ts_tablet_manager.cc:1403] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.856s	user 0.028s	sys 0.017s
I20260709 13:11:18.240845 30314 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:18.244508 28572 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:18.255592 30286 raft_consensus.cc:359] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:18.275914 30286 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:18.276839 30286 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:18.279835 30286 ts_tablet_manager.cc:1434] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:11:18.288062 30312 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:18.310386 30271 tablet_copy_client.cc:806] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:18.310506 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-e1210d5a904b4f328048e3c924967b95 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:11:18.311022 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-e1210d5a904b4f328048e3c924967b95 on tablet e1210d5a904b4f328048e3c924967b95 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:18.311131 30271 tablet_copy_client.cc:670] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:18.315315 30271 tablet_copy_client.cc:538] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:18.326341 30271 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:18.359596 30312 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.368644 28572 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.392580 28721 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.406301 29259 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.415772 30271 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:18.423475 30271 tablet_bootstrap.cc:492] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:18.424261 30271 ts_tablet_manager.cc:1403] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.002s
I20260709 13:11:18.424733 28476 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.426934 30271 raft_consensus.cc:359] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:18.432068 30313 raft_consensus.cc:1064] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:18.436733 30313 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:18.445415 30271 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:18.449121 30271 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:18.453573 30271 ts_tablet_manager.cc:1434] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:11:18.455628 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-c5e88af67eea4aa588b7cf82a03a9c3d received from {username='slave'} at 127.0.0.1:54208
I20260709 13:11:18.456233 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-c5e88af67eea4aa588b7cf82a03a9c3d on tablet c5e88af67eea4aa588b7cf82a03a9c3d with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:18.464043 28721 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:18.464469 28647 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:18.465646 30310 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:18.468047 29259 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:18.474594 30294 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:18.483429 30310 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:18.523962 29256 raft_consensus.cc:1217] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:11:18.551407 30211 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.558480 28723 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.565376 28651 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:18.597023 29259 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:18.598914 28476 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.601681 30308 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:18.603395 28722 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:18.607366 28647 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.609266 30312 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:18.613821 29259 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.620905 30233 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.635226 28721 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.663841 28575 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:18.700614 29259 raft_consensus.cc:2955] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.704135 28476 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 4 to 5, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.713353 28722 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:18.714990 30211 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:18.723521 29255 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:18.729147 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet 0817000b219d44bc891d4c9a50a56999 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50022
I20260709 13:11:18.733734 30310 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:18.745936 30251 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.754516 29255 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.761806 29256 raft_consensus.cc:1217] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:18.790716 28722 raft_consensus.cc:2955] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.808126 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0817000b219d44bc891d4c9a50a56999 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:18.815455 28479 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 4 to 5, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:18.831459 30333 tablet_replica.cc:333] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:11:18.832603 30333 raft_consensus.cc:2243] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.833494 30333 raft_consensus.cc:2272] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.846624 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet e868dee9130744a3bc9fab23a236b03a with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:18.863318 30333 ts_tablet_manager.cc:1916] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:18.864955 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e868dee9130744a3bc9fab23a236b03a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:18.909240 30334 tablet_replica.cc:333] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:11:18.910385 30334 raft_consensus.cc:2243] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:18.911149 30334 raft_consensus.cc:2272] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:18.943645 30334 ts_tablet_manager.cc:1916] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:18.963856 30333 ts_tablet_manager.cc:1929] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:11:18.964439 30333 log.cc:1199] T 0817000b219d44bc891d4c9a50a56999 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/0817000b219d44bc891d4c9a50a56999
I20260709 13:11:18.966287 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet 0817000b219d44bc891d4c9a50a56999 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:19.001402 30334 ts_tablet_manager.cc:1929] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:11:19.002065 30334 log.cc:1199] T e868dee9130744a3bc9fab23a236b03a P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/e868dee9130744a3bc9fab23a236b03a
I20260709 13:11:19.003844 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet e868dee9130744a3bc9fab23a236b03a (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:19.121889 30251 raft_consensus.cc:1064] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:19.124523 30251 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:19.141971 29259 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:19.143512 30251 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.144518 28647 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:19.146032 30310 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.152436 28721 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:19.157051 30251 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.198472 30310 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.204937 29255 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.215653 28647 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.291460 30312 raft_consensus.cc:1064] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:19.293885 28721 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.294277 30312 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:19.298492 28478 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.296660 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:19.327253 28572 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:19.360097 29255 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.363118 30307 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.360332 28721 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.370507 30308 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:19.370836 28575 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:19.378067 30308 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:19.407171 29256 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:19.409130 30211 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:19.414508 28647 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:19.416253 30211 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:19.419364 30251 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.430558 29255 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.462849 30307 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.473146 29259 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.477734 28647 raft_consensus.cc:2955] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.509760 28476 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 4 to 5, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.512789 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5e88af67eea4aa588b7cf82a03a9c3d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:19.511767 28476 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:19.563293 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61128.8us
I20260709 13:11:19.562947 28721 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.584872 28575 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.592882 28647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:19.593520 28647 raft_consensus.cc:606] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:19.596014 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet c5e88af67eea4aa588b7cf82a03a9c3d with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33252
I20260709 13:11:19.596604 28647 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:19.600584 30344 tablet_replica.cc:333] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:11:19.600929 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:19.601567 28574 raft_consensus.cc:606] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:19.601832 30344 raft_consensus.cc:2243] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:19.602869 30344 raft_consensus.cc:2272] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:19.605775 29259 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:19.606211 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:19.607432 30340 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.607890 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:19.614256 30344 ts_tablet_manager.cc:1916] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:19.617415 30308 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.624099 29259 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.640359 28722 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:19.644132 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1210d5a904b4f328048e3c924967b95 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:19.659456 30312 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:11:19.666648 28722 raft_consensus.cc:2955] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:19.673669 30344 ts_tablet_manager.cc:1929] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:11:19.674217 30344 log.cc:1199] T c5e88af67eea4aa588b7cf82a03a9c3d P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/c5e88af67eea4aa588b7cf82a03a9c3d
I20260709 13:11:19.676252 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet c5e88af67eea4aa588b7cf82a03a9c3d (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:19.678773 28476 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.697217 30307 raft_consensus.cc:993] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:19.697671 30307 raft_consensus.cc:1081] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:19.699752 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet e1210d5a904b4f328048e3c924967b95 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:11:19.706507 28721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33274
I20260709 13:11:19.707410 28721 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:19.707850 28721 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.740010 28721 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:19.742965 28721 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:19.745326 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:19.745944 28647 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:19.746234 28647 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:19.746978 28647 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:19.748179 28647 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.749804 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:19.750427 28574 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.751894 30346 tablet_replica.cc:333] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:11:19.753520 30346 raft_consensus.cc:2243] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:19.754231 30346 raft_consensus.cc:2272] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:19.758952 30346 ts_tablet_manager.cc:1916] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:19.763919 28574 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:19.765354 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:19.766280 30345 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:19.766793 30345 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:19.766943 28647 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:19.767771 30345 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:19.799065 30346 ts_tablet_manager.cc:1929] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:19.799602 30346 log.cc:1199] T e1210d5a904b4f328048e3c924967b95 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/e1210d5a904b4f328048e3c924967b95
I20260709 13:11:19.801164 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet e1210d5a904b4f328048e3c924967b95 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:19.831123 28476 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.962853 30211 raft_consensus.cc:993] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:19.963436 30211 raft_consensus.cc:1081] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:19.965423 28647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:19.966076 28647 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:19.966490 28647 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.974289 28647 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:19.977691 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:19.978307 28574 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:19.978631 28574 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:19.979460 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:19.979385 28574 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:19.980099 28721 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.980563 28574 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.995611 28721 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:19.997310 28574 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:19.997746 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:19.996196 28647 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:19.999349 30340 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:20.000168 30340 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:20.001122 30340 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:20.046548 28476 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 4, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 4 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.338656 28574 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:20.439047 28575 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:20.440631 30340 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:20.446161 30345 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:20.527132 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 81355.9us
I20260709 13:11:20.528910 28649 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:11:20.532166 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85527.5us
I20260709 13:11:20.534228 28721 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:20.539817 30307 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:20.566188 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 127789us
I20260709 13:11:20.573503 30285 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:20.608884 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:21.115469 28647 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
W20260709 13:11:21.123020 28622 consensus_peers.cc:597] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a055ab5c44004b99a22596b86a4c2a45. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.123117 28575 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:21.132750 28721 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:21.133920 30308 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:21.139024 30308 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:21.148398 30364 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.174319 28722 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:21.151520 28575 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.182617 28476 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index -1 to 5, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 4 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.194439 28721 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:11:21.204094 28696 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f0bc7b3c800463996a3d14ce7e5786f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.205152 28647 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:21.206848 30368 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:21.204173 28575 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:21.209544 30365 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:21.235276 30368 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.242203 28574 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.305941 28575 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:21.292871 28647 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.326397 28479 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 5, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 4 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
W20260709 13:11:21.355396 28547 consensus_peers.cc:597] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 220149aed66a471b9a682f9229ae53fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.382472 28649 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.384555 30355 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:21.400085 28721 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.419664 30251 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.465349 30355 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.485602 28649 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.538563 28721 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.553092 28722 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:21.556449 28478 catalog_manager.cc:5697] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.610311 30381 ts_tablet_manager.cc:933] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:21.617087 30382 ts_tablet_manager.cc:933] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:21.619096 30381 tablet_copy_client.cc:323] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.2:39245
I20260709 13:11:21.621790 28666 tablet_copy_service.cc:140] P 0c0ecde0af494dc9b152dee191c6d3e6: Received BeginTabletCopySession request for tablet a055ab5c44004b99a22596b86a4c2a45 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:49584)
I20260709 13:11:21.622375 28666 tablet_copy_service.cc:161] P 0c0ecde0af494dc9b152dee191c6d3e6: Beginning new tablet copy session on tablet a055ab5c44004b99a22596b86a4c2a45 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:49584: session id = d64d870625d6461b89b1fb75cd2e26e0-a055ab5c44004b99a22596b86a4c2a45
W20260709 13:11:21.623456 28696 consensus_peers.cc:597] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ff2d657aad54bbe97b4cda17edf3957. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.625499 30382 tablet_copy_client.cc:323] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:11:21.626320 28649 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.628331 30365 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:21.631309 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 5f0bc7b3c800463996a3d14ce7e5786f from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:11:21.631880 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 5f0bc7b3c800463996a3d14ce7e5786f from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-5f0bc7b3c800463996a3d14ce7e5786f
I20260709 13:11:21.644837 28575 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:21.648335 28666 tablet_copy_source_session.cc:215] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:21.649636 30365 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:21.650303 28740 tablet_copy_source_session.cc:215] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:21.654120 30381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a055ab5c44004b99a22596b86a4c2a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.660477 30382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0bc7b3c800463996a3d14ce7e5786f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.693545 30381 tablet_copy_client.cc:806] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:21.694268 30381 tablet_copy_client.cc:670] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:21.746654 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:21.833498 30381 tablet_copy_client.cc:538] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:21.852483 30368 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:21.895447 30381 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:21.915534 30382 tablet_copy_client.cc:806] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:21.927194 30382 tablet_copy_client.cc:670] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:21.948813 28478 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.954372 30382 tablet_copy_client.cc:538] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:21.970019 28649 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:22.019611 28574 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:22.027117 30389 ts_tablet_manager.cc:933] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115)
W20260709 13:11:22.041153 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 63752.7us
W20260709 13:11:22.081178 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67812.8us
I20260709 13:11:22.089618 30389 tablet_copy_client.cc:323] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.1:36115
I20260709 13:11:22.095745 28591 tablet_copy_service.cc:140] P 178f22d83287460fb8c0db0ba2799895: Received BeginTabletCopySession request for tablet 220149aed66a471b9a682f9229ae53fd from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:54208)
I20260709 13:11:22.096505 28591 tablet_copy_service.cc:161] P 178f22d83287460fb8c0db0ba2799895: Beginning new tablet copy session on tablet 220149aed66a471b9a682f9229ae53fd from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:54208: session id = d64d870625d6461b89b1fb75cd2e26e0-220149aed66a471b9a682f9229ae53fd
I20260709 13:11:22.099539 30382 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:22.143672 28591 tablet_copy_source_session.cc:215] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:22.174628 30389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220149aed66a471b9a682f9229ae53fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:22.209180 30396 ts_tablet_manager.cc:933] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:22.245635 30396 tablet_copy_client.cc:323] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:11:22.254359 30389 tablet_copy_client.cc:806] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:22.255321 30389 tablet_copy_client.cc:670] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:22.255350 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 1ff2d657aad54bbe97b4cda17edf3957 from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:11:22.256083 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 1ff2d657aad54bbe97b4cda17edf3957 from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-1ff2d657aad54bbe97b4cda17edf3957
I20260709 13:11:22.263233 30389 tablet_copy_client.cc:538] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:22.268123 28740 tablet_copy_source_session.cc:215] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:22.274982 30381 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.282997 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff2d657aad54bbe97b4cda17edf3957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:22.293722 30381 tablet_bootstrap.cc:492] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:22.294646 30381 ts_tablet_manager.cc:1403] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.400s	user 0.047s	sys 0.005s
I20260709 13:11:22.310490 30381 raft_consensus.cc:359] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:22.311486 30381 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:22.331436 30389 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:22.312268 30381 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:22.335805 30382 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.336848 30382 tablet_bootstrap.cc:492] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:22.337684 30382 ts_tablet_manager.cc:1403] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.238s	user 0.036s	sys 0.012s
I20260709 13:11:22.352260 30381 ts_tablet_manager.cc:1434] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260709 13:11:22.353062 30382 raft_consensus.cc:359] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:22.354090 30382 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:22.354849 30382 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:22.357904 30382 ts_tablet_manager.cc:1434] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:11:22.362067 28666 tablet_copy_service.cc:342] P 0c0ecde0af494dc9b152dee191c6d3e6: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-a055ab5c44004b99a22596b86a4c2a45 received from {username='slave'} at 127.0.0.1:49584
I20260709 13:11:22.362612 28666 tablet_copy_service.cc:434] P 0c0ecde0af494dc9b152dee191c6d3e6: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-a055ab5c44004b99a22596b86a4c2a45 on tablet a055ab5c44004b99a22596b86a4c2a45 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:22.364022 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-5f0bc7b3c800463996a3d14ce7e5786f received from {username='slave'} at 127.0.0.1:44608
I20260709 13:11:22.364610 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-5f0bc7b3c800463996a3d14ce7e5786f on tablet 5f0bc7b3c800463996a3d14ce7e5786f with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:22.393980 28647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:22.394893 28647 raft_consensus.cc:606] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:22.395797 30396 tablet_copy_client.cc:806] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:22.396530 30396 tablet_copy_client.cc:670] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:22.398774 28721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d30c923964844ccad86f6776b30b074"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:22.399392 28721 raft_consensus.cc:606] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:22.408897 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:22.410899 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:22.447352 30396 tablet_copy_client.cc:538] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:22.484099 29259 raft_consensus.cc:1217] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:11:22.502118 30396 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:22.535017 30389 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.535984 30389 tablet_bootstrap.cc:492] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:22.536747 30389 ts_tablet_manager.cc:1403] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.206s	user 0.018s	sys 0.009s
I20260709 13:11:22.540179 30396 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:22.541349 30396 tablet_bootstrap.cc:492] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:22.542186 30396 ts_tablet_manager.cc:1403] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.008s
I20260709 13:11:22.542223 30389 raft_consensus.cc:359] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:22.548177 30389 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:22.548978 30389 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:22.551674 30389 ts_tablet_manager.cc:1434] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:11:22.547168 30396 raft_consensus.cc:359] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:22.553200 30396 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:22.553839 28591 tablet_copy_service.cc:342] P 178f22d83287460fb8c0db0ba2799895: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-220149aed66a471b9a682f9229ae53fd received from {username='slave'} at 127.0.0.1:54208
I20260709 13:11:22.554390 28591 tablet_copy_service.cc:434] P 178f22d83287460fb8c0db0ba2799895: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-220149aed66a471b9a682f9229ae53fd on tablet 220149aed66a471b9a682f9229ae53fd with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:22.564428 29259 raft_consensus.cc:1217] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:11:22.555919 30396 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:22.574323 30396 ts_tablet_manager.cc:1434] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 13:11:22.581223 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-1ff2d657aad54bbe97b4cda17edf3957 received from {username='slave'} at 127.0.0.1:44608
I20260709 13:11:22.581698 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-1ff2d657aad54bbe97b4cda17edf3957 on tablet 1ff2d657aad54bbe97b4cda17edf3957 with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:22.626865 30312 raft_consensus.cc:993] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:22.627596 30392 raft_consensus.cc:1081] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Signalling peer d64d870625d6461b89b1fb75cd2e26e0 to start an election
I20260709 13:11:22.632709 29256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:46388
I20260709 13:11:22.633598 29256 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.634002 29256 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.648976 29256 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:22.656777 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:22.657599 28574 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.670485 28574 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:22.672430 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:22.678728 30207 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.679258 30207 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:22.680158 30207 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:22.688817 29259 raft_consensus.cc:1217] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:22.695075 29256 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:22.695744 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:22.696478 28649 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:22.696858 28649 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:22.697769 28649 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:22.699373 28649 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.732386 28649 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:22.751479 28478 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:22.793439 30402 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:22.812534 30369 raft_consensus.cc:993] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:22.813421 30391 raft_consensus.cc:1081] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:22.816141 28647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d30c923964844ccad86f6776b30b074"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50992
I20260709 13:11:22.816815 28647 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.817281 28647 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.830606 28647 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:22.832605 28647 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:22.835515 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:22.836148 28574 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.839780 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:22.840509 28721 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:22.840819 28721 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:22.841681 28721 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:22.843077 28721 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.886281 28574 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:22.887609 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:22.888566 30308 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:22.889066 30308 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:22.889946 30308 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:22.899971 28721 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:22.923643 28478 catalog_manager.cc:5697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.064080 30340 raft_consensus.cc:1064] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:23.076175 29255 raft_consensus.cc:1217] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:23.148609 30391 raft_consensus.cc:1064] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:23.151935 30391 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:23.284380 28574 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:23.287400 30390 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:23.295655 30340 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:23.311374 30394 raft_consensus.cc:1064] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:23.329119 30394 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:23.382239 28649 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:23.412371 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:23.475564 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 103390us
W20260709 13:11:23.492514 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 142068us
W20260709 13:11:23.533658 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 148921us
W20260709 13:11:23.534075 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 105743us
W20260709 13:11:23.552233 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 74009.9us
W20260709 13:11:23.579357 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 64292us
I20260709 13:11:23.655448 30424 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:23.691362 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 94483.2us
I20260709 13:11:23.718894 28722 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:23.729100 29256 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.724468 28650 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:23.720919 30428 raft_consensus.cc:1064] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:23.734234 29256 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:23.736541 30428 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:23.790218 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 80092.3us
W20260709 13:11:23.795459 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49221us
I20260709 13:11:23.806623 30308 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:11:23.824867 30434 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:11:23.830724 29256 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEARNER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:23.834699 28649 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.847694 30422 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:11:23.907032 30421 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:23.907301 30440 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:23.915205 28730 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:23.924422 28575 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:23.925024 28581 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:23.975361 30211 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 13:11:24.002969 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 227694us
I20260709 13:11:24.036990 28725 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:24.038420 28648 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:24.039458 30428 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:24.043581 30428 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:24.050925 30407 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:11:24.051992 28581 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:24.009212 30440 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:11:24.139506 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 105395us
I20260709 13:11:24.141184 30413 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:11:24.142550 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 312915us
I20260709 13:11:24.154781 29258 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:11:24.161656 30454 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.205s	user 0.004s	sys 0.000s
I20260709 13:11:24.070713 30340 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:11:24.239979 28572 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:11:24.248862 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 184845us
I20260709 13:11:24.279647 30427 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:11:24.305526 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61745.1us
I20260709 13:11:24.304497 30426 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:24.336359 30456 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:11:24.333055 30426 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:24.356150 30443 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:24.348255 30392 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.393990 28579 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.444905 28729 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.486088 30426 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:24.479357 29260 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.503821 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:24.505103 29254 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.527146 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:24.458503 30439 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.534005 28650 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.539119 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:24.540436 30432 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.545694 29256 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.569248 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:24.547829 28722 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.606101 28547 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:11:24.640074 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 79498.3us
W20260709 13:11:24.658110 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52135.8us
I20260709 13:11:24.658716 30434 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:24.662024 28574 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.668638 28647 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.702144 29260 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.719786 28476 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.740422 28479 catalog_manager.cc:5697] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } attrs { replace: true } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.779036 28650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:11:24.779696 28650 raft_consensus.cc:606] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:24.796728 28651 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:24.804016 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:24.805760 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:24.791419 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 71474.3us
I20260709 13:11:24.669221 30451 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:11:24.982985 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 204017us
I20260709 13:11:24.985416 28572 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.073441 28647 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:25.084007 28478 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } attrs { replace: true } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.086066 28478 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 5 to 6, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.109941 29259 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:25.113732 30407 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:25.145257 30419 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.152806 29255 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.154995 28721 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:25.159811 28726 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:25.169490 28574 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:25.175752 29254 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:25.179286 28647 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:25.179402 29260 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:25.180621 30482 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:25.181049 30432 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:25.190115 30482 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:25.195852 28650 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.207788 29260 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:25.209453 30416 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.219542 30414 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:25.222441 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 220149aed66a471b9a682f9229ae53fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:25.232452 30482 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.245605 29256 raft_consensus.cc:2955] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.254108 30485 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.259727 29254 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.261431 29260 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.282383 28579 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:25.283628 28721 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:25.277963 28477 catalog_manager.cc:5697] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index 3 to 4, VOTER ed517a03edd141a798f07798667c1c04 (127.26.202.3) evicted. New cstate: current_term: 1 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.296710 28651 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:25.309589 30440 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:25.305514 30363 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:11:25.348328 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44145.8us
I20260709 13:11:25.349691 28479 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 6 to 7, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 4 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.357512 30439 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:11:25.373413 28647 raft_consensus.cc:2955] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.392030 28465 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a055ab5c44004b99a22596b86a4c2a45 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:25.407507 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1ff2d657aad54bbe97b4cda17edf3957 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:25.418853 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f0bc7b3c800463996a3d14ce7e5786f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:25.423825 28726 raft_consensus.cc:2955] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.435005 30429 raft_consensus.cc:993] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:25.435608 30419 raft_consensus.cc:1081] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:25.445533 28718 tablet_service.cc:1558] Processing DeleteTablet for tablet 220149aed66a471b9a682f9229ae53fd with delete_type TABLET_DATA_TOMBSTONED (TS ed517a03edd141a798f07798667c1c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33252
I20260709 13:11:25.450431 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet a055ab5c44004b99a22596b86a4c2a45 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:50022
I20260709 13:11:25.452435 30491 tablet_replica.cc:333] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:11:25.453603 30491 raft_consensus.cc:2243] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.453418 28479 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 reported cstate change: config changed from index 6 to 7, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 4 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.454453 30491 raft_consensus.cc:2272] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.466533 28579 raft_consensus.cc:2955] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.471558 28721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33274
I20260709 13:11:25.472184 28721 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:25.472666 28721 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:25.488052 30491 ts_tablet_manager.cc:1916] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:25.505199 30490 tablet_replica.cc:333] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:11:25.513686 28477 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:25.527107 30491 ts_tablet_manager.cc:1929] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:11:25.527839 30491 log.cc:1199] T a055ab5c44004b99a22596b86a4c2a45 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/a055ab5c44004b99a22596b86a4c2a45
I20260709 13:11:25.528066 28721 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:25.529884 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet a055ab5c44004b99a22596b86a4c2a45 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:25.534263 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0bc7b3c800463996a3d14ce7e5786f with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:25.534453 30490 raft_consensus.cc:2243] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.535338 30490 raft_consensus.cc:2272] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.537709 30492 tablet_replica.cc:333] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:11:25.561159 30490 ts_tablet_manager.cc:1916] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:25.561578 30492 raft_consensus.cc:2243] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.562804 30492 raft_consensus.cc:2272] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.563344 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:25.539016 28568 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ff2d657aad54bbe97b4cda17edf3957 with delete_type TABLET_DATA_TOMBSTONED (TS 178f22d83287460fb8c0db0ba2799895 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50022
I20260709 13:11:25.563974 28647 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:25.564312 28647 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:25.557760 28721 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:25.559034 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:25.564992 29252 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:25.565208 28647 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:25.566342 30491 tablet_replica.cc:333] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:11:25.566425 28647 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:25.567446 30491 raft_consensus.cc:2243] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:25.568118 30491 raft_consensus.cc:2272] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:25.573261 29252 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:25.574693 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:25.575554 30363 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:25.576074 30363 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:25.584005 30363 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:25.578488 30491 ts_tablet_manager.cc:1916] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:25.580641 30492 ts_tablet_manager.cc:1916] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:25.576114 28647 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:25.597426 30490 ts_tablet_manager.cc:1929] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:25.598064 30490 log.cc:1199] T 220149aed66a471b9a682f9229ae53fd P ed517a03edd141a798f07798667c1c04: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/wals/220149aed66a471b9a682f9229ae53fd
I20260709 13:11:25.599917 28464 catalog_manager.cc:5028] TS ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): tablet 220149aed66a471b9a682f9229ae53fd (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:25.623397 28475 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.629499 30492 ts_tablet_manager.cc:1929] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:11:25.630084 30492 log.cc:1199] T 5f0bc7b3c800463996a3d14ce7e5786f P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/5f0bc7b3c800463996a3d14ce7e5786f
I20260709 13:11:25.631078 30491 ts_tablet_manager.cc:1929] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:25.631721 30491 log.cc:1199] T 1ff2d657aad54bbe97b4cda17edf3957 P 178f22d83287460fb8c0db0ba2799895: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/wals/1ff2d657aad54bbe97b4cda17edf3957
I20260709 13:11:25.632179 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 5f0bc7b3c800463996a3d14ce7e5786f (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:25.635011 28465 catalog_manager.cc:5028] TS 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): tablet 1ff2d657aad54bbe97b4cda17edf3957 (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
I20260709 13:11:25.807121 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:26.169044 28647 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:26.170846 30482 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.195977 29252 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:26.198043 30482 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.916780 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:27.901643 30502 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:27.902231 30502 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:27.904695 30502 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:27.939513 30502 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:27.940213 30502 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:27.942531 30502 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:27.947278 30437 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:27.947856 30437 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:27.949761 30437 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:27.955181 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:27.955704 30436 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:27.956226 30436 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:27.958496 30436 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:27.960490 30437 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:27.960768 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:27.961138 30437 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:27.963188 30437 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:27.963297 30502 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:27.963964 30502 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:27.967573 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:27.973697 30502 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.017853 30499 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.018483 30499 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.022315 30499 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.023108 30499 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:11:28.025810 28510 debug-util.cc:398] Leaking SignalData structure 0x7b080019d900 after lost signal to thread 27435
I20260709 13:11:28.026304 30508 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.070045 30508 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.071069 30499 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.072419 30508 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.040784 30419 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.073243 30419 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.073740 30499 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.074303 30499 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.075290 30419 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.076651 30434 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.077303 30437 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.077162 30434 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.077848 30437 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.079311 30434 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.080081 30437 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.040675 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.047008 30503 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.082787 30503 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.047521 30501 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.048285 30436 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.086311 30436 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.086654 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.086745 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.088325 30434 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.088929 30434 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.090711 30503 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.091841 30510 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.092306 30434 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.053280 30512 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.093217 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.093456 30512 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.066644 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.067466 28721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:28.055910 30513 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.085244 30501 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.096187 28653 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:28.096307 28721 raft_consensus.cc:606] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:28.070533 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08002590e0 after lost signal to thread 28513
I20260709 13:11:28.068821 30507 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.097877 30501 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:28.098181 28510 debug-util.cc:398] Leaking SignalData structure 0x7b080003cee0 after lost signal to thread 28605
W20260709 13:11:28.099511 28510 debug-util.cc:398] Leaking SignalData structure 0x7b0800249a40 after lost signal to thread 28680
I20260709 13:11:28.099049 30513 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.098443 30512 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:28.100541 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3220 after lost signal to thread 28754
I20260709 13:11:28.088948 30436 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.090111 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.101627 30513 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.094956 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:28.095433 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.103425 30437 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.103447 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.104682 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:28.105602 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.106531 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:28.103693 30436 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.103492 28648 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 1.
I20260709 13:11:28.108228 30501 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.108961 30501 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.042857 30509 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.110059 30509 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.111141 30501 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.107465 30436 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.097501 30507 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.112408 30509 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:28.112982 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08003923e0 after lost signal to thread 29286
I20260709 13:11:28.113572 30436 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.114091 30507 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.055327 30506 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.117134 30436 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.116916 30506 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.117630 30436 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.118347 30437 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.118872 30437 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.119798 30436 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.120376 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.120843 30437 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.122994 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.124341 30419 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.124876 30419 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.124382 30513 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.125953 30513 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.126847 30419 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.127336 30419 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.127835 30513 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.128306 30513 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.128731 30513 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.129806 30419 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.130741 30513 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.131943 30419 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.136675 30437 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.137878 30437 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.139830 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.140374 30436 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.140417 29252 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:11:28.140997 30436 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.139384 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:28.142311 30504 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:28.142673 30504 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.143030 30504 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.143124 30436 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.143785 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:28.145174 30449 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:28.074846 30499 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.145660 30449 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.145944 30507 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.146180 30449 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.146481 30507 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.147778 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.148344 29252 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:11:28.092417 30510 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.149482 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.145694 30437 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.150931 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.156832 30499 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.157964 30504 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.145038 30506 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.163506 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.166661 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.170045 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.152002 30507 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.171427 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.172824 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.173357 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.174186 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.174782 29252 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:11:28.174723 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:28.172132 29251 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:11:28.179912 28721 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:28.182366 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.184286 30504 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:28.186287 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:28.187498 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.193480 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:28.192268 30509 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:28.193449 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:28.194284 30509 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.194823 30509 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.194334 28648 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.198156 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.199256 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.199849 28726 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:28.201148 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.198808 28730 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:28.172250 30510 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.202924 30501 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.203405 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.203357 30516 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.203469 30501 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.188516 30507 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.206420 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.223941 30449 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.235206 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.235971 29251 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:28.236199 30429 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:28.236627 30429 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.237028 30429 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.237336 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.237845 30449 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.238044 30502 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.224694 30419 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.238708 30419 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.229209 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.229943 30501 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.233721 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.239732 28724 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:28.234385 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.241048 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.241302 30502 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.242566 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.240670 30419 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.226905 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.245920 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.232652 30511 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.245602 30502 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.246593 30511 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.258474 30511 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.249082 28648 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:28.249521 30419 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.250226 30507 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.254776 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.260113 28722 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:11:28.255915 30517 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.255952 30510 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.261161 30510 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.261847 30449 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.262406 30449 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.263286 30510 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:28.259889 30419 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.264176 30507 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:28.265241 30449 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.265250 30419 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.204236 30516 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.279698 28651 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:28.279739 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48200.9us
I20260709 13:11:28.248306 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:28.286168 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:28.287640 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.284845 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:28.290915 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.297401 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.300920 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:28.270205 30517 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.298529 30514 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:28.303658 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.298209 30513 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:28.281569 30429 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.302439 30449 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:28.278812 30509 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.300287 30504 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.302924 30511 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.304893 30514 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.320536 30518 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.321106 30514 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.317713 30508 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.310665 30513 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.315551 30502 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:28.321241 30518 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.333268 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:28.334121 29251 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 2: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:28.309983 30510 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:11:28.334880 30502 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.335429 30513 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.321751 30449 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:28.337433 30502 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.338356 30449 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.340294 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.340873 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.330086 30508 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.342163 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.343940 30508 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.319567 30504 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.345276 30515 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:28.345742 30515 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.346122 30515 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.325527 30509 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.346406 30504 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.347196 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:28.348273 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:28.349457 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.351055 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.337317 30505 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.352190 30500 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:28.352633 30500 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:28.353286 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 57428.1us
I20260709 13:11:28.330456 30519 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.354692 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.355763 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.325865 30517 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.354696 30500 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.352563 30505 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.361673 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.355029 30501 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.325752 30511 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.334151 30516 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:28.387606 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51791.3us
I20260709 13:11:28.353186 30434 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:28.389765 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.390983 30509 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:28.395025 30508 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.398187 30509 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.399739 30508 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.400424 30429 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.400832 30511 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.401467 30509 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.397447 30503 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.393577 30434 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.401815 30508 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.402339 30416 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.403894 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:28.402261 30434 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.405993 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.403983 30416 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.406689 30505 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.402231 30503 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.408520 30517 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:28.408855 30510 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.409152 30517 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:28.411312 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.411643 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.411999 28575 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:28.414176 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.412755 30503 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.409618 30510 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.414278 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:28.408541 30416 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.403728 30513 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.418551 30437 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.418678 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.419066 30437 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.419456 30437 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.406109 30516 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.423758 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.424018 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.425316 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.428387 30520 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.429677 30516 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.417682 30518 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.432062 30517 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:28.446411 28696 consensus_peers.cc:597] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 -> Peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Couldn't send request to peer d64d870625d6461b89b1fb75cd2e26e0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6caf9ec933124d00b3e0e2cfeccd317b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.448093 30516 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.447292 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.449889 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.457865 30501 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.448884 30520 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.458194 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:28.439191 30416 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.450899 30499 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.470600 30499 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.471561 30502 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.472693 30499 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.478871 30520 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.501782 30522 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.479337 30510 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:28.479828 30513 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.480564 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.480588 30517 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.513731 30510 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:28.514439 30510 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.486017 30434 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.486748 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:28.473186 30523 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:11:28.516184 30528 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.516222 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.509061 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.473949 30500 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.521526 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:28.502785 30522 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.390232 30519 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.522182 28729 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.477479 30514 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.528887 30522 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.529476 30434 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.530617 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.531163 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:28.539353 28724 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.539891 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.532008 28547 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.542366 30500 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.542359 30501 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.543746 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:28.531587 30502 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.540038 30514 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.546676 29251 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:28.549343 30519 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.553375 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:28.553455 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.554208 28722 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.533944 30510 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.556142 28575 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:28.560945 28724 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:28.563279 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:28.509996 30515 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.565423 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:28.536688 28475 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 3 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.567324 30510 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.567898 30510 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.568081 30437 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.569720 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:28.569913 30510 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.568459 30515 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.572304 30434 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:28.600833 30434 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:28.601909 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.602003 30434 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.567365 28572 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:28.591253 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.583297 29252 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:28.581249 28722 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:28.605307 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:28.606699 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:28.607612 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.581952 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.591420 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.585851 28729 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:28.602537 30524 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:11:28.609268 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.609413 30520 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.610019 30520 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.609319 28721 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:28.633229 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.633548 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.637851 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.639249 30524 consensus_queue.cc:1243] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:28.640213 30499 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.613842 30510 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.642362 30510 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.642678 30501 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:28.643314 30501 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:28.644737 30519 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.648320 30437 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.648947 30519 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.615188 30500 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:28.651538 30517 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:28.652290 30500 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:28.653182 30516 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:28.653568 30516 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:28.653748 30500 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.654418 30516 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.655718 30516 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.657634 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.658380 28721 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 2: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:28.659205 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.631270 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.661438 28729 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:28.644431 30510 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:28.664652 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.665059 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.665583 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.667364 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.668795 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.668970 30520 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:28.670233 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.670485 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.670677 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.671141 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.671851 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:28.672057 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.672231 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.673147 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.673283 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.673501 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:28.673725 28725 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:28.517086 30528 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.674649 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.675705 30528 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:28.676836 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.589601 30449 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:11:28.678766 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.679008 30449 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:28.679422 30449 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:28.680414 30449 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.687048 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.683054 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.685698 28724 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:28.682504 28572 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.688294 28649 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:28.688485 30499 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:28.702752 30499 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:28.702911 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.703408 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.703890 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:28.703680 30499 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.705468 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.708493 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.709553 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:28.711036 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:28.681737 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.688323 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.644455 30501 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.688488 30519 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:28.715435 30501 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.693305 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:28.694003 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 110460us
I20260709 13:11:28.697724 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.698159 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.694042 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.715505 30437 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.687215 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:28.718899 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.719244 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.720651 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.726553 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.729908 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.734817 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.740844 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.743620 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:28.745095 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:28.701689 30449 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.749578 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.760910 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.769559 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.766016 30505 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:28.759747 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.796684 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.797705 30517 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.799042 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.799891 30517 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.801499 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.803421 30517 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.807485 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.757318 30519 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:28.812577 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 91693.3us
I20260709 13:11:28.758112 30518 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:28.809264 30419 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.817224 30529 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:28.817646 30529 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:28.795152 30502 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.795341 30525 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:28.821280 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 95658.9us
I20260709 13:11:28.829788 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.833222 29223 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.833673 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:28.813146 30509 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.836369 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.840674 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.842456 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.849136 28722 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:28.853375 30531 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.836185 30519 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.824698 30518 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:28.859620 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 48121.7us
I20260709 13:11:28.857260 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.838692 30436 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.856653 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:28.861141 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 90251.8us
I20260709 13:11:28.861593 30536 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.861757 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:28.862022 30530 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:11:28.862875 30531 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.867571 30518 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:28.868285 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.868886 30519 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.854082 28649 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:28.872720 30530 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:28.855295 30528 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.850907 30510 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.874477 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.882365 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.885756 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.876045 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.892899 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.893529 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.894037 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.895027 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.896425 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.891489 28476 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.897893 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.898307 29223 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.900169 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:28.901386 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:28.901827 28546 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.904620 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.896826 30429 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.885922 30531 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:28.923787 30531 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:28.924253 30531 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.910909 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:28.911772 29223 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.925724 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.910842 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:28.914230 30416 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.874178 30529 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.914629 30504 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:28.915159 30534 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.892731 30434 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.911444 30503 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.899335 30513 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.912925 30516 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.913888 30505 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:28.912626 30515 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.909636 30419 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.899770 30437 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.897493 30508 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.942557 30526 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.926867 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:28.890281 30517 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.944868 28695 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.897782 30518 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.935706 28578 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:28.930962 30525 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.947712 30522 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.928844 30507 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.938195 30504 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:28.929925 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:28.949405 28581 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:28.951459 30525 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:28.957146 30504 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:28.960116 28722 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:28.969516 28722 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:28.978327 28724 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:28.980569 30419 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:28.981559 30419 consensus_queue.cc:1243] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:28.982064 30508 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:28.985090 30508 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:28.986124 30508 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:28.989156 30539 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.950736 30526 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.998651 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.999857 28724 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 2: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:29.013497 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:28.977849 30529 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.017045 30508 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.022982 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.032868 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.037912 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.039880 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.045154 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:29.045892 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 118880us
I20260709 13:11:29.054468 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:29.055454 28724 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 2: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:29.049775 30536 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:11:29.085243 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.059844 30449 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:11:29.107539 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.124604 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:29.134804 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.142679 28653 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:29.143121 28653 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:29.143898 28653 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:29.144822 28653 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.148590 30505 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:29.140978 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:29.155946 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.157135 28653 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:29.159924 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:29.159924 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:29.160312 28578 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:29.163928 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:29.164000 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:29.164471 30434 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:29.164692 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:29.165732 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.166000 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:29.165198 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:29.166819 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:29.168315 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.174322 28654 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:29.177767 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 115135us
I20260709 13:11:29.182976 30513 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:29.184166 30513 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.197443 28648 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.199697 30434 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:29.140393 30531 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:29.211767 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:29.184546 30513 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:29.220641 28722 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:29.222869 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:29.225731 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:29.227276 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:29.243225 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.224409 30517 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:29.233918 30528 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:29.233769 30516 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:29.232456 30530 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:29.242108 30501 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:11:29.304936 30518 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:29.318138 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62132.9us
W20260709 13:11:29.322192 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 57459.2us
I20260709 13:11:29.339712 29252 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:29.341120 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:29.342996 30554 ts_tablet_manager.cc:933] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Initiating tablet copy from peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:29.345335 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:29.357692 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.364611 28722 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:29.343041 30531 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:29.369779 30538 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:29.323988 30513 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:29.373829 30499 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:29.376482 30429 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:29.376995 30429 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:29.377892 30429 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:29.379410 30429 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.384016 28647 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:29.361930 30529 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:29.401317 30542 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:11:29.416639 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 173560us
I20260709 13:11:29.421695 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.424285 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.425450 29252 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:29.433288 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.430717 30419 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:29.438833 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.440595 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.437179 30540 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:29.432096 30538 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:29.451094 28722 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:29.437681 30506 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:29.462473 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.468119 28575 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:29.476142 28475 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.463506 30419 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:29.460258 30505 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:11:29.492924 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.550858 30419 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:29.607616 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 114765us
I20260709 13:11:29.495373 30520 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:29.608562 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.547458 30538 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:29.628090 28479 catalog_manager.cc:5697] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.629462 30511 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:29.630102 30511 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:29.630599 28479 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 3, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.609226 30561 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:29.632472 30511 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:29.646431 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:29.653040 30506 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:29.652318 30511 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:29.653611 30506 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:29.654008 30511 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:29.655759 30506 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:29.660166 30513 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:29.666365 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 54586.7us
I20260709 13:11:29.670034 30511 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:29.672174 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 63700.3us
I20260709 13:11:29.672923 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.674160 28620 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.675154 30564 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:29.675371 30518 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:29.675865 30564 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:29.676530 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:29.676942 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.706758 28724 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:29.730350 30554 tablet_copy_client.cc:323] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Beginning tablet copy session from remote peer at address 127.26.202.3:40339
I20260709 13:11:29.732566 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:29.736919 28648 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:29.706823 30511 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:29.763171 28740 tablet_copy_service.cc:140] P ed517a03edd141a798f07798667c1c04: Received BeginTabletCopySession request for tablet 6caf9ec933124d00b3e0e2cfeccd317b from peer d64d870625d6461b89b1fb75cd2e26e0 ({username='slave'} at 127.0.0.1:44608)
I20260709 13:11:29.763792 28740 tablet_copy_service.cc:161] P ed517a03edd141a798f07798667c1c04: Beginning new tablet copy session on tablet 6caf9ec933124d00b3e0e2cfeccd317b from peer d64d870625d6461b89b1fb75cd2e26e0 at {username='slave'} at 127.0.0.1:44608: session id = d64d870625d6461b89b1fb75cd2e26e0-6caf9ec933124d00b3e0e2cfeccd317b
I20260709 13:11:29.774451 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.777135 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.789997 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:29.761819 30522 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:29.836490 30522 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:29.837131 30522 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:29.838354 30522 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:29.840265 30522 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:29.849496 30507 consensus_queue.cc:1175] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d64d870625d6461b89b1fb75cd2e26e0" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:11:29.851492 30499 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:29.974030 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 199845us
I20260709 13:11:29.824046 30520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44596 (request call id 17) took 1654 ms. Trace:
I20260709 13:11:29.983805 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.986945 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.988214 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:29.996083 30561 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:29.985090 30516 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:11:30.014084 28479 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 reported cstate change: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:30.016754 30516 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:30.026208 30516 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:30.027753 30516 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:29.998617 30513 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:30.029774 30516 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:29.990064 30506 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:29.985107 30520 rpcz_store.cc:276] 0709 13:11:28.167060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.167179 (+   119us) service_pool.cc:224] Handling call
0709 13:11:28.192851 (+ 25672us) log.cc:844] Serialized 499 byte log entry
0709 13:11:29.821389 (+1628538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34778,"raft.queue_time_us":97791,"raft.run_cpu_time_us":1881,"raft.run_wall_time_us":9098,"thread_start_us":121451,"threads_started":2,"wal-append.queue_time_us":125370,"wal-append.run_cpu_time_us":3837,"wal-append.run_wall_time_us":1210545}
I20260709 13:11:30.059489 28740 tablet_copy_source_session.cc:215] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:30.087772 30554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6caf9ec933124d00b3e0e2cfeccd317b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.138882 30554 tablet_copy_client.cc:806] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:30.139569 30554 tablet_copy_client.cc:670] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:30.155385 30554 tablet_copy_client.cc:538] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:30.172386 30499 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:30.173347 30499 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.176362 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:30.177031 28729 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:30.177517 30499 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:30.178086 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:30.178879 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:30.185616 29259 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:30.186167 30524 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:30.186630 30524 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:30.187032 30524 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.206696 30554 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap starting.
I20260709 13:11:30.228217 28649 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } } }
I20260709 13:11:30.204330 30524 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.248083 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:30.249132 29259 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:30.248912 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:30.290488 30554 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:30.291530 30554 tablet_bootstrap.cc:492] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Bootstrap complete.
I20260709 13:11:30.291646 30524 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:30.292339 30554 ts_tablet_manager.cc:1403] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.008s
I20260709 13:11:30.295882 30554 raft_consensus.cc:359] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:30.296821 30554 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Initialized, Role: LEARNER
I20260709 13:11:30.297562 30554 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: NON_VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: true } }
I20260709 13:11:30.308146 30554 ts_tablet_manager.cc:1434] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:11:30.314345 28722 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:30.315708 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:30.317196 30524 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:30.318032 30524 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:30.319013 30524 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.333053 28740 tablet_copy_service.cc:342] P ed517a03edd141a798f07798667c1c04: Request end of tablet copy session d64d870625d6461b89b1fb75cd2e26e0-6caf9ec933124d00b3e0e2cfeccd317b received from {username='slave'} at 127.0.0.1:44608
I20260709 13:11:30.333480 28740 tablet_copy_service.cc:434] P ed517a03edd141a798f07798667c1c04: ending tablet copy session d64d870625d6461b89b1fb75cd2e26e0-6caf9ec933124d00b3e0e2cfeccd317b on tablet 6caf9ec933124d00b3e0e2cfeccd317b with peer d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:30.373715 28475 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 4 to 5, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.381757 29259 raft_consensus.cc:1217] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:30.453326 30577 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:30.453963 30577 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.457765 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:30.458459 28649 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:30.459667 28695 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:30.461560 30516 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:30.461935 30516 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:30.462299 30516 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.463573 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:30.464545 29251 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:30.466264 30577 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:30.478695 30516 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.484709 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:30.491945 30516 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:30.493598 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:30.511077 28649 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:30.494788 29251 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:30.525130 28695 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:30.521865 30449 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.527361 30577 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:30.530323 30520 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:30.532059 30520 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:30.531944 30577 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.533249 30520 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.536394 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:30.537731 28581 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:30.534945 30577 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:30.537976 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:30.535054 30449 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.554430 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:30.567155 29251 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:30.575259 28696 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:30.577790 30577 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:30.578183 30577 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:30.578527 30577 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.606098 30449 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:30.612534 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:30.616246 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:30.613258 28581 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:30.633677 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:30.636261 30546 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:30.636816 30546 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.637265 30546 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.667647 30546 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.686369 28479 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.706000 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788a727f92304a5a9926b2f15933af88"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:30.706735 28581 raft_consensus.cc:606] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:30.711679 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b905a9410ce147d093be203901159c35"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:30.712294 28581 raft_consensus.cc:606] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:30.715202 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:30.715879 28581 raft_consensus.cc:606] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:30.722851 30525 raft_consensus.cc:993] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:30.723449 30525 raft_consensus.cc:1081] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:11:30.725924 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:30.726459 28726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:11:30.727123 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:30.727061 28726 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:30.727511 28726 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.725785 30577 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.740461 28729 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:30.741112 30577 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:30.742949 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:30.743793 28581 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:30.744709 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:30.745607 29259 raft_consensus.cc:2368] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:30.746927 28696 leader_election.cc:400] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:30.748656 30546 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:30.750108 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:30.755247 28581 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.752106 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:30.758810 28729 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.754107 28696 leader_election.cc:403] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:30.763650 28726 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:30.765856 28726 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:30.767040 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:30.773880 28579 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:30.774191 28579 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:30.774885 28579 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:30.775905 28579 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.777865 28729 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:30.779100 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:30.779342 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:30.779935 28649 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.780009 30546 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:30.780850 30546 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:30.781122 30577 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:30.781810 30546 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.783836 28579 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:30.786391 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:30.787241 30577 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:30.787806 30577 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:30.791769 30577 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:30.771014 28581 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:30.797981 30516 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.798596 30516 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.808192 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:30.808876 28647 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:30.795675 28649 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:30.809964 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:30.811589 30586 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:30.812008 30586 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.812366 30586 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.816735 28479 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.800848 30516 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:30.825088 30586 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.827293 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:30.831036 29259 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:30.836024 30586 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:30.843315 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:30.846637 28647 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.856730 28647 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:30.858083 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:30.860881 30517 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:30.861466 30517 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:30.861886 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:30.862546 29251 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.862417 30517 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.868031 30574 raft_consensus.cc:1064] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: attempting to promote NON_VOTER d64d870625d6461b89b1fb75cd2e26e0 to VOTER
I20260709 13:11:30.882972 30574 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:30.884725 29254 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:30.887111 30501 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:30.955960 28479 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 4 to 5, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.961890 28647 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:30.963945 28581 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:30.966254 30517 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:30.968150 30517 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:30.968354 29259 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 LEARNER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:30.969609 29251 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:30.970587 30586 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:30.984737 28647 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:30.987062 30574 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:31.016259 28476 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.048832 28726 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:31.064566 29252 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:31.066731 30586 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:31.092059 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46984.7us
I20260709 13:11:31.108696 30499 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:11:31.131439 30499 raft_consensus.cc:993] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:31.131882 30499 raft_consensus.cc:1081] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:31.133522 28647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "788a727f92304a5a9926b2f15933af88"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:31.134027 28647 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.134394 28647 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:31.149708 30594 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:11:31.158380 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 57264.4us
I20260709 13:11:31.165197 30516 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:31.178097 29254 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:31.179989 30587 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.194155 30587 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:31.203691 30546 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:31.204365 30546 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:31.206635 30499 raft_consensus.cc:993] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:31.207108 30499 raft_consensus.cc:1081] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:31.207605 30546 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:31.208655 28722 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:31.208779 28648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b905a9410ce147d093be203901159c35"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:11:31.209395 28648 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.209808 28648 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.211730 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:31.212340 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:31.212452 28722 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:31.213948 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:31.213104 28656 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 2: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:31.214956 30545 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:31.216840 30545 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.217252 30545 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:31.217676 30545 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.219062 28648 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:31.220747 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:31.221468 28725 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:31.222792 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:31.228334 28648 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:31.230863 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:31.231695 28725 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.232697 30567 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:31.236414 30567 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.236832 30567 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.230031 28647 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:31.252940 28648 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:31.253686 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:31.254686 30574 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:31.246433 30587 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:31.258512 28647 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:31.258879 28656 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:31.265494 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:31.266170 29254 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:31.267444 28725 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:31.270085 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:31.272042 30506 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:31.272524 30506 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:31.277904 30506 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:31.300660 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:31.301440 28581 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:31.301746 28581 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:31.303314 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:31.303869 28575 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:31.304157 28575 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:31.315163 28572 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:31.317588 28578 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:31.302500 28581 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:31.331249 28575 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:31.338994 28581 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.293190 30586 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:11:31.359905 28575 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:31.365334 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 95337.5us
W20260709 13:11:31.371181 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 55311us
I20260709 13:11:31.376852 28581 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
W20260709 13:11:31.378793 30608 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:11:31.381081 28476 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:31.379663 30545 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:31.344776 30567 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:31.413286 30567 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:31.423580 28575 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:31.434129 29254 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:31.439689 30545 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:31.443456 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:31.451329 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:31.467058 30506 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:31.470417 29254 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:31.472009 28725 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:31.467675 30506 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:31.473685 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:31.473940 30516 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:31.473837 30506 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:31.474515 30611 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.475101 30611 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:31.476039 30611 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:31.551123 30612 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:31.551838 30612 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:31.659068 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 145195us
I20260709 13:11:31.831260 30612 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:31.987010 30546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.007s	sys 0.015s
W20260709 13:11:31.987581 30546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.007s	sys 0.015s
I20260709 13:11:32.104696 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:32.105724 29254 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:32.109925 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.111123 28725 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:32.197661 30528 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.198249 30528 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.200523 30528 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.240545 30528 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.241374 30528 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.244220 30528 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.245213 29223 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:32.254769 28722 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:32.256963 29254 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:32.330997 30546 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.341425 30586 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.348670 30546 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.348945 30586 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.290284 30528 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.353041 30528 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.353394 30546 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.355710 30528 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.314277 30625 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.356995 30625 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.359549 30625 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.314958 30616 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:11:32.362291 30586 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:32.363938 30624 raft_consensus.cc:2764] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:32.368377 30611 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.369261 30611 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.372972 30611 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.373720 30616 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.374464 30616 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.377295 30616 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.380267 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:32.393476 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52057.9us
I20260709 13:11:32.460162 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.464263 30625 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:32.465775 30625 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.459847 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.468719 30528 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.498628 30528 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.506405 30625 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.507181 30625 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.508147 30625 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.518913 30602 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:32.520040 30602 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.533524 30528 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.538795 30546 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.546154 30602 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:32.536978 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.557036 30546 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.559863 30546 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.564211 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.565572 28730 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:32.566066 30614 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:32.566555 30602 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:32.567159 30614 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.567581 30602 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.568883 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:32.569491 30603 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.570379 30603 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.570745 30546 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:32.571273 30546 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.571724 30546 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.570684 30501 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.573705 30501 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.576308 30501 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.553149 30586 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.577873 30517 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.578331 30586 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.578871 30517 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.582913 30611 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.583442 30618 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.583833 30611 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.584280 30618 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.585287 30613 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.586040 30613 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.587504 30618 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.581810 30586 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:32.591593 30586 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.592103 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:32.592679 30586 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.594419 30614 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:32.595587 30586 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:32.596007 28476 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 270) took 1266 ms. Trace:
I20260709 13:11:31.794775 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.597517 30603 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.604979 30546 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.614416 30618 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.614730 30602 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:32.605733 28479 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 4, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 4 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.563184 30528 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.615576 30618 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.588505 30613 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.622807 30528 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:32.625754 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.624579 30517 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.630025 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:32.636755 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53274.7us
I20260709 13:11:32.634554 30528 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:32.628547 30611 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.605222 28476 rpcz_store.cc:276] 0709 13:11:31.329686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.329866 (+   180us) service_pool.cc:224] Handling call
0709 13:11:32.595721 (+1265855us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:31.414160 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:31.414926 (+   766us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:31.414974 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:31.414999 (+    25us) tablet.cc:662] Decoding operations
0709 13:11:31.415422 (+   423us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:31.415498 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:31.415534 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:31.415756 (+   222us) tablet.cc:701] Row locks acquired
0709 13:11:31.415781 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:11:31.415952 (+   171us) write_op.cc:270] Start()
0709 13:11:31.416098 (+   146us) write_op.cc:276] Timestamp: P: 1783602691415903 usec, L: 0
0709 13:11:31.416126 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:11:31.416858 (+   732us) log.cc:844] Serialized 595 byte log entry
0709 13:11:31.431695 (+ 14837us) op_driver.cc:464] REPLICATION: finished
0709 13:11:31.432145 (+   450us) write_op.cc:301] APPLY: starting
0709 13:11:31.432225 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:31.432337 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:31.432446 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:31.432611 (+   165us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:31.432751 (+   140us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:31.432794 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:31.432960 (+   166us) log.cc:844] Serialized 23 byte log entry
0709 13:11:31.433151 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.433230 (+    79us) write_op.cc:454] Released schema lock
0709 13:11:31.433267 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:31.444572 (+ 11305us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.448467 (+  3895us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26981,"reported_tablets":1,"spinlock_wait_cycles":84864,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":1384,"apply.run_wall_time_us":1385,"num_ops":1,"prepare.queue_time_us":5158,"prepare.run_cpu_time_us":3066,"prepare.run_wall_time_us":15309,"replication_time_us":15445}]]}
I20260709 13:11:32.650512 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:32.661937 28572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.309s	user 0.020s	sys 0.037s
W20260709 13:11:32.813163 28572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.460s	user 0.020s	sys 0.037s
I20260709 13:11:32.814255 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2088) took 1503 ms. Trace:
I20260709 13:11:32.814713 28572 rpcz_store.cc:276] 0709 13:11:31.310338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.314461 (+  4123us) service_pool.cc:224] Handling call
0709 13:11:31.314800 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.315027 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:31.326801 (+ 11774us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.813656 (+1486855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.813775 (+   119us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:32.813822 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.813933 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.814151 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24857,"raft.queue_time_us":55124,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":14121,"thread_start_us":1460767,"threads_started":1}
I20260709 13:11:32.649650 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.820312 28730 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:32.650094 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.652671 30614 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:32.709476 30635 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.107393 30635 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.734882 28574 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:32.736116 30618 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.740111 30546 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.743431 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:32.744838 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.112754 30657 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:32.745609 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.113906 30657 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.745826 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:32.748111 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:32.777360 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:32.786361 29222 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.26.202.62:36613, user_credentials={real_user=slave}} blocked reactor thread for 116518us
I20260709 13:11:33.124980 30611 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:33.125639 30611 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.127923 30611 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:33.129458 30649 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.130228 30649 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:32.803660 30602 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:33.132517 30602 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.134716 30602 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:33.132848 30649 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:33.135430 30633 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.136014 30633 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.138235 30633 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:32.828404 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:32.833777 30625 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:32.843144 28547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.501s	user 0.016s	sys 0.014s
W20260709 13:11:33.142200 28547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.800s	user 0.018s	sys 0.014s
I20260709 13:11:32.861727 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.145457 28575 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 1.
I20260709 13:11:32.872254 30632 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:32.874468 30603 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:32.887745 30619 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.892334 30567 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:32.903766 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:32.918587 30586 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.918896 30528 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.929276 30641 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:32.941546 30607 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:32.942840 30639 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:32.946048 30642 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:32.950634 30623 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.952142 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:32.961982 30645 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:32.962080 30506 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:32.966128 30640 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.027331 30648 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:33.019905 30587 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:33.027673 30644 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.031044 30650 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:33.146574 30632 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.154326 30650 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.040593 30647 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.156957 30632 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.157362 30647 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.146951 30603 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.160370 30647 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:33.046242 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 74213.7us
I20260709 13:11:33.089401 30654 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.091385 30653 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.090605 28475 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 385) took 1639 ms. Trace:
I20260709 13:11:33.095606 30651 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.098845 30652 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:33.099906 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 54026.5us
I20260709 13:11:33.141541 30657 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.142340 30662 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:33.147253 30619 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.107391 30614 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.147439 30567 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.148095 30586 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.147475 30601 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.045404 30643 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:33.150993 29223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.020s	sys 0.019s
I20260709 13:11:33.160408 30603 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:33.212800 29223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.021s	sys 0.020s
I20260709 13:11:33.211949 30654 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:33.150414 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 198397us
I20260709 13:11:33.149158 30607 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.157621 30632 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:33.184603 28475 rpcz_store.cc:276] 0709 13:11:31.448353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.449343 (+   990us) service_pool.cc:224] Handling call
0709 13:11:33.087930 (+1638587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1147930,"reported_tablets":2}
I20260709 13:11:33.214886 28653 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:33.146219 30663 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.149782 30642 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.198366 30653 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.201148 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:33.201377 30652 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.203302 28479 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 374) took 1771 ms. Trace:
I20260709 13:11:33.203761 30662 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.206212 30619 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.204438 30624 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:33.207922 30614 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.150781 30506 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.209172 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:33.209441 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:33.209758 30567 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.151230 30648 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.211587 30586 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.148574 30528 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.212185 30601 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.150547 30645 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.151787 30587 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.150903 30640 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.149533 30639 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.148998 30641 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.153640 30644 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.150055 30623 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.216135 30654 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.287194 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:33.153684 30664 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.220427 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:33.438439 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.455072 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.345573 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.517753 30607 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:33.518739 30528 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:33.515820 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 130305us
I20260709 13:11:33.415897 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.479956 30632 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:33.218879 28476 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.385097 30517 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.523402 30632 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.531121 30517 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.532554 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:33.533314 28725 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:33.533587 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.534318 28652 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:33.535290 30642 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.535480 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.533301 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.382715 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:33.283244 30655 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.342496 30546 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.438779 30613 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:33.532547 28722 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:33.201196 30651 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.536136 28652 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:11:33.295109 30635 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.539592 30625 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:33.518488 30663 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.294234 30657 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.382671 30665 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.471936 30616 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:33.548764 30651 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.490461 30650 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.554126 28650 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:33.554661 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:33.579301 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 378246us
I20260709 13:11:33.301813 30647 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:33.556056 30623 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:33.555855 30546 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.481874 28479 rpcz_store.cc:276] 0709 13:11:31.431710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.431876 (+   166us) service_pool.cc:224] Handling call
0709 13:11:33.203222 (+1771346us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:32.714231 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:32.715342 (+  1111us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:32.715407 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:11:32.715435 (+    28us) tablet.cc:662] Decoding operations
0709 13:11:32.716012 (+   577us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:32.716124 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:32.716173 (+    49us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:32.716595 (+   422us) tablet.cc:701] Row locks acquired
0709 13:11:32.716656 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:11:32.716992 (+   336us) write_op.cc:270] Start()
0709 13:11:32.717265 (+   273us) write_op.cc:276] Timestamp: P: 1783602692716816 usec, L: 0
0709 13:11:32.717299 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:11:32.718335 (+  1036us) log.cc:844] Serialized 538 byte log entry
0709 13:11:32.767074 (+ 48739us) op_driver.cc:464] REPLICATION: finished
0709 13:11:32.768405 (+  1331us) write_op.cc:301] APPLY: starting
0709 13:11:32.768480 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:32.768624 (+   144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:32.768755 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:32.769091 (+   336us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:32.769369 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:32.769420 (+    51us) write_op.cc:312] APPLY: finished
0709 13:11:32.770068 (+   648us) log.cc:844] Serialized 23 byte log entry
0709 13:11:32.770286 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:32.770379 (+    93us) write_op.cc:454] Released schema lock
0709 13:11:32.770439 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:32.771098 (+   659us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:32.771117 (+    19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1474757,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1099,"apply.run_cpu_time_us":2033,"apply.run_wall_time_us":2680,"num_ops":1,"prepare.queue_time_us":86804,"prepare.run_cpu_time_us":8232,"prepare.run_wall_time_us":47062,"raft.queue_time_us":11863,"raft.run_cpu_time_us":1300,"raft.run_wall_time_us":1301,"replication_time_us":49631,"thread_start_us":97808,"threads_started":4,"wal-append.queue_time_us":28434}]]}
I20260709 13:11:33.556910 30632 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.212430 30643 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.539700 30654 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.527216 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:33.662045 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.589679 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:33.628840 30660 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:33.651917 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:33.656903 30663 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.660046 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:33.575911 30619 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:33.556819 30613 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.567145 30528 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:11:33.688325 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:33.522970 30664 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.567145 30655 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.697520 29223 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:33.803603 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:33.581949 30607 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:33.804481 28677 debug-util.cc:398] Leaking SignalData structure 0x7b080033fa00 after lost signal to thread 27435
W20260709 13:11:33.856559 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800342b00 after lost signal to thread 28513
I20260709 13:11:33.847246 28724 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.657989 30602 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:33.859409 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 161948us
I20260709 13:11:33.871585 30659 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.871981 30587 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.739195 30650 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:33.873181 27437 debug-util.cc:398] Leaking SignalData structure 0x7b0800218a40 after lost signal to thread 30546
I20260709 13:11:33.816712 30601 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.653317 30665 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.846086 30623 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:33.805081 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:33.893288 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800149e00 after lost signal to thread 28605
I20260709 13:11:33.725790 30647 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:33.900542 28677 debug-util.cc:398] Leaking SignalData structure 0x7b080019d840 after lost signal to thread 28680
W20260709 13:11:33.901664 28677 debug-util.cc:398] Leaking SignalData structure 0x7b080019d860 after lost signal to thread 28681
W20260709 13:11:33.903563 28677 debug-util.cc:398] Leaking SignalData structure 0x7b08000caf00 after lost signal to thread 28754
W20260709 13:11:33.905350 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800399aa0 after lost signal to thread 29286
W20260709 13:11:33.905870 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800399be0 after lost signal to thread 29287
I20260709 13:11:33.733666 30654 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.868835 30625 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:33.872387 30659 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.771869 30657 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:33.818727 30619 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.690333 30616 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.915359 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.805364 30660 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:33.935324 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 345737us
I20260709 13:11:33.894232 30607 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.921545 30625 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:33.937803 28654 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:33.889966 30602 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.950644 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:33.953361 29224 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:33.913596 30650 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.945117 30603 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.961406 30667 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:33.947070 30625 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:33.964680 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 190735us
I20260709 13:11:33.945277 30506 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.967223 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.969118 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.969756 30659 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:33.948660 30639 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.973260 28575 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:33.976507 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:33.977051 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47087.4us
I20260709 13:11:33.977945 30645 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:33.978444 30616 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:33.966225 30632 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:33.985177 28724 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:33.986765 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.987072 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.988988 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.991067 30674 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.971205 30546 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:33.972054 30652 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:33.967417 30669 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:34.012403 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:33.994812 30624 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:34.017112 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.017222 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.018069 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.024605 28652 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:34.019170 30644 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:34.019922 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:33.989645 30640 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.022917 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:33.991562 30674 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.972213 30667 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:34.026238 30665 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.021744 30669 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:33.995683 30613 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:33.992280 30653 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.003589 30664 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:34.001313 30643 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:33.985118 30603 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.033223 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.037104 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.037863 30607 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.038056 30647 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:34.038708 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.044806 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.041595 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.041838 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.015640 30641 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:34.049650 30602 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.050624 30619 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.051860 30650 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.054217 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.057760 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.057843 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.058568 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.059478 28580 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:34.060658 30654 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.061913 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.067157 30603 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.069773 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.076268 30660 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.079838 30657 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:34.095119 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 142129us
I20260709 13:11:34.095956 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.096580 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:34.097920 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 83452us
I20260709 13:11:34.094962 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:34.116153 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.119333 30669 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.122259 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.102164 30683 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:34.151378 30667 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:34.153275 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.154021 28652 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:34.155150 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.155851 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.156944 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:34.157178 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.157786 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.155870 28656 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:34.158494 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.153358 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:34.150102 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 58446.4us
I20260709 13:11:34.147646 30673 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:34.162201 30648 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:34.162901 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 61864.2us
I20260709 13:11:34.163589 28580 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:34.163627 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:34.165362 30655 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.166601 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.167635 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.168035 30676 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:34.168792 30674 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.181233 30676 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:34.181926 30676 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.169642 30517 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:34.184247 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.184933 28580 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 1.
I20260709 13:11:34.169377 30625 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.186882 30625 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:34.188639 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.170574 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.198385 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:34.201305 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.201458 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.201798 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.202630 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.202973 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.203768 30517 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:34.202649 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:34.204456 30517 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:34.203828 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.205387 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.205632 28577 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:34.206715 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.204962 30517 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.208170 28578 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:34.210357 30662 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:34.210736 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47209.7us
I20260709 13:11:34.211699 30655 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:34.215831 30655 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:34.217363 30655 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.228823 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.233502 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.233565 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.247798 30685 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:34.249538 28578 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:34.251019 30625 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:34.251819 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:34.251674 30625 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.252645 28652 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 2: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:34.253937 30625 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:34.256809 28547 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.258796 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.266222 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.266816 30645 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:34.266902 28580 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:11:34.269694 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.270777 29254 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:34.272111 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.272289 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.261471 30685 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:34.273480 29259 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:34.274448 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.275828 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.279790 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:34.201174 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.282698 28479 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.285072 28650 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:34.272920 29252 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:34.293514 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.292181 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:34.295169 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56182.4us
I20260709 13:11:34.285499 30625 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:34.296984 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:34.304373 30685 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:34.304968 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:34.305791 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45887.6us
I20260709 13:11:34.311404 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2056) took 1088 ms. Trace:
I20260709 13:11:34.306628 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:34.314507 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.314844 30675 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:34.315285 30675 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.326745 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.317888 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:34.311988 28653 rpcz_store.cc:276] 0709 13:11:33.208761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.209774 (+  1013us) service_pool.cc:224] Handling call
0709 13:11:33.210120 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.214479 (+  4359us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:34.002664 (+788185us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.287160 (+284496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:34.287229 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:34.287288 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.296679 (+  9391us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b54000703d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:34.296724 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.296846 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2354,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3435,"spinlock_wait_cycles":9281792,"thread_start_us":242462,"threads_started":1}
I20260709 13:11:34.328115 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.305135 30685 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.315662 30675 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:34.327055 30625 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.301224 30645 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:34.391247 29224 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.765s (SENT) [suppressed 1 similar messages]
I20260709 13:11:34.392094 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.392441 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.413498 30625 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:34.413932 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.414007 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.393683 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.415266 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.415550 30645 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.416468 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.416730 28572 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:34.395906 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.395939 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.397255 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.398324 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.328697 30673 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:34.317179 30602 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:34.304456 29253 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:34.406520 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 88715.1us
I20260709 13:11:34.405982 28575 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:34.407384 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.415877 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.395704 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.419761 28577 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:34.410252 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:34.420643 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:34.436151 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.436524 30645 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.438426 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:34.440696 29255 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:34.398527 30676 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.440169 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.417917 30647 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:34.446821 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.446131 30501 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:34.449564 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:34.446381 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.453933 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.453058 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.447377 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.440335 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.457165 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:34.458850 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.459368 30635 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:34.459789 30635 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:34.460171 30635 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.460197 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.461195 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.461627 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.462419 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.462781 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.460400 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.464735 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:34.420979 30602 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:34.465834 30602 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.465876 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.432965 30673 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:34.468879 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.469661 29252 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:11:34.468788 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.472450 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.473260 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.473654 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.473946 30639 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:34.474318 30639 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.474709 30639 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:34.474817 30644 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:34.477298 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.476033 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:34.478379 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.444221 30614 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:34.475160 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.481086 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:34.485532 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.447207 30586 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:34.472483 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.455133 30647 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:34.493372 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:34.447021 30674 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:34.475739 30632 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:34.478128 30673 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.506527 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.507462 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.509109 30614 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:34.509734 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.509931 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.479418 30642 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:34.540771 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 53379.1us
I20260709 13:11:34.502617 30647 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.546051 30614 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:34.599646 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:34.605098 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 213870us
I20260709 13:11:34.540899 30674 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:34.563506 30632 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:34.565693 30685 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:34.610746 30690 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.325s	user 0.004s	sys 0.002s
I20260709 13:11:34.626698 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:34.629985 30667 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:34.630154 30661 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:34.631668 30661 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:34.632143 30661 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:34.632452 30694 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:11:34.627741 30693 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:11:34.637074 30667 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:34.637212 30676 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:34.671443 29259 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:34.678251 30660 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:34.679740 30660 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:34.652340 30689 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:11:34.681999 30691 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:11:34.661295 30517 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:34.683746 30669 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:34.662362 30667 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:34.647704 30635 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.687633 30685 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:34.695433 30669 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:11:34.713492 30692 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:11:34.713235 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:34.695008 30667 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.689754 30689 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:34.734026 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 165159us
I20260709 13:11:34.703881 30676 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:34.722162 30685 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:34.761435 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:34.757997 30674 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:34.790728 30635 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.798327 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:34.811424 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 336332us
I20260709 13:11:34.830947 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:11:34.811946 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 332307us
I20260709 13:11:34.774799 30517 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:34.825364 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:34.835227 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.836726 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:34.829380 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:34.768740 30669 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.852173 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:34.841667 30618 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:34.841557 30623 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:34.868242 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:11:34.869844 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 329835us
I20260709 13:11:34.875772 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:34.878280 30675 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.878758 30602 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.880503 30675 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.832336 30676 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:34.881560 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:11:34.947233 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65754.9us
I20260709 13:11:34.928586 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:34.881829 30603 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:34.929607 30501 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:34.932089 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:34.933238 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 96595.5us
I20260709 13:11:34.847467 30635 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:34.942440 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:34.882054 30602 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:34.898856 30623 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:34.930334 30689 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:34.948520 30690 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:11:34.932713 30669 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:34.930070 30687 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:34.997316 30687 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:34.997980 30687 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:34.964520 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 90714us
I20260709 13:11:34.955179 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:34.961925 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:34.966255 30623 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.979590 30661 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:34.968864 30528 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:34.987761 30639 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.013s
I20260709 13:11:34.991242 30614 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:35.032018 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 80744.3us
I20260709 13:11:34.949551 30698 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.033963 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:35.037338 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:35.043709 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:35.051198 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.011323 30676 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:35.062227 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.032953 30528 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:35.033242 30655 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:11:35.071450 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 106661us
I20260709 13:11:35.074973 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:35.081732 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.004856 30667 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.050854 30645 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:35.087404 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50434.9us
W20260709 13:11:35.068955 30673 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
I20260709 13:11:35.065456 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:35.114545 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53661.5us
I20260709 13:11:35.118960 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:35.035601 30639 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.072839 30528 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.088157 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:35.122570 30713 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:35.127571 28573 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 1.
I20260709 13:11:35.127789 30713 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:35.128278 30713 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.113878 30567 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.129971 30661 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:35.135224 30648 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:35.143872 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:35.145134 28620 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:35.145908 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:35.066480 30640 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:11:35.159348 30639 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:35.162837 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:35.086663 30655 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:35.164045 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 98004us
I20260709 13:11:35.165246 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:35.170303 30639 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:35.136905 30685 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:35.174595 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.155659 30675 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.116138 30673 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:35.183255 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 130158us
I20260709 13:11:35.183439 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:35.189338 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 103299us
I20260709 13:11:35.190438 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:35.193194 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.156733 30567 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:35.209347 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.183152 30719 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.216348 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.204903 30661 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.223666 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:35.221177 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.234544 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:35.292630 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:35.217664 30613 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:35.219898 30645 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.219352 30614 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:35.231709 30700 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:35.299533 30690 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:11:35.294488 30716 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:35.296864 30675 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:35.301546 30671 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:35.219220 30713 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.395457 29251 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:35.400534 30687 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:35.401655 30710 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:11:35.233044 30723 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.406082 30687 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:35.389230 30716 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:11:35.403685 30721 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:35.391642 30671 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.391470 30667 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:35.408038 30713 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:35.433544 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 315133us
W20260709 13:11:35.436017 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 290143us
I20260709 13:11:35.436585 29224 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:35.440608 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 319122us
I20260709 13:11:35.441931 28621 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.443622 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.444530 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.427492 30671 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:35.394425 30726 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:35.448127 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.447300 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.437461 30723 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.441175 30655 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:35.435232 30727 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:11:35.482091 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 256620us
I20260709 13:11:35.455178 30713 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.484054 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.483021 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.457324 30673 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:35.483569 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:35.510035 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:35.435660 30716 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:35.488965 30702 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.516626 30716 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.519867 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.522446 28580 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:35.525453 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:35.510594 30715 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:35.523742 30647 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.917s	user 0.016s	sys 0.005s
I20260709 13:11:35.529316 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:35.531737 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.542028 30528 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:35.543793 30623 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:35.543828 30669 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:11:35.550807 28476 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 271) took 2402 ms. Trace:
I20260709 13:11:35.414484 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:35.487783 30727 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.581362 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:35.588405 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.590525 29260 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:35.591050 28581 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.578927 28476 rpcz_store.cc:276] 0709 13:11:33.148584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.151239 (+  2655us) service_pool.cc:224] Handling call
0709 13:11:33.214606 (+ 63367us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5400163d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d80090 00007f4a27e1ef3a 00007f4a2dbd51cc 00007f4a2dcd337e 00007f4a2c1942a4 00007f4a2c194232 00007f4a2c194161 00007f4a2c1940dc 00007f4a2c193392 00007f4a2615148c 00007f4a261508c6
0709 13:11:35.550715 (+2336109us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:33.983605 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:34.011936 (+ 28331us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:34.011968 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:11:34.011984 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:34.047441 (+ 35457us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:34.053192 (+  5751us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:34.053228 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:34.053463 (+   235us) tablet.cc:701] Row locks acquired
0709 13:11:34.053482 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:34.053660 (+   178us) write_op.cc:270] Start()
0709 13:11:34.053787 (+   127us) write_op.cc:276] Timestamp: P: 1783602694053598 usec, L: 0
0709 13:11:34.053813 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:34.079503 (+ 25690us) log.cc:844] Serialized 533 byte log entry
0709 13:11:34.233621 (+154118us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5400163d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e11e28 00007f4a2b84c581 00007f4a2b84bd58 00007f4a2b8509f1 00007f4a2b8509a9 00007f4a2b850939 00007f4a2b850901 00007f4a2b84fb2d 000000000038f354 000000000038f199
0709 13:11:34.449777 (+216156us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:11:34.881386 (+431609us) op_driver.cc:464] REPLICATION: finished
0709 13:11:35.121240 (+239854us) write_op.cc:301] APPLY: starting
0709 13:11:35.125783 (+  4543us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:35.154625 (+ 28842us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:35.156821 (+  2196us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:35.159094 (+  2273us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:35.159261 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:35.159313 (+    52us) write_op.cc:312] APPLY: finished
0709 13:11:35.159518 (+   205us) log.cc:844] Serialized 23 byte log entry
0709 13:11:35.159696 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:35.159766 (+    70us) write_op.cc:454] Released schema lock
0709 13:11:35.159807 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:35.160176 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:35.160204 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":29373312,"child_traces":[["op",{"apply.queue_time_us":191167,"apply.run_cpu_time_us":1897,"apply.run_wall_time_us":70141,"num_ops":1,"prepare.queue_time_us":405981,"prepare.run_cpu_time_us":12543,"prepare.run_wall_time_us":262562,"raft.queue_time_us":192857,"raft.run_cpu_time_us":49115,"raft.run_wall_time_us":171828,"replication_time_us":827384,"spinlock_wait_cycles":14281600,"thread_start_us":363879,"threads_started":4,"wal-append.queue_time_us":205517}]]}
I20260709 13:11:35.600217 30528 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:35.583029 28576 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:35.577755 30647 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:35.605237 30719 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:35.611464 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 376999us
W20260709 13:11:35.597872 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 156019us
I20260709 13:11:35.619663 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:35.595326 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1280022290000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:11:35.622633 29224 connection.cc:256] RPC call timeout handler was delayed by -1.0875022290000516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 13:11:35.620895 28621 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:35.623072 29224 connection.cc:256] RPC call timeout handler was delayed by -1.0274389249999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:11:35.624115 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.625065 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.625334 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.623632 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.629727 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:35.629936 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:35.630349 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:35.630945 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:35.632393 28655 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 2: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:35.633754 30675 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:35.634243 30675 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:35.634469 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.634653 30675 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.635874 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.635951 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.637292 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.638351 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.638769 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.639501 28727 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 2: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:35.640362 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.640450 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.641846 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.644506 28725 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:35.646013 28723 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:35.646196 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.642612 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.647078 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:35.642328 30675 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:35.643002 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.643214 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.643558 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.651126 28725 raft_consensus.cc:2368] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:35.643882 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:35.651503 28724 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:35.622298 30674 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.650211 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.652984 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.653173 30727 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:35.653236 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.660599 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.663376 30623 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:35.663729 30647 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:35.661808 30671 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:35.667347 30671 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:35.674247 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.674170 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:35.621447 30726 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:11:35.677886 28722 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:35.678651 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.680444 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.681962 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:35.702772 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.672732 30723 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.704207 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.701709 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:35.706108 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.700038 30655 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.707261 30715 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.708683 30655 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.699992 30517 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.709154 30715 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:35.710889 30675 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:35.713471 30737 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:35.717821 30737 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:35.718437 30737 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.720921 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:35.723979 30736 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.708839 30739 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.723335 30528 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.730786 28572 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:35.733860 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:35.734786 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.737453 28577 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:35.738250 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:35.742893 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:35.708770 30735 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:35.745115 30735 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:35.745576 30735 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:35.746052 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:35.748088 28576 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:35.748168 30741 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.759725 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.769636 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.770628 28581 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:35.771721 28651 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:35.748981 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.775197 28546 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:35.773731 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.753301 30528 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:35.785876 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:35.787619 30642 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:35.804749 30662 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:35.785386 30722 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.805438 30662 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:35.773772 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.806267 30662 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.787768 30714 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:11:35.788120 30723 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:35.796104 30528 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.819845 29253 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:35.820729 30722 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:35.821342 30722 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.823712 30722 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:35.824141 30735 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:35.829805 30723 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:35.832037 30528 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:35.836200 28479 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 375) took 1564 ms. Trace:
I20260709 13:11:35.861738 29256 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:35.851928 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:35.862397 29258 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.858726 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.863706 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.865476 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:35.873091 29259 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 2: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:35.861584 28479 rpcz_store.cc:276] 0709 13:11:34.271804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.278566 (+  6762us) service_pool.cc:224] Handling call
0709 13:11:35.836128 (+1557562us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:34.305293 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:34.365672 (+ 60379us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:34.365703 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:11:34.365717 (+    14us) tablet.cc:662] Decoding operations
0709 13:11:34.408488 (+ 42771us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:34.417487 (+  8999us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:34.420483 (+  2996us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:34.451887 (+ 31404us) tablet.cc:701] Row locks acquired
0709 13:11:34.451911 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:11:34.458292 (+  6381us) write_op.cc:270] Start()
0709 13:11:34.458525 (+   233us) write_op.cc:276] Timestamp: P: 1783602694458178 usec, L: 0
0709 13:11:34.458578 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:11:34.459833 (+  1255us) log.cc:844] Serialized 533 byte log entry
0709 13:11:35.123751 (+663918us) op_driver.cc:464] REPLICATION: finished
0709 13:11:35.160546 (+ 36795us) write_op.cc:301] APPLY: starting
0709 13:11:35.160610 (+    64us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:35.160710 (+   100us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:35.160819 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:35.162677 (+  1858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:35.180708 (+ 18031us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:35.184993 (+  4285us) write_op.cc:312] APPLY: finished
0709 13:11:35.200963 (+ 15970us) log.cc:844] Serialized 23 byte log entry
0709 13:11:35.212849 (+ 11886us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:35.217695 (+  4846us) write_op.cc:454] Released schema lock
0709 13:11:35.218995 (+  1300us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:35.314136 (+ 95141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:35.314175 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":264735,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":35095,"apply.run_cpu_time_us":2270,"apply.run_wall_time_us":139938,"mutex_wait_us":5221,"num_ops":1,"prepare.queue_time_us":4905,"prepare.run_cpu_time_us":6907,"prepare.run_wall_time_us":159039,"replication_time_us":655657,"thread_start_us":45486,"threads_started":1}]]}
I20260709 13:11:35.879282 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:35.882301 30501 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:11:35.861243 30640 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:11:35.862334 30632 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:11:35.865446 29253 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:35.892812 30742 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:35.893756 30640 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.894203 30640 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:35.895073 30640 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.896445 30640 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:35.898664 30501 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:35.899082 30501 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:35.899463 30735 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:35.899977 30501 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.901947 30685 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:35.902473 30685 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.903779 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.904611 30685 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:35.901206 30501 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.905802 30632 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:35.908154 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 250907us
I20260709 13:11:35.860836 30723 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:35.868083 30727 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.873828 30701 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.914557 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:35.921093 29258 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:35.921885 29260 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:35.917335 28648 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
W20260709 13:11:35.922708 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47269.1us
I20260709 13:11:35.935830 30662 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:35.945109 28721 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:35.945312 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:35.947383 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:35.906176 30632 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:11:35.960259 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46319.4us
I20260709 13:11:35.949945 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:35.912463 30689 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:35.959841 30735 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:11:35.972774 30673 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:35.974315 30673 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:35.974704 30673 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:35.975548 30673 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:35.906330 30716 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:11:35.982275 28724 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:35.981257 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:35.984458 28577 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.945916 30517 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:35.964100 30714 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:35.967629 30701 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:35.988382 28721 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:35.990793 28722 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:35.991253 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 79892.5us
I20260709 13:11:35.993449 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:35.994916 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:35.997381 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.996086 28725 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:35.998055 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.001734 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:36.003669 28620 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.012413 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:35.979420 30689 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.015928 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.003023 30735 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.003929 30714 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:35.996577 30701 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:36.030822 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 64525.6us
I20260709 13:11:36.009327 30736 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.025854 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.011591 30673 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.033557 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.014870 30715 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.011632 30662 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:36.040403 28576 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:36.042114 30669 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.008647 30712 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:11:35.983744 30723 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.050354 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.049088 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:36.030939 30655 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.033380 30701 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.996042 30632 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.042114 30689 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:36.064795 30723 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.071436 28722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:11:36.072234 28722 raft_consensus.cc:606] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:36.075013 30709 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:36.077996 29224 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.101897 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.060760 30716 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.086064 28479 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 3, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:36.048888 30602 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:11:36.055768 30735 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.049515 30702 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:11:36.095715 28475 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 386) took 1730 ms. Trace:
I20260709 13:11:36.098327 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:36.078365 30726 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:36.102607 30747 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.107546 28475 rpcz_store.cc:276] 0709 13:11:34.365442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.391135 (+ 25693us) service_pool.cc:224] Handling call
0709 13:11:36.095646 (+1704511us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11272,"reported_tablets":5}
I20260709 13:11:36.111248 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.114651 29224 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.115641 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.032977 30737 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.045948 30727 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:11:36.124879 30709 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.125353 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.126242 30709 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.127609 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.128530 30709 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.121438 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:36.139205 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:36.110270 30726 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:36.116964 30720 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.116544 30618 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.150415 29260 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:36.150857 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.121554 30623 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:36.154066 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:11:36.144054 30745 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:11:36.130935 30698 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:36.180754 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:11:36.190119 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 79137.9us
I20260709 13:11:36.148054 30632 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.194630 30669 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:36.205940 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 76800.2us
I20260709 13:11:36.198203 30639 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.166842 30722 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:36.162985 30730 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.187166 30655 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.161728 30662 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:11:36.215116 28620 leader_election.cc:400] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:36.218850 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:36.219694 28581 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.169746 30736 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:11:36.228066 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.148496 30714 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.210078 30639 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:36.184867 30698 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.227468 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.242105 28729 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:36.244470 28577 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
W20260709 13:11:36.250082 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.250470 30602 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:36.275837 30623 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.276059 30602 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.253248 30737 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:36.254961 30716 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:36.259243 30739 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.261847 30712 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.301131 30712 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:36.302042 30712 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.303218 30712 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.303777 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:36.215803 30722 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.306753 30722 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:36.270622 30730 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:36.309418 30730 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:36.309818 30730 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:36.310602 30730 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.311812 30730 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:36.312872 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.315380 30669 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.315933 30669 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.316666 30645 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.317813 30645 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:36.318131 30669 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:36.318461 30645 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.274243 30639 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:36.283025 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 59654.6us
I20260709 13:11:36.285580 28572 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:36.284989 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:36.320560 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.289202 28576 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:36.289472 28575 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:36.289721 30602 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:36.291852 30756 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:36.330807 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 176926us
I20260709 13:11:36.293998 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:36.294909 30739 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:36.281127 30662 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.294019 30640 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:11:36.321929 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.335078 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.335922 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.325690 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.328466 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.324695 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.327589 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.292414 28728 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:36.329206 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.339224 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:36.339874 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:36.341239 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:36.341388 28656 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:36.331676 30683 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.342617 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.342872 30729 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.346062 30720 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.346854 30625 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:36.347275 30625 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:36.347802 30625 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.341239 30756 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.351904 28652 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:36.340516 29259 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:36.356210 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:36.338825 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.350298 28654 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:36.358376 30645 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:36.358507 30756 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:36.361673 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.363220 30698 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:36.364740 28547 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.365700 30722 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.367130 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:36.368404 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:36.369019 28654 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:36.369355 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:36.385644 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:36.389623 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52633.3us
I20260709 13:11:36.390250 28581 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:36.391342 30747 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:36.391419 30729 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:36.392256 30747 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:36.392861 30720 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:36.394119 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:36.287609 30716 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:36.401290 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:36.397982 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.397992 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:36.411324 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:36.411716 29259 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 3: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:36.405783 28577 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:36.406569 30739 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.399026 30685 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:36.393608 30720 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:36.410526 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:36.415330 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:36.415958 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:36.418216 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:36.425416 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:36.426828 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 70696.6us
I20260709 13:11:36.421245 30685 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:36.429925 30685 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.423048 30528 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:11:36.432399 30723 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:36.432818 30723 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.433203 30723 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.433835 28728 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 2: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:36.372264 30726 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.435322 28654 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:36.435302 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.438391 28656 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:36.438318 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:36.440259 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:36.443917 30716 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.444617 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:36.445238 30716 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:36.448904 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:36.450080 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:36.462491 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.434643 30722 raft_consensus.cc:2764] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:36.465773 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.463421 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:36.467097 30623 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:11:36.469655 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.470027 30676 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:36.470263 30623 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:36.447983 30736 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:36.447831 30640 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.470681 30676 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:36.429039 30720 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.474607 30713 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:36.433279 30755 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:11:36.475193 30687 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.471241 30709 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.472108 30666 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.486348 30687 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:36.487263 30687 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.487699 30603 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:36.488212 30603 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:36.488687 30687 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.471741 30715 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:11:36.480535 30713 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:36.527449 30713 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.529065 30713 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:36.530504 28726 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.484565 30717 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.479993 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.491472 30603 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.471226 30736 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:36.494807 30739 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.495745 30676 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.497505 30720 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:36.441681 30747 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.502393 30639 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.500206 30701 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.516459 30671 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:36.524196 30685 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:36.540112 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 60251.7us
I20260709 13:11:36.553187 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:36.554301 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.555315 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:36.543275 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 65462.6us
I20260709 13:11:36.541323 30674 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.565851 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:36.567400 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.569794 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.571486 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.573771 28578 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:36.576176 30753 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.576249 30754 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:36.577539 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 114590us
I20260709 13:11:36.578832 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.582643 30714 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.562223 30741 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:36.552165 30671 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:36.571713 30717 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.564580 30719 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.591496 30755 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.614287 30625 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.592341 30741 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:36.634707 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.636802 30625 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:36.640887 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:36.640187 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 43876.3us
I20260709 13:11:36.588656 30749 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:11:36.577268 30666 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:11:36.648862 30669 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:36.650179 30669 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:36.651343 30669 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.650224 30666 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:36.654541 30666 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:36.655472 30666 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.641222 30741 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.661933 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:36.663066 30625 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:11:36.664234 30625 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.664599 30625 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:36.665426 30625 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.666852 30625 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.670763 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:36.672119 30623 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:36.674155 30701 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:36.675772 30669 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:36.678916 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.684681 28722 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:36.606842 30736 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.690248 30726 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:36.676311 30723 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:36.695039 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 85112.5us
I20260709 13:11:36.696718 28722 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:36.678980 30755 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.707617 30662 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:36.708025 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.701815 30755 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.725656 30755 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:36.726842 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:36.727505 28722 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:36.729600 28653 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:36.734025 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:36.748063 30640 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.748795 30640 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.753054 30640 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:36.753558 30671 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.758324 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:36.763386 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:36.764086 28725 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:36.759096 28572 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:36.765256 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:36.775523 28647 raft_consensus.cc:2410] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:36.777735 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:36.781473 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:36.784096 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:36.771449 30662 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:36.773576 30671 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:36.776237 30723 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:36.799515 28573 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:36.782797 30752 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:36.806766 29260 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:36.807686 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:36.810089 30727 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.811343 30639 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:36.785786 30712 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.787307 30756 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.788306 30662 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.827384 30662 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:36.804960 28573 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.826308 30603 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:36.826435 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:36.826556 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.821969 30639 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.835678 30639 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:36.805446 30752 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:36.838536 30752 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.824836 30686 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:36.845431 30723 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:11:36.867321 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:36.868422 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:36.869153 29253 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.894016 29260 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:36.894557 30645 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.897464 30645 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:36.898280 30645 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.899792 30645 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:36.905184 29260 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:36.906422 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.910560 30666 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.925074 30717 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:36.926290 30717 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.926657 30717 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:36.890403 30661 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:11:36.948155 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:36.950472 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:36.956710 30673 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:36.954560 30602 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:36.961524 30602 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:36.962487 30602 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.967072 29260 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:36.969873 30753 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:36.993114 30662 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:36.994411 28648 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:36.927591 30717 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:36.996713 30717 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.002152 30714 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:36.922394 30752 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.013545 30741 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.014914 28726 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:37.015308 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:37.019371 30720 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:37.020486 30687 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:37.018757 28479 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.020874 30687 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:37.021838 30687 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.023101 30687 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.024330 30741 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.028151 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:37.026708 29253 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:11:37.033768 28573 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:37.035614 30712 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:37.040289 30720 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:37.041311 30625 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:37.041736 30625 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:37.042239 30752 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.042683 30625 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.044219 30625 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.045894 30755 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.046523 30755 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.051489 28652 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:37.054831 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:37.056648 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:37.058148 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:36.952574 30639 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:37.103742 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:37.104394 28722 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:37.073559 28479 catalog_manager.cc:5697] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 2, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.074901 30662 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:37.077656 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:37.098877 29254 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
W20260709 13:11:37.107070 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52400.3us
I20260709 13:11:37.116432 28696 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:37.125758 28577 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:37.110565 30714 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:37.132861 30673 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:37.150488 30639 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:37.153877 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:37.155797 28647 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:37.158159 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:37.159668 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:37.165537 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:37.153391 30686 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:37.155247 30673 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:37.165439 30752 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:37.138986 30714 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:37.184733 30673 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.191757 28576 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:37.190007 30741 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:37.196985 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:37.197981 28647 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:37.199940 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:37.176996 30686 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.211896 30645 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:37.224829 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:37.211717 30602 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:37.226365 29254 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:37.224452 30755 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.227531 30645 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.231654 30602 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.244233 30602 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.240763 30645 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:37.249707 30772 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.078s	user 0.003s	sys 0.000s
I20260709 13:11:37.250424 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:37.251062 29257 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:37.252683 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:37.253788 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:37.254112 30603 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:37.254537 28647 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:37.254490 30603 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:37.255795 30603 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.261045 28572 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:37.262789 28577 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:37.227864 30714 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.267277 28648 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:37.272310 28577 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:37.274204 30754 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:37.278273 28726 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:37.279052 30687 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:37.281790 28729 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:37.284303 30689 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:37.276551 28475 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 2, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:37.289991 30686 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.235258 30639 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:37.290827 30639 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:37.292903 30639 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:37.288839 28475 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 3, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.310339 30739 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:37.312152 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:37.321134 28722 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:37.321723 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:37.322445 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:37.324734 30676 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:37.323313 28647 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:37.334133 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:37.339249 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:37.317790 29258 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:37.347658 29257 raft_consensus.cc:2368] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6.
I20260709 13:11:37.357108 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:37.358040 28722 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:37.341248 30739 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:37.342783 30639 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:37.389223 30639 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:37.389881 30639 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:37.395221 30739 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:37.396656 30739 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:37.344007 30753 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:37.349900 30747 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:11:37.405807 30712 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.435712 28696 leader_election.cc:400] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6.
W20260709 13:11:37.437825 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 92020.7us
I20260709 13:11:37.438182 28696 leader_election.cc:403] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:37.426690 30756 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.447503 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:37.450992 30647 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:37.456717 30727 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:37.457341 30727 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:37.458354 30727 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.427112 30603 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.461200 30603 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.464089 29258 raft_consensus.cc:2955] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:37.467703 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:37.469635 30645 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.470721 30603 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.471254 30603 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.471839 30645 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.474100 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:37.474893 28648 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:37.475786 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:37.476334 29254 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.426656 30753 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:37.477438 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:37.478272 28653 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:37.477934 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:37.480937 28652 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.443408 30712 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.487730 30712 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.491535 29260 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:37.495237 28648 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.497438 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:37.498080 28656 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:37.530470 29254 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:37.484335 30639 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:37.544050 29257 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:37.524457 28652 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:37.500663 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:37.546695 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:37.547583 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 100805us
I20260709 13:11:37.547721 29258 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
W20260709 13:11:37.554893 30782 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:37.559103 30741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33252 (request call id 91) took 1347 ms. Trace:
I20260709 13:11:37.566370 28648 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:37.447249 30756 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:37.570871 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:37.572041 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:37.532913 30674 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:37.577884 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 77293.6us
I20260709 13:11:37.586833 30758 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:37.587466 30758 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.587960 30758 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.581897 30755 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:37.589627 30787 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:37.601624 30603 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.584326 30701 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:11:37.602692 30720 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.599822 30674 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.611436 30727 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.631018 30787 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:37.625402 30755 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:37.628762 30753 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:37.675244 30790 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:11:37.667186 30754 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.640563 30712 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:11:37.681353 30754 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.682163 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:37.682952 28725 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:37.683478 30754 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:37.679915 30639 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:37.638664 30661 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.686053 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:37.639186 30726 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:37.686048 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:37.638109 30720 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.692672 30739 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:37.722685 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 146467us
I20260709 13:11:37.722888 28648 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:37.727921 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:37.728865 29258 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:11:37.730415 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 51927.1us
W20260709 13:11:37.728564 30786 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:11:37.762036 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:37.767076 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 204620us
I20260709 13:11:37.559579 30741 rpcz_store.cc:276] 0709 13:11:36.211189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.211395 (+   206us) service_pool.cc:224] Handling call
0709 13:11:36.369974 (+158579us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b18002faea0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e5173d 00007f4a27e1cf3f 00007f4a27e1c6b3 00007f4a27e149fa 00007f4a2cddc4c9 00007f4a26358c54 00007f4a26358be2 00007f4a26358b11 00007f4a26358a8c 00007f4a26357d42
0709 13:11:36.490306 (+120332us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b5400424620. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8dec4 00007f4a27e118d7 00007f4a27e1d03c 00007f4a27e1c6b3 00007f4a27e149fa 00007f4a2cddc4c9 00007f4a26358c54 00007f4a26358be2 00007f4a26358b11 00007f4a26358a8c
0709 13:11:36.529461 (+ 39155us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b5800168bd0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d720aa 00007f4a27df4447 00007f4a27e1170a 00007f4a27e1276a 00007f4a27e1191b 00007f4a27e1d03c 00007f4a27e1c6b3 00007f4a27e149fa 00007f4a2cddc4c9 00007f4a26358c54
0709 13:11:36.539813 (+ 10352us) log.cc:844] Serialized 494 byte log entry
0709 13:11:36.730148 (+190335us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b5400424620. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8f142 00007f4a27d6feaa 00007f4a27d76d53 00007f4a27d76cd9 00007f4a27d76c69 00007f4a27d76c31 00007f4a27d75dfd 000000000038f354 000000000038f199 00007f4a24d29475
0709 13:11:36.897336 (+167188us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b4c002515c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a260e2a20 00007f4a260f3a29 00007f4a260f413f 00007f4a260b82ab 00007f4a260e5f3c 00007f4a260e63fe 00007f4a2637350b 00007f4a27d72381 00007f4a27d7026b 00007f4a27d76d53 00007f4a27d76cd9
0709 13:11:37.558976 (+661640us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27249,"raft.queue_time_us":3052,"raft.run_cpu_time_us":4766,"raft.run_wall_time_us":421124,"spinlock_wait_cycles":380601472,"thread_start_us":52716,"threads_started":1,"wal-append.queue_time_us":82709}
I20260709 13:11:37.707819 30661 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.728004 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:37.685926 30727 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.713629 30726 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.729562 30739 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.776005 30675 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.842880 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:37.843859 28722 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:11:37.864144 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 79893.4us
W20260709 13:11:37.897456 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44282us
I20260709 13:11:37.789805 28573 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:37.832697 30714 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.854212 30639 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:37.854604 30756 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:37.973989 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 213628us
W20260709 13:11:37.900588 30789 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:11:37.771888 30755 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.856230 30675 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:37.975380 30791 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:37.975256 30687 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:37.816982 30787 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:37.985497 30756 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.967427 30714 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:38.007443 28464 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6caf9ec933124d00b3e0e2cfeccd317b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:37.986091 30674 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:38.008308 30661 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:38.009970 30802 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.032249 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:38.033102 28573 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:38.039161 29224 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:38.009641 30687 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:38.024290 28464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 234612us
I20260709 13:11:38.020498 30756 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:38.042057 30647 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.005s
I20260709 13:11:38.037850 30720 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:38.028398 30812 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.034389 30816 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.084941 30675 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:38.088394 30647 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6.
I20260709 13:11:38.132004 30812 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:38.037237 30802 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:38.135964 30812 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:38.093799 30727 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:38.096138 30602 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:38.098102 30794 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.107158 30756 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:38.107730 30726 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:38.051038 30784 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:38.136945 30802 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:38.167237 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:38.138733 30794 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:38.138486 30602 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:38.179207 30602 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:38.168622 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:38.183480 29260 raft_consensus.cc:2410] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:38.192931 29257 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:38.144495 30784 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.196309 30784 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:38.202425 30714 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:38.176774 30794 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:38.193099 30816 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:38.206634 30816 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:38.149184 30758 consensus_meta.cc:287] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.006s
I20260709 13:11:38.220085 28475 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43518 (request call id 373) took 1074 ms. Trace:
I20260709 13:11:38.223233 30758 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:38.226995 30687 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:38.228160 30739 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:38.232582 28479 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.237793 28479 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 4, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 4 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:38.245978 30625 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.220621 28475 rpcz_store.cc:276] 0709 13:11:37.145223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.145445 (+   222us) service_pool.cc:224] Handling call
0709 13:11:38.220000 (+1074555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:37.397309 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:37.398021 (+   712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:37.398064 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:11:37.398086 (+    22us) tablet.cc:662] Decoding operations
0709 13:11:37.398644 (+   558us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:37.398707 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:37.398751 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:37.399174 (+   423us) tablet.cc:701] Row locks acquired
0709 13:11:37.399194 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:11:37.399376 (+   182us) write_op.cc:270] Start()
0709 13:11:37.399517 (+   141us) write_op.cc:276] Timestamp: P: 1783602697399317 usec, L: 0
0709 13:11:37.399550 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:11:37.453090 (+ 53540us) log.cc:844] Serialized 913 byte log entry
0709 13:11:37.553052 (+ 99962us) op_driver.cc:464] REPLICATION: finished
0709 13:11:37.599550 (+ 46498us) write_op.cc:301] APPLY: starting
0709 13:11:37.604841 (+  5291us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:37.612781 (+  7940us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:37.625778 (+ 12997us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:37.655087 (+ 29309us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:37.670260 (+ 15173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:11:37.670330 (+    70us) write_op.cc:312] APPLY: finished
0709 13:11:37.670566 (+   236us) log.cc:844] Serialized 29 byte log entry
0709 13:11:37.670759 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:37.679652 (+  8893us) write_op.cc:454] Released schema lock
0709 13:11:37.679699 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:38.078134 (+398435us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b5400163d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e11e28 00007f4a2b84c581 00007f4a2b84bd58 00007f4a2b8509f1 00007f4a2b8509a9 00007f4a2b850939 00007f4a2b850901 00007f4a2b84fb2d 000000000038f354 000000000038f199
0709 13:11:38.078461 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.078514 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1702,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":6375,"apply.run_cpu_time_us":2501,"apply.run_wall_time_us":80646,"num_ops":2,"prepare.queue_time_us":48944,"prepare.run_cpu_time_us":7807,"prepare.run_wall_time_us":713783,"replication_time_us":135166,"spinlock_wait_cycles":121544576}]]}
I20260709 13:11:38.254153 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:38.254834 28722 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:38.246568 30625 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:38.256618 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:38.266572 28722 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:38.258713 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:38.267145 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:38.267479 28730 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:38.259690 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:38.262392 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:38.269639 28725 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:38.262679 30647 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:38.263365 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:38.270756 28581 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:38.263494 30802 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:38.267998 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:38.297408 28652 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:38.268771 28728 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 2: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:38.271482 28574 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:38.261610 30801 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.272413 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:38.276295 30714 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.277837 30739 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:38.279488 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:38.309382 28653 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:38.279553 30754 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:38.281436 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:38.282078 28577 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:38.310853 28578 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:11:38.284622 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:38.312090 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:38.312705 28581 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:38.285501 30819 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:38.288983 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:38.291345 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:38.291630 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:38.293195 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:38.316673 28648 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:38.316953 28651 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
W20260709 13:11:38.294554 28547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.005s	sys 0.026s
I20260709 13:11:38.296125 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:38.304126 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:38.318023 28649 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:38.270242 30662 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.233835 30784 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:38.317751 28547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.027s
I20260709 13:11:38.311681 30806 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:38.321674 30819 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:38.311962 30714 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:38.312988 30802 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:38.315862 30801 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:38.324375 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 562369us
I20260709 13:11:38.324115 30662 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:38.413300 30805 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.164342 30805 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.165719 30662 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:38.391278 30810 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:39.166877 30805 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:38.385388 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 81389.9us
I20260709 13:11:38.322161 30758 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:38.330538 28729 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.010s
W20260709 13:11:39.168542 28729 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.384s	user 0.030s	sys 0.032s
I20260709 13:11:39.168936 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:39.169487 30830 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:38.403730 30788 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:39.170151 30753 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:39.170014 30830 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:38.410017 29258 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:39.170760 30753 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.171591 30753 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:38.407389 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:39.172289 30830 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:39.172708 29253 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:39.173187 30819 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:38.401517 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 89658us
I20260709 13:11:38.412855 30625 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:38.405448 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:39.175330 29259 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:38.397903 28649 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:38.933905 30689 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.170288 28621 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:39.178982 30755 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:38.341733 30687 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.179644 30755 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.181943 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:38.419992 29254 raft_consensus.cc:2368] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:38.673260 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:38.421991 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:39.170873 30789 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.675s	user 0.021s	sys 0.019s
I20260709 13:11:39.198551 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:39.172857 30830 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.199580 28578 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:39.198462 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:11:39.138118 30787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.022s	sys 0.035s
I20260709 13:11:39.201014 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:39.205732 28572 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:39.191406 30780 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.555s	user 0.003s	sys 0.007s
I20260709 13:11:38.972692 30784 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:38.835726 30708 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.213346 28655 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:38.343410 30823 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:39.211181 30787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.022s	sys 0.035s
I20260709 13:11:39.211261 28574 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:38.709780 30795 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:39.347931 30815 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:39.372617 30829 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:11:39.373091 30795 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.373543 30815 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.375319 30795 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:39.375171 30823 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:38.774734 30803 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.570858 30804 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.933179 30676 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:39.180137 30687 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.006848 30647 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:38.314702 30754 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.182708 30810 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:39.208068 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 661) took 1412 ms. Trace:
I20260709 13:11:39.191813 30662 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:39.097615 30741 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:38.900779 30674 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:39.184329 30625 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:39.191673 30813 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:39.170331 30788 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:38.318593 30739 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.349341 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:39.192193 30689 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:39.572768 28546 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.806s (SENT) [suppressed 6 similar messages]
I20260709 13:11:39.581790 30843 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.581929 30804 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.582391 30843 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.584574 30843 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:39.585176 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 377465us
I20260709 13:11:39.587754 30815 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:39.588729 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:39.590250 30788 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:39.579312 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:39.621649 29251 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:39.625391 30802 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:39.629870 30755 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:39.630676 30755 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.631275 30755 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.640300 30801 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:39.579818 30752 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.641441 30752 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.644284 30752 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:39.559362 29253 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:39.646144 30834 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:11:39.647565 30833 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.375876 30795 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:39.509306 30794 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.591298 30810 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:39.591167 30803 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.592161 28654 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:39.413621 30708 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.219352 30818 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:39.377615 30823 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:39.431962 30726 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.214067 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 544) took 1006 ms. Trace:
I20260709 13:11:39.594197 30754 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:39.594111 30625 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.594537 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:39.594883 30647 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.595373 29257 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:39.595878 30674 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:39.702152 28621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.002s	sys 0.009s
I20260709 13:11:39.754259 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:39.754714 28621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.004s	sys 0.014s
W20260709 13:11:39.754999 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 571534us
I20260709 13:11:39.596148 30676 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.557580 28572 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:39.597420 30813 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.596985 30741 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.791648 30689 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:39.602020 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:39.793471 29260 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 3: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:39.602408 30835 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.794392 30835 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.796152 30687 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:39.796651 30835 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:39.591161 30662 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.797655 30662 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.798444 30803 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:39.799290 30829 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.800073 30708 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:39.528716 30603 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:39.801282 30603 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.588567 28729 rpcz_store.cc:276] 0709 13:11:37.779938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.781117 (+  1179us) service_pool.cc:224] Handling call
0709 13:11:37.781378 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.781573 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:39.169061 (+1387488us) log.cc:844] Serialized 14 byte log entry
0709 13:11:39.191212 (+ 22151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.191288 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:39.191350 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.191653 (+   303us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.191850 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1387997,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":3910,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":20994,"spinlock_wait_cycles":56250112,"thread_start_us":1406127,"threads_started":2,"wal-append.queue_time_us":60904}
I20260709 13:11:39.541260 30787 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.648372 30833 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.650388 30752 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.826711 30833 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:39.681655 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 94829.9us
I20260709 13:11:39.827337 30839 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.827715 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:39.677942 30794 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.684718 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:39.828519 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:39.705998 28619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.012s
W20260709 13:11:39.829308 28619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.013s
I20260709 13:11:39.681347 30823 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:39.773474 30754 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.773320 30842 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.753677 30714 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:39.773311 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 66910.3us
I20260709 13:11:39.775624 29251 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:39.777518 30625 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:39.782801 30804 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:39.784770 30843 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.682039 30818 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.790797 30813 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:39.215468 30830 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.792749 30741 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:39.799813 30829 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.800729 30837 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:39.580279 30784 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:39.817551 28655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1558) took 1510 ms (client timeout 1817 ms). Trace:
W20260709 13:11:39.819206 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 246476us
I20260709 13:11:39.821394 30603 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:39.825800 30835 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:39.826453 30752 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.827878 30839 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.670631 30801 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.661980 30802 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:39.831576 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:39.833591 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 662) took 1491 ms. Trace:
I20260709 13:11:39.834445 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:39.757997 30815 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:39.837698 28730 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:11:39.838207 29254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1075) took 1653 ms (client timeout 2038 ms). Trace:
I20260709 13:11:39.841486 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1555) took 1550 ms. Trace:
I20260709 13:11:39.717653 30806 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:11:39.843854 29223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.063s	sys 0.079s
W20260709 13:11:39.847800 28545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.007s	sys 0.027s
I20260709 13:11:39.786571 30674 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:39.852339 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:39.889581 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 814) took 1485 ms. Trace:
I20260709 13:11:39.680728 30795 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.690172 30726 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:39.907572 28655 rpcz_store.cc:269] 0709 13:11:38.292810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.292933 (+   123us) service_pool.cc:224] Handling call
0709 13:11:39.803181 (+1510248us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54003aa7d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:39.803301 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060957440}
I20260709 13:11:40.071797 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:39.884162 30842 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.918038 30835 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.883227 30848 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.849592 30803 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.067654 29223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.067s	sys 0.085s
I20260709 13:11:39.902093 30720 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:39.923276 30753 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.006s
I20260709 13:11:39.900869 30843 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.842103 30787 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:40.070887 28545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.008s	sys 0.036s
I20260709 13:11:39.916539 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.071579 28546 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:40.066660 29257 rpcz_store.cc:276] 0709 13:11:38.404484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.421655 (+ 17171us) service_pool.cc:224] Handling call
0709 13:11:39.889353 (+1467698us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54006432d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:39.889493 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935634816}
I20260709 13:11:40.066715 28654 rpcz_store.cc:276] 0709 13:11:38.291006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.291122 (+   116us) service_pool.cc:224] Handling call
0709 13:11:39.840989 (+1549867us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540018f954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:39.841412 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933104000}
W20260709 13:11:40.071758 29254 rpcz_store.cc:269] 0709 13:11:38.166830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.166963 (+   133us) service_pool.cc:224] Handling call
0709 13:11:39.819807 (+1652844us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400596354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:39.820006 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579140352}
I20260709 13:11:40.072072 28728 rpcz_store.cc:276] 0709 13:11:38.342313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.832622 (+1490309us) service_pool.cc:224] Handling call
0709 13:11:39.832943 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.833173 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.833210 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.833269 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:39.833331 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.833399 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.833524 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:40.076236 28725 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:40.072645 28726 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:40.075448 28727 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
W20260709 13:11:40.120078 28725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 1424) took 1806 ms (client timeout 1817 ms). Trace:
W20260709 13:11:40.119642 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 235744us
I20260709 13:11:39.910892 30689 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.850672 30823 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:39.902572 30747 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:40.077965 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.103744 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:40.135449 28730 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:40.135716 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.137394 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:40.108394 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.019666 30625 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.138921 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:40.137394 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:40.021090 30849 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:40.139077 30625 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.139633 28654 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:11:40.139922 30849 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:40.141462 30625 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:40.142390 30849 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:40.143028 30849 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:40.143646 30849 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.049747 30830 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:40.111025 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 363414us
I20260709 13:11:39.921373 30839 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:40.019351 30820 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:11:40.120460 28725 rpcz_store.cc:269] 0709 13:11:38.314079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.831358 (+1517279us) service_pool.cc:224] Handling call
0709 13:11:40.120023 (+288665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:40.043879 30698 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:40.072978 30603 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:39.910998 30741 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:39.853449 30754 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.118031 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:40.087980 30755 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:40.076828 30675 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:40.080842 30829 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.132445 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.132578 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:40.133155 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 280874us
I20260709 13:11:40.105665 30720 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.019840 30784 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.152935 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:40.260248 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 107448us
I20260709 13:11:40.159543 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.075577 30801 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:39.923000 30837 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.115742 30838 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:40.194000 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48608.9us
I20260709 13:11:40.074975 30815 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.195379 28647 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:40.162283 30851 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:39.921753 30810 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:40.192451 30676 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:40.081169 30802 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.114288 30753 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.241464 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 715) took 1036 ms. Trace:
I20260709 13:11:40.155259 30647 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:40.201342 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 83393.9us
I20260709 13:11:40.111581 30803 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.148568 30820 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.251559 30829 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.235158 30675 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.243491 29224 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:40.254657 30726 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.255492 30787 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.192876 30698 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.278781 30853 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:40.257659 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:39.679208 28573 rpcz_store.cc:276] 0709 13:11:38.208047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.208174 (+   127us) service_pool.cc:224] Handling call
0709 13:11:38.208754 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.208971 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:38.495759 (+286788us) log.cc:844] Serialized 14 byte log entry
0709 13:11:39.176289 (+680530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.185742 (+  9453us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:39.192770 (+  7028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.202990 (+ 10220us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.213996 (+ 11006us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":432450,"prepare.queue_time_us":948470,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":47,"raft.queue_time_us":445530,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":6577,"thread_start_us":286334,"threads_started":1}
I20260709 13:11:40.191171 30603 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:40.513212 30729 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:40.523634 30729 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:40.191547 30839 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:40.262445 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.196141 30804 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.103222 30848 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.265630 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:40.558784 28725 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:40.264055 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:40.560119 28581 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:40.103627 30828 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:40.197580 30662 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.151118 30689 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.199295 30739 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.291421 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:40.234925 30845 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:40.202103 30858 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:40.293895 30854 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:40.234992 30755 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:40.235167 30752 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:40.158556 30747 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.199388 30856 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.209s
I20260709 13:11:40.242527 30806 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:40.202777 30794 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:40.503293 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 259858us
I20260709 13:11:40.260213 30720 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:40.295179 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:40.503000 29258 rpcz_store.cc:276] 0709 13:11:39.205554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.205783 (+   229us) service_pool.cc:224] Handling call
0709 13:11:39.206123 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.583636 (+377513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.583668 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.584172 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:11:39.823865 (+239693us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b18001d1d00. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1
0709 13:11:39.824067 (+   202us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:39.824109 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.824728 (+   619us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400513bd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:39.824774 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.241214 (+416440us) raft_consensus.cc:1685] finished
0709 13:11:40.241234 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.241389 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1462,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":7910,"spinlock_wait_cycles":989150336,"thread_start_us":117519,"threads_started":1,"wal-append.queue_time_us":522470}
I20260709 13:11:40.257591 30823 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.280627 30714 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:40.460788 30676 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:40.279569 30758 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:40.512262 28722 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
W20260709 13:11:40.515507 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 443957us
W20260709 13:11:40.306325 30788 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.000s
I20260709 13:11:40.519273 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:40.306352 30687 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:40.506135 30829 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:40.521765 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 719) took 1170 ms. Trace:
I20260709 13:11:40.522800 30795 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:40.541970 28656 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:40.289448 30851 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.567689 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.574051 30864 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:40.514823 30647 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:40.604180 28725 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
W20260709 13:11:40.626451 28695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.015s	sys 0.049s
I20260709 13:11:40.511251 30849 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.510737 30859 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:40.416392 30818 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:40.569914 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:40.577236 30828 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.524533 30729 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:40.201289 30741 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:40.627175 28721 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.000s	sys 0.064s
I20260709 13:11:41.263988 28546 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:40.627833 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:41.192502 28696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.124s	sys 0.267s
W20260709 13:11:41.265144 28696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.128s	sys 0.282s
I20260709 13:11:41.265244 30861 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:40.968750 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.265919 30861 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:40.797434 28648 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:40.970186 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1554) took 2679 ms. Trace:
W20260709 13:11:41.264043 28721 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.342s	user 0.021s	sys 0.136s
W20260709 13:11:41.265489 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 980991us
I20260709 13:11:41.268808 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.265947 30803 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.269495 28696 leader_election.cc:400] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:41.269878 28696 leader_election.cc:403] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:40.348093 30838 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.270570 30816 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.271080 30816 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:41.270761 30854 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.271559 30816 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.272065 30838 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.272616 30838 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:41.273132 30845 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.210268 30802 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.273383 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.274199 30801 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.266052 30687 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.274134 30864 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.271538 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.276516 30864 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.526561 30726 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:41.269980 28572 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:41.277360 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.277596 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:40.757141 30810 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.279925 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.280223 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:40.967015 30848 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:41.277559 30726 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.045708 30754 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.820685 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.281620 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 531) took 1626 ms. Trace:
I20260709 13:11:41.280885 30861 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.282151 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:41.282394 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 773505us
I20260709 13:11:41.339012 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 532) took 1662 ms. Trace:
W20260709 13:11:40.619082 30813 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.000s
I20260709 13:11:40.558902 30839 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:41.339501 28656 rpcz_store.cc:276] 0709 13:11:39.676406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.676528 (+   122us) service_pool.cc:224] Handling call
0709 13:11:41.338225 (+1661697us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b540018f454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:41.338934 (+   709us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809066240}
I20260709 13:11:40.973285 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1084) took 1056 ms. Trace:
I20260709 13:11:41.283470 30858 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:41.151973 28621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.009s	sys 0.031s
I20260709 13:11:41.284421 30698 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:40.678649 30739 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:41.285638 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:41.352766 28621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.013s	sys 0.033s
I20260709 13:11:40.960251 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:40.967795 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.286859 30675 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.273663 30845 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:41.287411 30676 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.040217 30815 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:41.289336 28695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.020s	sys 0.066s
I20260709 13:11:41.290040 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.290242 30854 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.289539 30862 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:41.290840 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.290978 30817 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:41.280898 30840 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:41.446532 29258 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:11:41.352475 29253 rpcz_store.cc:276] 0709 13:11:39.906381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.910425 (+  4044us) service_pool.cc:224] Handling call
0709 13:11:40.074349 (+163924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.568259 (+493910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.580382 (+ 12123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.629519 (+ 49137us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:40.676885 (+ 47366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.962853 (+285968us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54007562d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:40.962927 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.963145 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030045440}
I20260709 13:11:41.447201 30839 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.447403 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 728) took 1246 ms. Trace:
I20260709 13:11:41.447889 29258 rpcz_store.cc:276] 0709 13:11:40.200599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.285338 (+1084739us) service_pool.cc:224] Handling call
0709 13:11:41.447330 (+161992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.292121 30714 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:41.292212 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:40.606307 30853 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.294466 30851 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:40.976891 30662 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.296679 30876 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:41.299053 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.461316 28655 raft_consensus.cc:2410] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:41.301162 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.302644 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:41.266485 28575 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:41.290894 30823 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.566841 30804 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.303861 30864 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.580808 30866 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.752s
I20260709 13:11:41.306733 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 825) took 1021 ms. Trace:
W20260709 13:11:41.104068 28647 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.814s	user 0.006s	sys 0.005s
I20260709 13:11:41.308233 30647 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:40.697311 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.751377 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.267419 28650 rpcz_store.cc:276] 0709 13:11:38.290251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.290355 (+   104us) service_pool.cc:224] Handling call
0709 13:11:38.290640 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.653492 (+1362852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.653530 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.682320 (+ 28790us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.075729 (+393409us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:40.075767 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.969613 (+893846us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b540022b854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:40.969682 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.969744 (+    62us) raft_consensus.cc:1685] finished
0709 13:11:40.969766 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.970070 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":415594,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"spinlock_wait_cycles":2114966400,"thread_start_us":681296,"threads_started":2,"wal-append.queue_time_us":362366,"wal-append.run_cpu_time_us":2739,"wal-append.run_wall_time_us":1051594}
W20260709 13:11:41.316915 28722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2072) took 2934 ms (client timeout 2215 ms). Trace:
I20260709 13:11:41.526225 28647 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:41.327724 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.328835 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 670) took 1063 ms. Trace:
I20260709 13:11:41.517618 29260 rpcz_store.cc:276] 0709 13:11:40.285344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.567338 (+281994us) service_pool.cc:224] Handling call
0709 13:11:41.306649 (+739311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.527350 28725 rpcz_store.cc:276] 0709 13:11:40.265126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.265291 (+   165us) service_pool.cc:224] Handling call
0709 13:11:41.328751 (+1063460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.330394 28581 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:41.528244 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.529464 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:40.797673 29257 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:40.753232 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 720) took 1332 ms. Trace:
W20260709 13:11:41.332404 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 52265.4us
I20260709 13:11:41.518544 28730 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
W20260709 13:11:41.293123 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 723184us
I20260709 13:11:41.335412 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 535) took 1653 ms. Trace:
I20260709 13:11:41.330415 29255 rpcz_store.cc:276] 0709 13:11:39.351472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.351742 (+   270us) service_pool.cc:224] Handling call
0709 13:11:39.352114 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.842640 (+490526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.842669 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.842707 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:40.075952 (+233245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.521524 (+445572us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54005690d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:40.521570 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.521685 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127587200}
I20260709 13:11:41.532152 28648 rpcz_store.cc:276] 0709 13:11:39.682323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.684403 (+  2080us) service_pool.cc:224] Handling call
0709 13:11:41.335132 (+1650729us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b540027e054. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:41.335321 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226187008}
I20260709 13:11:41.532600 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.331193 28649 rpcz_store.cc:276] 0709 13:11:39.655601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.676139 (+ 20538us) service_pool.cc:224] Handling call
0709 13:11:39.734805 (+ 58666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.278386 (+1543581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.278420 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.278464 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:41.278507 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.281407 (+  2900us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540006e0d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:41.281451 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.281569 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833051520}
I20260709 13:11:41.533210 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.456398 30714 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:41.283260 30837 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.337282 28727 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:41.350741 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2076) took 1523 ms. Trace:
W20260709 13:11:41.351797 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47584.2us
I20260709 13:11:41.539880 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 672) took 1021 ms. Trace:
I20260709 13:11:40.677897 30842 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.485389 30754 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.304904 30755 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:41.280239 30788 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.450100 28653 raft_consensus.cc:2410] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:41.539855 28721 rpcz_store.cc:276] 0709 13:11:39.827621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.830187 (+  2566us) service_pool.cc:224] Handling call
0709 13:11:39.852371 (+ 22184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.852653 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:41.267985 (+1415332us) log.cc:844] Serialized 14 byte log entry
0709 13:11:41.350224 (+ 82239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.350272 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:41.350340 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.350420 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.350614 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1454672,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":102,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"thread_start_us":1427176,"threads_started":2,"wal-append.queue_time_us":81874}
I20260709 13:11:41.329398 30758 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.407668 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.552963 28656 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
W20260709 13:11:41.452586 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.40223e+06us
I20260709 13:11:41.428406 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1086) took 1521 ms. Trace:
I20260709 13:11:41.454833 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.517886 30820 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.555950 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.523738 30843 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.456744 28574 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
W20260709 13:11:41.439327 30857 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.004s	sys 0.022s
I20260709 13:11:41.462589 28652 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:41.563589 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.463316 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:41.565650 29258 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:41.541069 30840 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:41.427445 30603 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.390625 30848 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:41.453354 30795 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:41.514319 30675 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.497990 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.486150 28728 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:41.319918 30794 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:41.533753 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.338017 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 826) took 1048 ms. Trace:
W20260709 13:11:41.526631 28722 rpcz_store.cc:269] 0709 13:11:38.330008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.828280 (+1498272us) service_pool.cc:224] Handling call
0709 13:11:40.512018 (+683738us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b540008c6a8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbf3924 00007f4a2cddc227 00007f4a2cddbab8 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6
0709 13:11:41.264174 (+752156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10269568}
I20260709 13:11:41.530627 29252 rpcz_store.cc:276] 0709 13:11:39.420507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.420726 (+   219us) service_pool.cc:224] Handling call
0709 13:11:39.421193 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.021655 (+600462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.021683 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.021723 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:40.021770 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.752869 (+731099us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54005e6854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:40.752929 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.753150 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380380544}
I20260709 13:11:41.530038 29260 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:41.354628 28573 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:41.537096 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:41.542181 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.543233 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:41.537322 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:41.485044 30810 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:40.973505 30689 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:41.342666 30838 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.547142 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.309284 30859 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.540544 28727 rpcz_store.cc:276] 0709 13:11:40.518887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.519023 (+   136us) service_pool.cc:224] Handling call
0709 13:11:41.539798 (+1020775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.551714 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.450626 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 668) took 1318 ms. Trace:
I20260709 13:11:41.456804 30739 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.456169 28576 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:41.456171 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:41.516234 30870 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:41.354671 30813 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:41.558421 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.555126 29259 rpcz_store.cc:276] 0709 13:11:39.906983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.136690 (+229707us) service_pool.cc:224] Handling call
0709 13:11:40.136973 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.395069 (+1258096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.395117 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.395181 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:41.395241 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.427986 (+ 32745us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540068f1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:41.428049 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.428336 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2892592000}
I20260709 13:11:41.561355 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.566453 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:41.565752 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2156) took 1153 ms. Trace:
I20260709 13:11:41.331558 30835 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.566685 28696 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:41.549728 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.572451 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:41.517424 30823 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.533104 30876 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.551216 30726 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.460367 30862 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.028836 30866 raft_consensus.cc:2764] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:42.029330 28725 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
W20260709 13:11:42.030010 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 492992us
I20260709 13:11:42.032023 30862 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.032316 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:41.562417 30698 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:41.558557 30758 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.035151 30698 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.558175 30815 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.034602 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.035979 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:41.584159 30867 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.298s	user 0.001s	sys 0.003s
I20260709 13:11:42.037762 29253 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:42.038702 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1083) took 2132 ms. Trace:
I20260709 13:11:42.038381 30815 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:42.039124 29256 rpcz_store.cc:276] 0709 13:11:39.906063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.906172 (+   109us) service_pool.cc:224] Handling call
0709 13:11:39.917632 (+ 11460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.074869 (+157237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.074902 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.099620 (+ 24718us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.504783 (+405163us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:40.504837 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.504906 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.583599 (+1078693us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:11:42.038413 (+454814us) raft_consensus.cc:1685] finished
0709 13:11:42.038432 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.038631 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156222,"raft.queue_time_us":194658,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":39585,"spinlock_wait_cycles":62916864,"thread_start_us":355249,"threads_started":1,"wal-append.queue_time_us":1167357}
I20260709 13:11:42.041476 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.041940 29254 rpcz_store.cc:276] 0709 13:11:40.289360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.820329 (+530969us) service_pool.cc:224] Handling call
0709 13:11:41.337953 (+517624us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:42.043068 28576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2157) took 1582 ms (client timeout 1891 ms). Trace:
I20260709 13:11:41.580261 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.573812 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.044905 28575 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 1.
I20260709 13:11:41.565128 29251 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:42.046139 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:41.611235 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.043707 28649 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:11:42.034345 30804 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:41.553398 30754 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:41.531170 30864 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:42.099565 28648 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:42.104262 28653 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:42.043906 28655 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:41.616307 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1562) took 1479 ms. Trace:
W20260709 13:11:41.617036 29257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 820) took 1692 ms (client timeout 2116 ms). Trace:
I20260709 13:11:42.048444 29259 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:42.122150 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 725) took 1969 ms. Trace:
I20260709 13:11:42.122589 28656 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 1.
W20260709 13:11:42.123292 29257 rpcz_store.cc:269] 0709 13:11:39.912977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.132125 (+219148us) service_pool.cc:224] Handling call
0709 13:11:41.604828 (+1472703us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54006e0354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:41.604934 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277042944}
W20260709 13:11:42.110504 28730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 671) took 1816 ms (client timeout 1786 ms). Trace:
W20260709 13:11:42.132908 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 100701us
I20260709 13:11:42.135494 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.042618 28726 rpcz_store.cc:276] 0709 13:11:40.132594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.135161 (+  2567us) service_pool.cc:224] Handling call
0709 13:11:40.194027 (+ 58866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.380250 (+1186223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.380298 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.380365 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:41.380423 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.409464 (+ 29041us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001b8854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:41.409530 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.450556 (+ 41026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2727287552}
I20260709 13:11:42.072949 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:42.131193 28730 rpcz_store.cc:269] 0709 13:11:40.294536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.294843 (+   307us) service_pool.cc:224] Handling call
0709 13:11:42.109605 (+1814762us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400233cd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:42.110417 (+   812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463518592}
W20260709 13:11:41.908644 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 352935us
I20260709 13:11:42.069512 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.040355 30813 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.140769 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.140542 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.136796 29254 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
W20260709 13:11:42.143339 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 687189us
I20260709 13:11:42.143465 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.565320 30842 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.531s
I20260709 13:11:42.129798 29259 rpcz_store.cc:276] 0709 13:11:40.152386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.047807 (+1895421us) service_pool.cc:224] Handling call
0709 13:11:42.048105 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.121883 (+ 73778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.122095 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:42.122268 28576 rpcz_store.cc:269] 0709 13:11:40.460527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.460998 (+   471us) service_pool.cc:224] Handling call
0709 13:11:40.960049 (+499051us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:11:42.043008 (+1082959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16908160}
I20260709 13:11:41.590718 30858 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.154685 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.121852 28647 rpcz_store.cc:276] 0709 13:11:40.136487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.138580 (+  2093us) service_pool.cc:224] Handling call
0709 13:11:40.138869 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.526684 (+1387815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.616015 (+ 89331us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b540001d6d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:41.616223 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129637120}
I20260709 13:11:42.101754 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 824) took 1841 ms. Trace:
I20260709 13:11:41.592597 30741 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:41.582135 30784 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:42.163533 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 626209us
I20260709 13:11:42.179553 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:42.123057 30876 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.165084 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.584582 30828 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.586410 30829 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.042393 30794 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.592907 30753 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.199564 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:41.585819 30747 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:41.738456 30861 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:42.163144 30755 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.069937 30848 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.175308 30837 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.042618 28574 rpcz_store.cc:276] 0709 13:11:40.406212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.417140 (+ 10928us) service_pool.cc:224] Handling call
0709 13:11:40.967585 (+550445us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:11:41.559864 (+592279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17201408}
I20260709 13:11:42.069586 30676 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.173902 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.213621 28655 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:41.591878 30687 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.099254 30843 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:42.174415 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.174741 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.092557 30820 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:42.164677 28654 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.191262 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.228753 28649 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
W20260709 13:11:42.153878 30806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.011s
I20260709 13:11:41.585857 30720 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.230669 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 729) took 2023 ms. Trace:
I20260709 13:11:42.194916 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.141201 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.152663 30866 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.197512 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:41.582183 30816 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:42.197571 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.079056 30675 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:42.169580 30835 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.199353 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.242930 28572 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:42.069207 30810 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.171739 29255 rpcz_store.cc:276] 0709 13:11:40.260488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.090968 (+1830480us) service_pool.cc:224] Handling call
0709 13:11:42.101071 (+ 10103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.101304 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.101342 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:42.101406 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.101460 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.101532 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.101681 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:42.245864 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.246364 29255 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:11:42.202265 29259 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:42.069799 30795 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:42.171895 29251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 827) took 1871 ms (client timeout 1549 ms). Trace:
I20260709 13:11:42.204411 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.205348 30823 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.206911 30754 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.208595 30859 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.210182 30739 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.201115 30647 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.203281 30815 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.294411 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.294689 30815 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:42.295233 30815 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:42.295872 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.286682 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.232751 30843 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.299332 30843 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.300077 29254 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:42.192224 30858 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.244500 29253 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:42.301254 30858 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:42.301412 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 726) took 2110 ms. Trace:
I20260709 13:11:42.301719 30858 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.305331 30739 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.305828 30739 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:42.306228 30739 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.306888 30795 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.309299 30816 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.294298 30647 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:42.310794 30647 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:42.309105 29253 rpcz_store.cc:276] 0709 13:11:40.191474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.069503 (+1878029us) service_pool.cc:224] Handling call
0709 13:11:42.301340 (+231837us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:42.217759 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 124571us
I20260709 13:11:42.312422 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.313144 29253 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:42.315624 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.316246 29253 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:42.317297 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.226130 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.211941 30861 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.240374 30741 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:42.199510 30794 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:42.230273 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.322147 28580 raft_consensus.cc:1813] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Handling vote request from an unknown peer 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:11:42.301530 30881 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:42.233095 29256 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:42.201401 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.233248 29260 rpcz_store.cc:276] 0709 13:11:40.207354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.081459 (+1874105us) service_pool.cc:224] Handling call
0709 13:11:42.081905 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.229718 (+147813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.229756 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:42.230346 (+   590us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:42.230444 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.230506 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.230617 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10629,"raft.queue_time_us":51320,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":21193,"thread_start_us":130665,"threads_started":1}
I20260709 13:11:42.330394 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.332070 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:42.332517 30882 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:42.238545 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:42.333369 28576 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:42.230633 30851 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.002s
I20260709 13:11:42.337915 30848 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.227684 30701 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.338883 30701 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:42.339469 30701 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.340323 30885 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.233764 30676 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.341290 30676 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.341810 30647 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.342891 28479 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 376) took 4739 ms. Trace:
I20260709 13:11:42.343736 30676 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.340924 30885 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.247336 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.345448 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.346109 29259 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 1.
I20260709 13:11:42.346983 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.347582 29259 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:42.234983 30865 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:42.349494 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:42.242489 30845 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.000s
I20260709 13:11:42.350561 30845 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:42.351148 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:42.230129 30806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.006s	sys 0.011s
I20260709 13:11:41.591449 30840 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.357534 30845 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.316043 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.320989 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:11:42.320869 28545 connection.cc:256] RPC call timeout handler was delayed by -1.6591442060000645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 13:11:42.355958 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:42.354097 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1092) took 1059 ms. Trace:
I20260709 13:11:42.363868 29260 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:42.363827 29259 rpcz_store.cc:276] 0709 13:11:41.294743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.348163 (+1053420us) service_pool.cc:224] Handling call
0709 13:11:42.348492 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.348690 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.348724 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:42.348769 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.348814 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.348875 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.348994 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:42.254639 29251 rpcz_store.cc:269] 0709 13:11:40.291962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.538205 (+246243us) service_pool.cc:224] Handling call
0709 13:11:42.152922 (+1614717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:42.242594 30835 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:42.365440 30835 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.365618 30689 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.322717 28580 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:11:42.230895 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 664230us
I20260709 13:11:42.323120 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 831) took 1004 ms. Trace:
I20260709 13:11:42.234313 30820 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.376907 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:42.370558 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.337538 30851 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.349347 30865 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.337808 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.272481 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.380892 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:42.366767 30714 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.809s	user 0.012s	sys 0.000s
I20260709 13:11:42.389161 28726 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:11:42.389321 30885 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.389840 28722 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:42.388266 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.390134 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.388652 28572 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:42.390784 28726 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:42.391454 30858 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.391726 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:42.390448 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 675) took 1054 ms. Trace:
I20260709 13:11:42.393767 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.393952 28722 rpcz_store.cc:276] 0709 13:11:41.336108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.337517 (+1001409us) service_pool.cc:224] Handling call
0709 13:11:42.390395 (+ 52878us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:42.358598 30838 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.319531 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:42.395581 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 76191.9us
I20260709 13:11:42.369158 29252 rpcz_store.cc:276] 0709 13:11:41.318959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.044391 (+725432us) service_pool.cc:224] Handling call
0709 13:11:42.225907 (+181516us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:11:42.323047 (+ 97140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36749568}
W20260709 13:11:42.365468 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49485.8us
I20260709 13:11:42.392071 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:42.396872 28622 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.397190 28726 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.397234 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.397527 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.398428 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.398548 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.370725 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.371088 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:42.373075 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.399603 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.375332 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.343453 28479 rpcz_store.cc:276] 0709 13:11:37.603302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.603462 (+   160us) service_pool.cc:224] Handling call
0709 13:11:42.342752 (+4739290us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:38.321177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:38.734232 (+413055us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:38.777721 (+ 43489us) write_op.cc:435] Acquired schema lock
0709 13:11:38.819105 (+ 41384us) tablet.cc:662] Decoding operations
0709 13:11:38.973124 (+154019us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:38.973182 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:38.973213 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:38.973528 (+   315us) tablet.cc:701] Row locks acquired
0709 13:11:38.973542 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:11:38.973696 (+   154us) write_op.cc:270] Start()
0709 13:11:38.973808 (+   112us) write_op.cc:276] Timestamp: P: 1783602698973648 usec, L: 0
0709 13:11:38.973827 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:38.996460 (+ 22633us) log.cc:844] Serialized 918 byte log entry
0709 13:11:40.517660 (+1521200us) op_driver.cc:464] REPLICATION: finished
0709 13:11:41.571290 (+1053630us) write_op.cc:301] APPLY: starting
0709 13:11:41.730610 (+159320us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:41.753859 (+ 23249us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:41.754057 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:41.881421 (+127364us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:41.909133 (+ 27712us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:11:41.950050 (+ 40917us) write_op.cc:312] APPLY: finished
0709 13:11:42.010509 (+ 60459us) log.cc:844] Serialized 29 byte log entry
0709 13:11:42.143003 (+132494us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:42.164728 (+ 21725us) write_op.cc:454] Released schema lock
0709 13:11:42.175973 (+ 11245us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:42.229026 (+ 53053us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:42.230211 (+  1185us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":996604,"apply.run_cpu_time_us":40061,"apply.run_wall_time_us":644899,"num_ops":2,"prepare.queue_time_us":157,"prepare.run_cpu_time_us":35896,"prepare.run_wall_time_us":1029374,"raft.queue_time_us":483266,"raft.run_cpu_time_us":39021,"raft.run_wall_time_us":1288616,"replication_time_us":1469920,"thread_start_us":1525205,"threads_started":4,"wal-append.queue_time_us":863579,"wal-append.run_cpu_time_us":14332,"wal-append.run_wall_time_us":1414357}]]}
I20260709 13:11:42.376269 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.401862 28721 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:42.334791 30675 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.326140 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.402704 28730 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:42.403577 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.404064 28730 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:42.378984 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:42.379446 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 199972us
I20260709 13:11:42.362828 28573 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:42.366102 30689 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:42.390559 28723 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:42.392020 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.410171 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.413020 28572 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:42.392483 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.399900 28729 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:42.374259 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.404959 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.361167 30720 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.406563 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.416256 28721 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:42.417157 29257 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:42.407653 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.255259 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.420221 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1094) took 1120 ms. Trace:
I20260709 13:11:42.420646 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.408023 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.390574 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:42.414701 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.355546 28576 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:42.417052 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.420657 29256 rpcz_store.cc:276] 0709 13:11:41.299340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.041186 (+741846us) service_pool.cc:224] Handling call
0709 13:11:42.420033 (+378847us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400569354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:42.420162 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439044352}
I20260709 13:11:42.422960 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:42.420214 29255 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:42.423696 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:42.425935 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.415361 30848 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:42.428148 30848 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:42.428565 30848 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.429294 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.429733 30829 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:42.430114 28723 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:42.431073 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.432256 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.389467 30714 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.433393 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.434237 30842 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:42.434552 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.434810 30837 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:42.435228 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:42.435633 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.418866 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:42.428417 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:42.434693 30842 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.335602 30741 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.464339 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.872406 28730 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:42.440431 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:42.873812 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 455001us
I20260709 13:11:42.525800 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:42.874823 28572 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.497866 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.436220 28651 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:42.879566 28579 raft_consensus.cc:1813] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Handling vote request from an unknown peer 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:42.626588 30851 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:42.685782 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 287938us
I20260709 13:11:42.881150 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:42.436204 30676 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:42.469830 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 59724.9us
I20260709 13:11:42.883234 30884 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:42.704643 30794 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:42.432832 28723 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:42.875506 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 677) took 1356 ms. Trace:
I20260709 13:11:42.634744 28726 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:42.522400 30891 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:42.416023 30689 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.884871 28728 rpcz_store.cc:276] 0709 13:11:41.518867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.785136 (+1266269us) service_pool.cc:224] Handling call
0709 13:11:42.785474 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.875067 (+ 89593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.875102 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:42.875177 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.875226 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.875284 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.875447 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:42.470343 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.873883 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.418044 30845 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.430151 30829 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.886129 28655 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:42.886440 30845 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:11:42.742893 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 289280us
I20260709 13:11:42.887032 30845 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.887300 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.883229 30676 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:42.887959 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:42.888162 30676 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:42.888604 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.889737 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:42.436493 30859 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.890749 30859 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:42.745059 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2129) took 1443 ms. Trace:
I20260709 13:11:42.891283 30859 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.891571 28648 rpcz_store.cc:276] 0709 13:11:41.301980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.532974 (+230994us) service_pool.cc:224] Handling call
0709 13:11:42.744866 (+1211892us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540027db54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:42.744978 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300908416}
I20260709 13:11:42.873736 28652 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:42.893868 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.895670 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:42.881839 28579 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:11:42.900169 28652 raft_consensus.cc:2368] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3.
I20260709 13:11:42.471338 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.900616 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:42.901134 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.901383 28579 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.471764 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:42.903067 28721 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:42.631017 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.905174 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.906487 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:42.526711 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 116187us
I20260709 13:11:42.882946 30858 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.884574 28575 raft_consensus.cc:2368] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5.
I20260709 13:11:42.398154 30885 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:42.381179 30823 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:42.908648 30823 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.908564 30885 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.705873 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:42.909262 30823 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.885519 30891 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.910082 30891 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.472664 30687 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:42.521926 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:42.455163 28654 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:42.917510 28649 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:42.917609 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2122) took 1617 ms. Trace:
I20260709 13:11:42.918027 28654 rpcz_store.cc:276] 0709 13:11:41.300086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.164215 (+864129us) service_pool.cc:224] Handling call
0709 13:11:42.164557 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.917299 (+752742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.917546 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:42.886507 30829 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:42.472791 30675 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.890282 28655 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.435966 28727 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 2: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:42.416046 30753 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.416087 30754 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.705046 30815 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.895431 30845 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.896478 28647 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:42.897378 30714 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.472419 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.442248 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.952869 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:42.470810 29258 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:42.393316 30788 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.898782 30842 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:42.626485 30865 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.628029 30820 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:42.933651 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 45759us
I20260709 13:11:42.743851 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 542) took 1192 ms. Trace:
I20260709 13:11:42.978365 28653 rpcz_store.cc:276] 0709 13:11:41.551225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.558196 (+  6971us) service_pool.cc:224] Handling call
0709 13:11:42.743676 (+1185480us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b54003d4fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:42.743794 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136937728}
I20260709 13:11:42.940584 30753 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:42.506219 30866 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.921603 30755 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:42.437086 30838 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:42.940053 30675 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:42.886102 30794 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.921886 30729 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:42.964041 30739 consensus_meta.cc:287] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 13:11:43.004005 30739 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.006515 30739 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.969080 30899 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:43.007180 30899 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:43.007644 30899 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.007478 30829 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.970045 30870 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.009352 30870 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:42.970950 30848 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.001s
I20260709 13:11:42.971942 30885 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:42.972908 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 65113.9us
I20260709 13:11:43.010744 30848 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.952602 30891 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:42.982128 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.012908 30845 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.985951 30861 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.983814 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.013972 30891 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.014354 29251 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:42.985744 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:42.945041 30754 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:43.016251 30754 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.961084 30720 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:43.018102 30720 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.018673 30720 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.988539 30866 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:43.020439 30866 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.021503 29252 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:43.023087 30864 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:42.999789 30758 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.964s	user 0.008s	sys 0.004s
I20260709 13:11:43.024339 30758 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.026182 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:43.026427 30758 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:43.027184 30729 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:43.027590 30729 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:43.027680 30829 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.027985 30729 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.028934 30689 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.031083 30689 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:42.961786 30815 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.033205 30815 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:43.033617 30815 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:43.035776 30835 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.000s
I20260709 13:11:43.036222 30835 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:43.037290 29223 leader_election.cc:336] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.547s (SENT)
I20260709 13:11:43.037755 30848 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:42.948663 30806 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:11:42.976693 30853 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:42.998633 30675 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.988252 30753 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.039264 30859 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.026767 30676 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:42.992509 29258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 829) took 1728 ms (client timeout 2056 ms). Trace:
I20260709 13:11:43.042479 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:42.986061 30687 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:43.046386 30676 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:43.048188 30815 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:43.042469 29258 rpcz_store.cc:269] 0709 13:11:41.264112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.572250 (+308138us) service_pool.cc:224] Handling call
0709 13:11:42.992254 (+1420004us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b5400327b54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:42.992433 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984178048}
I20260709 13:11:43.037292 30698 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.052155 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 833) took 1732 ms. Trace:
I20260709 13:11:43.054455 30729 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.052911 29253 rpcz_store.cc:276] 0709 13:11:41.319593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.361390 (+1041797us) service_pool.cc:224] Handling call
0709 13:11:42.361763 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:42.379190 (+ 17427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.382145 (+  2955us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.575951 (+193806us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.912085 (+336134us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:42.912147 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.912273 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.051811 (+139538us) raft_consensus.cc:1685] finished
0709 13:11:43.051863 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.052059 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2026,"raft.queue_time_us":3075,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":238157,"threads_started":1,"wal-append.queue_time_us":327584}
I20260709 13:11:43.057950 30823 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.060027 30823 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:43.060360 30870 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.061476 30859 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:43.062328 30701 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.002s
I20260709 13:11:43.062561 30835 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.062729 30870 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:43.062851 30701 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.063764 30729 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:43.064971 30815 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.065237 30899 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:42.928637 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 44461.2us
I20260709 13:11:42.898012 28572 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:42.906729 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:42.944052 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 238241us
I20260709 13:11:42.931421 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:42.971050 28728 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:11:42.966678 28651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1563) took 2829 ms (client timeout 3139 ms). Trace:
I20260709 13:11:42.956305 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:43.050004 30687 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.103076 28576 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:43.113870 28650 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:43.101903 28574 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:43.133853 28656 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.125039 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.069684 30899 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.100633 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:43.137625 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 144043us
I20260709 13:11:43.102783 28573 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:43.140340 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:43.144172 28581 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:11:43.114463 28651 rpcz_store.cc:269] 0709 13:11:40.136748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.137143 (+   395us) service_pool.cc:224] Handling call
0709 13:11:40.751191 (+614048us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1e9c 00007f4a24cf1a5b 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:11:42.966479 (+2215288us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b540003fcd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:42.966589 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097629312}
I20260709 13:11:43.111467 28578 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 2: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:11:43.110311 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 178846us
I20260709 13:11:43.151829 28546 leader_election.cc:400] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3.
I20260709 13:11:43.152348 28546 leader_election.cc:403] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:43.152859 28655 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:43.156756 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.157198 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.159435 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.163322 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:43.168040 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.170835 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.183741 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2211) took 1010 ms. Trace:
I20260709 13:11:43.196838 29256 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.197872 30842 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.200305 30842 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.196909 29260 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.206660 28656 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:43.217620 30754 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:43.205749 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 105645us
W20260709 13:11:43.221460 29223 leader_election.cc:336] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.788s (SENT)
I20260709 13:11:43.195390 28575 rpcz_store.cc:276] 0709 13:11:42.173027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.173140 (+   113us) service_pool.cc:224] Handling call
0709 13:11:43.183173 (+1010033us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b540031f954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:43.183513 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488964480}
I20260709 13:11:43.225082 28621 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:43.225378 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.226410 28728 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.227813 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:43.229728 30823 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.229423 30675 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.230392 30823 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:43.230994 30823 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.176373 30753 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.233182 29258 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.235293 30753 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.236300 30753 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:43.064976 30701 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:43.240731 28652 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:43.244738 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 93429.8us
I20260709 13:11:43.248224 30603 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3.
I20260709 13:11:43.250411 30810 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.201829 29253 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:43.253914 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.255165 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.255329 30755 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:43.261708 30701 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:43.262492 30701 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.262930 30755 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.265358 30698 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:43.266248 30698 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.267578 28730 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:43.271648 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.274706 28576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2219) took 1082 ms. Trace:
I20260709 13:11:43.275159 28576 rpcz_store.cc:276] 0709 13:11:42.191793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.422718 (+230925us) service_pool.cc:224] Handling call
0709 13:11:43.274420 (+851702us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54001aa254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:43.274619 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560317824}
I20260709 13:11:43.276804 29251 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 2: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:43.277649 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.277839 30870 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:43.278569 30870 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.279274 30870 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.286623 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2228) took 1015 ms. Trace:
I20260709 13:11:43.287117 28578 rpcz_store.cc:276] 0709 13:11:42.270820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.295576 (+ 24756us) service_pool.cc:224] Handling call
0709 13:11:43.286394 (+990818us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b5400352ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:43.286556 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871910144}
I20260709 13:11:43.288411 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.289213 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 739) took 1100 ms. Trace:
I20260709 13:11:43.287248 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.289857 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.290486 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.290828 28721 raft_consensus.cc:2376] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4. Re-sending same reply.
I20260709 13:11:43.291419 28727 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:43.278460 29252 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.236968 30753 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:43.240099 30687 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.262508 30835 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:43.301980 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:43.308409 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 55214.4us
I20260709 13:11:43.311391 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.302867 30698 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.289618 29257 rpcz_store.cc:276] 0709 13:11:42.188179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.702134 (+513955us) service_pool.cc:224] Handling call
0709 13:11:42.702533 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:42.949178 (+246645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.949211 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.950865 (+  1654us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.982278 (+ 31413us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.982315 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.288592 (+306277us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540048ab54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:43.288655 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.288717 (+    62us) raft_consensus.cc:1685] finished
0709 13:11:43.288730 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.288980 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72162,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7087,"spinlock_wait_cycles":483667840,"thread_start_us":58434,"threads_started":2,"wal-append.queue_time_us":92951}
I20260709 13:11:43.311827 30835 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.325721 30835 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.325348 30647 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:43.313040 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.326648 30647 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:43.327119 30647 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:43.312361 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.328888 29253 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.333235 30701 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.333617 30864 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:43.314805 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.309079 28726 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:11:43.241410 30823 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.338327 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.341743 28572 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:43.349408 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.355006 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.356073 28727 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:43.320977 30754 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.361419 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.362370 28729 raft_consensus.cc:2368] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4.
I20260709 13:11:43.319094 30753 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.368566 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.369694 28722 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:11:43.372099 28723 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.336527 30864 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:43.373457 30864 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.374607 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:43.373735 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.376132 28726 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:43.376961 30701 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.377489 30701 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:43.377938 30701 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.381536 28728 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:43.308610 28621 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:43.070513 30866 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.385921 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.386703 28721 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:43.387728 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.387887 30866 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.388833 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.389266 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:11:43.390051 29223 leader_election.cc:336] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.786s (SENT)
I20260709 13:11:43.390560 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:43.392355 30729 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:43.384295 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 133335us
I20260709 13:11:43.399122 30815 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.399883 30815 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.401667 29258 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:43.402631 30815 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:43.405864 28579 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.504s	user 0.013s	sys 0.006s
I20260709 13:11:43.406399 28579 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:43.407071 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2227) took 1138 ms. Trace:
I20260709 13:11:43.407421 28579 rpcz_store.cc:276] 0709 13:11:42.268398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.900335 (+631937us) service_pool.cc:224] Handling call
0709 13:11:43.406967 (+506632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:43.409683 29252 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:43.409489 30720 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.404235 30870 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.411603 30741 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.412467 30870 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.395145 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:43.328421 30647 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.409441 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.413144 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.440289 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.413676 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.414649 30675 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.416445 28575 raft_consensus.cc:2368] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5.
I20260709 13:11:43.417253 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.431272 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.433305 29256 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:43.441294 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:43.416951 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 122684us
I20260709 13:11:43.438139 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.439894 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:43.412976 29260 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:43.453337 28580 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
W20260709 13:11:43.429225 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 175638us
I20260709 13:11:43.453544 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.438944 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.432768 29251 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:43.432327 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:43.437763 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.461124 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.422857 30647 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.422524 30687 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:43.432879 30859 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:43.466167 29223 leader_election.cc:336] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.847s (SENT)
I20260709 13:11:43.466897 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:43.467638 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:43.467880 30810 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:43.468593 30859 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.468703 30810 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:43.469446 30859 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:43.470120 30810 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.470642 30859 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.468596 30729 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:43.473693 30729 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.474109 30729 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.474788 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.475217 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.475893 28729 raft_consensus.cc:2376] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4. Re-sending same reply.
I20260709 13:11:43.476225 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.476977 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.434630 30823 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:43.478335 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.473151 29258 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.467979 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:43.479918 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 50714.9us
I20260709 13:11:43.435686 29253 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:43.483590 28725 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:43.483103 28722 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:43.488021 28730 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
W20260709 13:11:43.489399 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49747.6us
I20260709 13:11:43.490002 30912 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:43.490404 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:43.492431 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.493319 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:43.500749 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:43.501938 30720 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:43.502171 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:43.504567 30755 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.505455 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.506841 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.507331 30714 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:43.507889 30714 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:43.508173 30755 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:43.508863 30714 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.512234 28726 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.508198 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.516413 29257 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:43.519341 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.520777 29258 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:43.490528 30912 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:43.527681 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.528770 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.530180 28730 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.530381 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:43.532493 30840 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:43.533058 30840 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:43.533469 30840 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.533502 28722 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:43.534672 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.537374 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.538481 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.546248 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:43.546492 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.547113 28575 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 1.
I20260709 13:11:43.547858 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.548491 28728 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:11:43.548833 28477 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: config changed from index 3 to 4, VOTER 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) evicted. New cstate: current_term: 1 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:43.549204 30864 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.553319 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:43.518396 30870 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:43.557859 30870 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:43.558339 30870 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.558408 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:43.558923 28730 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:43.560228 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.561308 30758 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.561519 28730 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:43.562186 30758 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:43.563210 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:43.564172 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.567500 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.562604 30758 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:43.573522 28727 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:43.538630 30755 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.568666 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.537705 30912 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.580267 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.582865 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.579588 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.525784 30835 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.587695 28580 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 2: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:43.588131 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.590387 28730 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:43.590502 29258 raft_consensus.cc:2368] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4.
I20260709 13:11:43.592674 28721 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:43.581743 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:43.586752 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:43.604385 30864 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.573429 30758 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.576566 30755 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:43.617060 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:43.624127 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:11:43.609987 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 125638us
W20260709 13:11:43.627590 30914 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:11:43.630227 30835 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:43.632234 30753 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:43.632997 30753 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:11:43.633705 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 155492us
I20260709 13:11:43.634343 30753 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.635828 30876 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:43.638442 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 51035us
I20260709 13:11:43.640702 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.641765 29253 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.642902 29254 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:43.643070 28547 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:43.634878 28621 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:43.610807 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.611254 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.647022 28727 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.620733 28725 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:43.649617 29252 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:43.652911 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.653612 29258 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:43.654009 30890 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.654397 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:43.655376 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.654531 30890 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:43.652961 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:43.665556 28581 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:43.665752 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.666805 28577 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:43.617246 30815 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.668030 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:43.600749 30701 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:43.678735 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 104970us
I20260709 13:11:43.677805 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.859948 28722 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:43.678325 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:43.724852 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 738) took 1420 ms. Trace:
I20260709 13:11:43.695196 29252 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.861491 29259 rpcz_store.cc:276] 0709 13:11:42.187836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.500185 (+312349us) service_pool.cc:224] Handling call
0709 13:11:42.927279 (+427094us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:11:42.927599 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.927958 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:43.223007 (+295049us) log.cc:844] Serialized 14 byte log entry
0709 13:11:43.497336 (+274329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:43.528252 (+ 30916us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:43.570222 (+ 41970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.586137 (+ 15915us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.608479 (+ 22342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41783,"prepare.queue_time_us":141130,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":6264,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":6510,"spinlock_wait_cycles":9886080,"thread_start_us":508794,"threads_started":2,"wal-append.queue_time_us":264879}
I20260709 13:11:43.719748 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.825153 30840 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.871768 30701 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:43.645315 30755 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:43.734436 28620 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.505s (SENT)
I20260709 13:11:43.865221 28578 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.704186 28547 leader_election.cc:400] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4.
I20260709 13:11:43.878506 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.878875 28547 leader_election.cc:403] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:11:43.725692 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 99511.5us
I20260709 13:11:43.866834 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.866892 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.769977 28726 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:43.695544 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.717332 29258 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.873294 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.859972 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:43.864285 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:43.878440 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:43.882401 28729 raft_consensus.cc:2368] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5.
W20260709 13:11:43.883136 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 248410us
I20260709 13:11:43.884863 28621 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:43.887331 30810 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.651505 30876 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:43.888070 28724 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:43.888736 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:43.889701 28573 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 2: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:43.667668 30890 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.889901 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.892499 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.893187 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.893644 28728 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:43.694373 30837 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:43.894690 30837 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:43.892645 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:43.896206 30689 raft_consensus.cc:2764] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:11:43.882053 30815 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:43.891598 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.905405 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.905965 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.906584 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.907434 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.907697 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.908428 28721 raft_consensus.cc:2368] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:43.911621 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:43.915614 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.915791 29256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:11:43.895429 30837 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.929891 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:43.879711 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:43.932492 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 45081.6us
I20260709 13:11:43.933511 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:43.957082 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 45625.2us
I20260709 13:11:43.958065 28727 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:43.921658 29256 raft_consensus.cc:606] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:11:43.934548 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52804.1us
W20260709 13:11:43.959591 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 99859.8us
I20260709 13:11:43.961831 30884 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:43.962304 30884 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:43.903900 30815 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.962683 30884 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.962793 30902 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.963338 30902 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:11:43.964758 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 85124.3us
I20260709 13:11:43.733603 30714 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:43.703815 30698 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:43.964294 30902 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.969887 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.898429 30729 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:43.970909 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:43.971535 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 293322us
I20260709 13:11:43.974220 28721 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:43.830649 30912 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:43.982103 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.933554 30810 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:43.976847 28724 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:43.983062 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:43.987999 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:43.989693 29254 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:43.975598 30866 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.991303 28728 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:11:43.991179 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 256876us
I20260709 13:11:43.986339 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:43.975466 30701 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.994899 30603 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:11:43.986346 30840 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:44.001396 30913 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:11:44.001920 30758 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.002954 30866 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.003553 30912 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:44.004237 30912 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:44.004081 30866 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.001497 30840 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:43.965464 30870 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.004681 30912 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:43.997045 28730 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:43.985110 30714 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:43.984567 30859 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:44.009860 30823 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:44.010273 30823 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.010499 30823 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.014647 30912 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.016127 30912 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:43.991205 30698 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.018926 30698 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.019879 30698 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:44.023036 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:44.021775 30870 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:44.039026 30870 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:44.039521 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:44.040258 28652 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:44.040361 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:44.041651 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:44.042475 28654 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:44.043435 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.043816 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:44.002902 30890 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.044577 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.045311 28721 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:44.045421 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.046231 28656 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:44.046448 30890 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.048206 29258 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:44.036814 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:44.050787 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.055496 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:44.056087 28620 leader_election.cc:336] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.171s (SENT)
I20260709 13:11:44.060173 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:44.063467 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.064544 28728 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:44.053553 28650 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:44.066476 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:44.067544 28724 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:44.021809 30698 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.074163 30758 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:44.121917 28723 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:44.085659 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 91144.9us
W20260709 13:11:44.112777 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 56747.8us
I20260709 13:11:44.137075 30758 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:44.138000 30758 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:44.138361 30758 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.138629 30870 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:44.139329 30758 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.140528 30870 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.141271 30870 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.141784 30603 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:44.142613 29260 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:44.142854 30603 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.143201 30603 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.143160 30870 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.144523 30603 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.145584 30870 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.146544 30603 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.147979 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:44.150651 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:44.140681 30758 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.152983 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:11:44.154832 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.160626 30870 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:44.084919 28545 leader_election.cc:400] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4.
I20260709 13:11:44.109802 30890 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:44.165803 30890 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:44.166425 30890 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.084110 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:44.165845 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 97531.3us
W20260709 13:11:44.170956 28620 leader_election.cc:336] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.215s (SENT)
I20260709 13:11:44.170387 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:44.171609 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.172698 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.185407 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:44.074568 30714 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.187104 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.188253 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.192773 30729 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:44.204625 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:44.205236 30926 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:44.205418 30899 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.205691 30926 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.206708 30926 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.210578 30929 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:44.212039 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:44.214869 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:44.187162 30754 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:44.212787 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.207726 30926 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.219079 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:44.230546 28574 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:44.202086 30603 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:44.212893 30929 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.241052 30935 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:44.241197 30698 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.242472 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.240280 30884 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:44.252703 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 69736us
I20260709 13:11:44.217557 30835 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.246510 30603 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:44.263754 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.189074 30810 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.281579 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.282384 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.246294 30929 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:44.285934 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.288029 28648 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 2: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:44.269268 30720 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.264856 30603 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.291133 30913 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.291531 30913 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.292434 30913 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.293696 30913 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.294516 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:44.295529 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:44.296597 30900 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:44.297035 30900 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:44.297411 30900 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:44.300391 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.300563 30729 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:44.295394 30823 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.305594 30929 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.307113 30929 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.307507 30823 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:44.311319 29254 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:44.284385 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 169356us
I20260709 13:11:44.314774 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:44.323792 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:11:44.331875 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 89489.7us
I20260709 13:11:44.333377 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.329365 28654 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.285482 30698 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.354076 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.356021 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:44.358331 29254 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:44.351356 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:44.370930 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 197064us
I20260709 13:11:44.380261 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:44.362082 28620 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.554s (SENT)
I20260709 13:11:44.391197 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.393046 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:44.372937 30729 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:44.395493 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 72007.9us
W20260709 13:11:44.397553 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 64271us
I20260709 13:11:44.374169 30687 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.391867 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:44.384388 30720 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:44.330036 30837 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.372669 30823 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:11:44.421468 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:44.422610 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.407214 30912 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:44.423386 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.407274 30720 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:44.427639 28723 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:11:44.428330 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 57876.6us
I20260709 13:11:44.431222 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:44.432237 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:44.437502 30884 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:44.440248 30904 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:11:44.441530 30904 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:44.441987 30904 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:44.443015 30904 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.444546 30848 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:44.445436 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.446357 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.447464 30837 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:44.447547 30758 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:44.415766 30714 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:44.415112 30935 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.467360 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:44.475430 28654 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:44.398193 30900 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:44.479579 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 117542us
W20260709 13:11:44.475144 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 51927.4us
W20260709 13:11:44.481341 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 97850.9us
I20260709 13:11:44.425925 30912 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:44.455576 30720 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.486335 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:44.426939 30925 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:44.486539 30948 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:44.465903 30729 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:44.548590 30603 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:44.550755 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 120918us
W20260709 13:11:44.559764 28620 leader_election.cc:336] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.559s (SENT)
I20260709 13:11:44.490177 30647 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:44.482398 30758 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.561934 28654 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:44.539351 30912 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:44.559927 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 139968us
W20260709 13:11:44.563030 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 76847us
W20260709 13:11:44.570401 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.552745 30701 consensus_meta.cc:287] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.007s
I20260709 13:11:44.571280 30701 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4.
W20260709 13:11:44.574723 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 166940us
I20260709 13:11:44.576017 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.549952 30948 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.584182 30689 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:44.590135 30689 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.592567 30689 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:44.593138 30933 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:44.593991 30933 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.599509 30603 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.601367 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.601688 29254 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:44.602021 30900 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:44.602157 28654 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.603704 30947 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:44.604471 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.605235 28652 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.605530 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.606122 28656 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:44.606355 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.565979 30647 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:44.585969 28620 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.580s (SENT) [suppressed 56 similar messages]
I20260709 13:11:44.631224 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.596798 30935 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.633474 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:44.633647 30675 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.634116 30675 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:11:44.634330 30755 consensus_meta.cc:287] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.002s
I20260709 13:11:44.634964 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:44.634819 30755 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:44.661568 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85674.4us
W20260709 13:11:44.662493 28620 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.626s (SENT)
I20260709 13:11:44.662951 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.659255 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.663975 29256 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:44.586555 30948 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:44.664645 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 111502us
I20260709 13:11:44.626778 30647 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.677767 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:44.677855 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55046.8us
I20260709 13:11:44.669747 29258 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:44.670555 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.666438 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.679898 28649 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.688812 28652 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:44.684826 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.686750 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.690606 28580 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:44.694386 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.695370 28652 raft_consensus.cc:2368] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7.
W20260709 13:11:44.698405 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.701272 28575 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:44.685158 30937 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:11:44.714075 28648 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:11:44.718437 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 167819us
I20260709 13:11:44.716586 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.565105 30925 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.691924 30687 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.728986 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.679204 30952 raft_consensus.cc:2764] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:44.725304 28654 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:44.685489 30933 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.630553 30754 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:11:44.722172 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 317428us
I20260709 13:11:44.747179 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:44.746032 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:44.749945 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 71155.5us
I20260709 13:11:44.635064 30675 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.729116 30815 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:44.767616 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.729300 30714 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:44.768893 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:44.776891 29259 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:44.770931 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.781461 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 145618us
W20260709 13:11:44.779884 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 225828us
I20260709 13:11:44.784396 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:44.797518 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:44.803843 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 72680.6us
I20260709 13:11:44.806412 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.774513 30913 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:44.779682 30815 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:44.815747 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.816417 28725 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.772289 30959 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:44.820514 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:44.821076 28620 leader_election.cc:336] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.810s (SENT)
I20260709 13:11:44.821722 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.735889 30758 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:44.811337 30929 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.003s
I20260709 13:11:44.838997 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.824203 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:44.823911 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 49263us
W20260709 13:11:44.841415 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 112656us
I20260709 13:11:44.842638 28621 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:44.842988 28621 leader_election.cc:403] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:44.843194 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.822372 30815 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:44.850592 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.854377 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.855486 28649 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:44.855715 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:44.856662 28574 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 2: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:44.857319 30912 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.857728 30720 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:44.858932 30890 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.005s
I20260709 13:11:44.859064 29254 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:44.859411 30890 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.860556 28576 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:44.785983 30714 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.786746 30952 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:11:44.861457 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.845028 30913 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.829725 30884 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:44.862990 28722 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:44.863596 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.839998 29251 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:44.867888 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:44.867537 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:44.881508 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.882017 30720 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:44.893328 30956 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:11:44.851620 30946 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:44.894827 30946 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:44.895301 30946 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.869144 30955 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.180s
I20260709 13:11:44.896569 30884 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:44.897861 30714 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.897758 30884 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:44.899044 30966 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:11:44.899889 30647 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.865103 30912 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.851886 30835 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:44.908238 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44804.9us
I20260709 13:11:44.908313 30835 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.865476 30754 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:44.883276 30689 raft_consensus.cc:993] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:44.910562 30689 raft_consensus.cc:1081] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:11:44.910938 30904 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:44.883422 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62409.4us
I20260709 13:11:44.884045 30967 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:44.886159 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44028.7us
I20260709 13:11:44.908051 30933 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:44.914583 30933 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:44.873283 28621 leader_election.cc:400] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5.
I20260709 13:11:44.915596 30933 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:44.829891 30953 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:44.918661 29253 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:44.886826 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48553us
I20260709 13:11:44.922386 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.922749 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.824494 30959 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:44.869668 30926 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 13:11:44.841286 30949 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:44.924419 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.888422 28725 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:44.888926 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 587) took 1019 ms. Trace:
I20260709 13:11:44.871814 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:44.926030 28655 raft_consensus.cc:2410] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:44.926595 28574 raft_consensus.cc:2410] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:44.926904 30952 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:44.892211 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 68084.8us
I20260709 13:11:44.901645 30755 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.902415 30925 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.926046 28575 rpcz_store.cc:276] 0709 13:11:43.869304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.870176 (+   872us) service_pool.cc:224] Handling call
0709 13:11:43.870513 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.708800 (+838287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.888693 (+179893us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54003fdc54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:44.888869 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909947264}
I20260709 13:11:44.932781 28723 raft_consensus.cc:2368] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7.
I20260709 13:11:44.903093 30951 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.933508 30951 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.934800 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:44.935595 28577 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:44.935822 30951 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:44.907513 30971 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:44.913625 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:44.937033 28576 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:44.938253 28581 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:44.938582 28579 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:44.904073 30913 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:44.940587 28579 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:44.940951 28579 pending_rounds.cc:85] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 5
I20260709 13:11:44.941254 28579 pending_rounds.cc:107] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:44.941568 28579 raft_consensus.cc:2889] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.941844 30953 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.942111 28577 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:44.942627 28572 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:44.845721 30876 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.903012 30970 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:44.934912 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:44.935551 28573 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.944063 28574 raft_consensus.cc:2368] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:44.944278 28575 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:44.944609 28572 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:44.944972 28572 pending_rounds.cc:85] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 5
I20260709 13:11:44.944913 30837 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:44.945369 28572 pending_rounds.cc:107] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:44.945619 28572 raft_consensus.cc:2889] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.946225 30729 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:44.946581 30933 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.928553 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:44.911513 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.947338 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.954732 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.955960 30951 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.956698 30951 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:44.957621 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:44.958226 28579 raft_consensus.cc:2376] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4. Re-sending same reply.
I20260709 13:11:44.959465 29252 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:44.962594 30890 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:44.886760 30687 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.964255 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:44.964603 28578 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:44.966890 28575 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:44.964849 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:44.924693 30959 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.968711 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.968932 29254 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:44.969460 28725 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:44.971923 28577 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:44.977609 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 591) took 1019 ms. Trace:
I20260709 13:11:44.977769 29252 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:44.978847 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:45.037925 29258 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.080753 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:44.968575 30953 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:45.088622 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 177253us
W20260709 13:11:45.077471 28620 leader_election.cc:336] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.647s (SENT)
I20260709 13:11:44.978335 28580 rpcz_store.cc:276] 0709 13:11:43.958616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.958755 (+   139us) service_pool.cc:224] Handling call
0709 13:11:44.977438 (+1018683us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54001fbb54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:44.977555 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341455232}
I20260709 13:11:45.092495 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.968570 30960 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:45.089741 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 161262us
I20260709 13:11:45.102450 29224 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.104131 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:44.966159 30714 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.096827 28546 leader_election.cc:400] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7.
I20260709 13:11:45.120944 28546 leader_election.cc:403] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:45.096845 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.106613 28477 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 274) took 6993 ms. Trace:
I20260709 13:11:45.107764 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.110249 30687 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.111389 28722 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:45.123354 30754 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:45.045940 30951 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:45.111538 30946 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.112025 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:45.134220 28575 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:45.112739 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:45.114847 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:44.969900 30720 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.116230 30958 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:45.116797 30647 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:45.117113 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.117404 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.118690 30864 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:45.119129 29256 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:45.118975 30948 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:45.119392 30902 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:45.119535 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:45.036166 30970 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:11:45.108865 28573 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:11:45.121877 28723 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.128927 28475 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 3, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.130414 30926 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:45.156975 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:45.045174 30904 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:11:45.130883 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:45.135068 28727 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
W20260709 13:11:45.139133 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61732.3us
I20260709 13:11:45.144132 29259 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.145853 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:45.156740 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:45.120777 30714 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:45.128234 28580 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:45.161608 29252 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:45.133322 30912 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.170439 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.172327 30946 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:45.172753 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:45.126459 30753 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:11:45.173655 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 58922.3us
I20260709 13:11:45.174021 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:45.174196 30753 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:45.174609 30753 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:45.175251 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:45.175446 30753 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.176456 30926 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:45.176674 30720 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:45.176985 30926 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:45.177237 30689 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.177495 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:45.177977 30689 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.178037 30926 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:45.179020 30949 consensus_queue.cc:1175] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d64d870625d6461b89b1fb75cd2e26e0" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:11:45.179540 30926 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:45.179628 28620 leader_election.cc:336] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.656s (SENT)
W20260709 13:11:45.181147 28620 leader_election.cc:336] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.824s (SENT)
I20260709 13:11:45.181978 28728 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:11:45.181986 28620 leader_election.cc:336] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.825s (SENT)
I20260709 13:11:45.182814 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.166370 30948 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:45.047477 30876 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:11:45.088847 30815 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:45.169353 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 222069us
I20260709 13:11:45.138901 30754 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.151450 30884 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.176455 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:45.182852 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:45.188391 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 57566.8us
I20260709 13:11:45.195448 28545 leader_election.cc:400] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7.
I20260709 13:11:45.188582 28723 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:45.169580 30970 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:45.192466 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.199951 28578 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:11:45.193049 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.158635 30890 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7.
I20260709 13:11:45.201995 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.202351 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.176760 30753 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.177484 30720 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:45.202879 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.207464 28730 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:45.144718 30958 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:45.183390 30935 consensus_queue.cc:1175] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d64d870625d6461b89b1fb75cd2e26e0" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:11:45.209195 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:11:45.218644 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 90938.4us
I20260709 13:11:45.193408 30755 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.219779 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.218837 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:45.222738 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.161311 30810 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:11:45.226570 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:45.205739 30758 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.144974 30960 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:11:45.161490 30936 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:11:45.195060 30912 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:45.199437 30970 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:45.233518 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.235070 30970 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:45.236424 30970 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:45.215545 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.223798 30925 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.242007 30925 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:45.243741 28646 tablet_service.cc:1558] Processing DeleteTablet for tablet 6caf9ec933124d00b3e0e2cfeccd317b with delete_type TABLET_DATA_TOMBSTONED (TS 0c0ecde0af494dc9b152dee191c6d3e6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50986
I20260709 13:11:45.229969 30963 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.244333 30714 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.245638 30714 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.247195 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.248003 28577 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 2: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:45.251645 30912 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:45.252708 30912 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:45.259341 30675 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.262820 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.268595 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:45.269568 29258 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 2: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:45.212776 30884 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.229699 30948 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:11:45.270716 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.248611 30959 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.271770 30729 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:45.272377 30729 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:45.273026 30959 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:45.273324 29251 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:45.278735 30958 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:45.195706 30938 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:11:45.199088 30973 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:45.121650 28477 rpcz_store.cc:276] 0709 13:11:38.113376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.122117 (+  8741us) service_pool.cc:224] Handling call
0709 13:11:45.106494 (+6984377us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:43.861527 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:43.862173 (+   646us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:43.862217 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:11:43.862248 (+    31us) tablet.cc:662] Decoding operations
0709 13:11:43.862655 (+   407us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:43.862736 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:43.862778 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:43.863065 (+   287us) tablet.cc:701] Row locks acquired
0709 13:11:43.863113 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:11:43.863275 (+   162us) write_op.cc:270] Start()
0709 13:11:43.863435 (+   160us) write_op.cc:276] Timestamp: P: 1783602703863215 usec, L: 0
0709 13:11:43.863455 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:11:43.963419 (+ 99964us) log.cc:844] Serialized 533 byte log entry
0709 13:11:44.474007 (+510588us) op_driver.cc:464] REPLICATION: finished
0709 13:11:44.800261 (+326254us) write_op.cc:301] APPLY: starting
0709 13:11:44.813885 (+ 13624us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:44.849636 (+ 35751us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:44.878538 (+ 28902us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:44.879007 (+   469us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:44.879305 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:44.879358 (+    53us) write_op.cc:312] APPLY: finished
0709 13:11:44.879644 (+   286us) log.cc:844] Serialized 23 byte log entry
0709 13:11:44.879855 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:44.879942 (+    87us) write_op.cc:454] Released schema lock
0709 13:11:44.879998 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:44.880532 (+   534us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:44.880565 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61741,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":253124,"apply.run_cpu_time_us":2753,"apply.run_wall_time_us":108385,"num_ops":1,"prepare.queue_time_us":308896,"prepare.run_cpu_time_us":16856,"prepare.run_wall_time_us":212667,"raft.queue_time_us":86544,"raft.run_cpu_time_us":34962,"raft.run_wall_time_us":259274,"replication_time_us":553381,"thread_start_us":414202,"threads_started":4,"wal-append.queue_time_us":258390}]]}
I20260709 13:11:45.190371 30859 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:11:45.214810 30647 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:45.224313 30955 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.205576 30840 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:45.229308 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:45.287135 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85530.1us
I20260709 13:11:45.264732 30835 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:45.301373 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.302670 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:11:45.303815 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 184340us
I20260709 13:11:45.305953 28621 leader_election.cc:400] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:45.306205 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.306224 28621 leader_election.cc:403] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:45.307331 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:11:45.309070 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 79795.2us
I20260709 13:11:45.287107 30973 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:45.374713 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 67009.3us
I20260709 13:11:45.300068 30949 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:11:45.375100 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 73855.7us
I20260709 13:11:45.296345 30902 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:45.287396 30647 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:45.273344 30729 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:45.384589 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 160012us
I20260709 13:11:45.386660 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:45.318106 30959 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.421670 28574 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:45.422304 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.313710 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:45.396144 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.375277 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:45.288398 30810 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.399394 28578 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.400846 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.403904 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.378181 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:45.409464 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.409854 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.414456 28727 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:45.416579 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:45.423440 28572 raft_consensus.cc:2393] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:45.385497 30835 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:45.439715 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 257727us
I20260709 13:11:45.396080 30936 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:45.399791 30973 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:45.457346 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53600.3us
I20260709 13:11:45.466710 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.377219 30946 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:11:45.411545 30902 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:45.475930 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:45.476411 28579 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.479174 28573 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:45.479555 30980 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:45.475523 30753 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:45.481798 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:45.482986 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.483559 28722 raft_consensus.cc:2376] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3. Re-sending same reply.
W20260709 13:11:45.484117 30978 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:45.484365 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:45.485713 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69239.7us
I20260709 13:11:45.486074 28729 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:45.485176 30983 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:45.490764 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:45.412528 30840 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 13:11:45.509244 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 201270us
I20260709 13:11:45.493463 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:11:45.497514 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.510934 28620 leader_election.cc:336] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.944s (SENT)
I20260709 13:11:45.498970 28724 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:45.502312 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:45.480118 30982 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:11:45.495757 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:45.519526 28729 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:45.522570 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:45.492514 30935 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:45.527737 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:45.474773 30936 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:45.497062 30753 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:45.503051 30758 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:45.539297 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:45.539526 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:45.543445 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.515513 30720 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.545418 28722 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:45.548462 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55112.8us
I20260709 13:11:45.536605 28580 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:45.507505 30815 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:45.521118 30926 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:45.555222 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:45.525566 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:45.560997 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:45.561213 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:45.562642 28575 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.563007 28723 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:45.548568 30996 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.557852 30980 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:45.499591 30647 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.574842 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:45.587649 30985 tablet_replica.cc:333] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:11:45.573434 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:45.555351 30970 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:45.587538 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:45.573062 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:45.605527 28578 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:45.584679 28577 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:45.591907 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:45.550849 30810 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:11:45.609222 28652 raft_consensus.cc:2376] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3. Re-sending same reply.
I20260709 13:11:45.565737 30951 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.601900 28574 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.558934 30720 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.581167 30980 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:45.607208 28573 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 7: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:45.602087 30926 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:45.572470 30949 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:11:45.619335 30980 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:45.600792 30859 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:11:45.626578 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:45.605831 30935 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:45.621744 30999 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.553468 30902 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:45.603091 30970 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:45.618913 28729 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:45.576098 30753 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:45.631992 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 76862.7us
I20260709 13:11:45.622284 30926 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.636790 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:45.636929 30926 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:45.637645 30840 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:45.638142 30840 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:45.639004 30840 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.577603 30996 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.642750 30996 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:45.644017 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.644896 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:45.645588 29260 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
W20260709 13:11:45.646217 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 58467.5us
I20260709 13:11:45.647725 28722 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:45.662830 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:45.664335 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:45.665628 28620 leader_election.cc:400] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:45.666996 28620 leader_election.cc:403] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:45.666320 30926 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:45.619371 30997 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:45.678473 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44084.6us
I20260709 13:11:45.633244 30815 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.792405 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:45.808533 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:45.865693 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55630.6us
I20260709 13:11:45.875586 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:45.694187 30859 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:45.865520 30675 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:45.868441 30958 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:46.007094 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.668349 30999 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:45.973477 30959 consensus_meta.cc:287] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:11:46.014420 30720 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:45.938303 30859 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:45.880041 30948 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:11:45.971529 30815 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:11:45.683303 30997 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:46.049201 30986 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:11:46.051470 28574 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
W20260709 13:11:46.056169 30989 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.441s	user 0.001s	sys 0.000s
I20260709 13:11:46.026322 30959 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:46.130038 30977 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:46.131479 31002 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
I20260709 13:11:46.129442 30859 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.146790 30859 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.053499 30840 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:46.150458 30995 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:46.151338 30995 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.155470 31001 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:46.156358 31001 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:45.882189 30987 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.491s
I20260709 13:11:45.971282 30935 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:46.052029 30913 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:46.191187 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 525626us
I20260709 13:11:46.193231 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.185225 30913 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.216197 31006 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:46.217285 31006 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.217867 31006 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.220598 31006 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.225665 30997 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.226933 30999 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.209049 30936 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:46.231422 30987 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:46.210808 30913 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.268767 30933 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:46.245085 30758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.135s	sys 0.213s
I20260709 13:11:46.276288 30995 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:46.249361 28545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.070s	sys 0.067s
W20260709 13:11:46.297597 28545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.070s	sys 0.067s
I20260709 13:11:46.278491 30926 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:46.265745 31006 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:11:46.295501 28547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.019s	sys 0.088s
I20260709 13:11:46.278913 31003 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:46.310943 28547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.019s	sys 0.088s
I20260709 13:11:46.288158 30933 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:11:46.299659 30955 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.988s	user 0.013s	sys 0.002s
I20260709 13:11:46.320593 28577 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:46.316994 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:46.295506 30758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.136s	sys 0.214s
W20260709 13:11:46.310927 30714 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.065s	user 0.015s	sys 0.000s
I20260709 13:11:46.322043 29260 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:46.321580 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:46.301280 31014 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.328940 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:46.332443 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 459944us
I20260709 13:11:46.333042 29259 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:46.333645 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:46.334962 29255 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 2: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
W20260709 13:11:46.336325 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.017s	sys 0.021s
W20260709 13:11:46.336814 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.017s	sys 0.021s
W20260709 13:11:46.321673 31011 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 13:11:46.322279 30955 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:46.360361 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.1467e+06us
I20260709 13:11:46.350798 31001 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.341034 31003 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:46.375854 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:46.320713 31004 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:46.372933 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 179812us
W20260709 13:11:46.381352 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 483276us
I20260709 13:11:46.371461 30754 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:46.392674 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:46.392765 28576 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:46.402331 28581 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.393226 28655 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:46.402490 28577 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.369885 30933 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.406637 30933 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:46.382761 29224 connection.cc:256] RPC call timeout handler was delayed by -1.0855804270000817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:11:46.414119 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:46.414882 28578 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:46.336701 31014 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.417028 28695 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:46.411502 30754 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:46.393290 31003 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:46.369578 31012 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 13:11:46.441176 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55671.9us
I20260709 13:11:46.443363 28620 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4.
I20260709 13:11:46.443431 28577 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:46.447566 28576 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:46.449358 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 125718us
W20260709 13:11:46.382162 30912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.126s	user 0.040s	sys 0.038s
I20260709 13:11:46.439975 30977 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:46.439302 30960 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:46.461215 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:46.468793 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 51877.1us
I20260709 13:11:46.471378 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:46.456686 30912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.040s	sys 0.042s
I20260709 13:11:46.422614 30936 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:11:46.475142 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:46.481997 28577 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:46.483178 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.484972 28725 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.467634 30960 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:46.478374 30720 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:11:46.493324 30936 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:46.493794 30936 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:46.494704 30936 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.496062 30936 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.478945 30810 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:46.489977 30977 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:46.504702 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49452.6us
I20260709 13:11:46.510440 28577 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.512010 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:46.512881 28576 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:46.501834 30815 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.490314 31021 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:46.516451 31005 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260709 13:11:46.517114 31032 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:46.516126 30815 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.518966 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 869) took 1602 ms. Trace:
W20260709 13:11:46.519765 31017 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:11:46.499347 30912 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.501564 30948 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:46.473727 30754 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:46.533223 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.511750 30675 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.537123 30720 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:46.510818 30689 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:46.539359 30948 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:46.546429 31016 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.546931 30948 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.547263 31016 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.549243 30720 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:46.537146 30913 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.519449 30815 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.557261 31019 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:46.545914 30675 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.562943 30754 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:46.556145 30980 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.925s	user 0.009s	sys 0.004s
I20260709 13:11:46.550174 30720 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.519436 29251 rpcz_store.cc:276] 0709 13:11:44.917065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.917281 (+   216us) service_pool.cc:224] Handling call
0709 13:11:44.917638 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.273995 (+356357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.518650 (+1244655us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54006aa754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:46.518880 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817305984}
I20260709 13:11:46.571435 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.521169 30977 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.507858 31003 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:46.577600 31016 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.537567 31021 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.581065 30913 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.569252 30980 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:46.582940 30973 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.084s	user 0.001s	sys 0.013s
I20260709 13:11:46.583388 30973 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.583844 30980 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.545812 30960 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.539719 30912 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.586213 30960 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.593546 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.596105 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2140) took 1072 ms. Trace:
I20260709 13:11:46.596519 28729 rpcz_store.cc:276] 0709 13:11:45.523649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.523788 (+   139us) service_pool.cc:224] Handling call
0709 13:11:45.543889 (+ 20101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.631427 (+ 87538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.595829 (+964402us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b54002814d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:46.596016 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167024896}
I20260709 13:11:46.597970 30810 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:46.598803 30810 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:46.599565 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:46.600234 28725 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.600306 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:46.600978 28724 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:46.603309 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.602171 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:46.605687 28722 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:46.606038 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:46.602480 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:46.618647 28725 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:46.588977 31019 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:46.628031 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.635115 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.636636 28725 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:46.631984 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:46.627003 30810 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:46.640183 31024 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.640560 31019 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:46.641245 31016 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:46.640736 31024 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.637727 30980 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:46.656100 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.629555 30913 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:46.658668 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.694402 28654 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:46.694659 28647 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:46.694607 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.661599 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.662465 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.663412 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.666236 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:46.673215 31030 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:11:46.675946 30912 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.648218 30973 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.676646 31024 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.638712 30859 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:11:46.646432 28725 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:46.720733 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:46.721714 28725 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:46.688063 31010 raft_consensus.cc:2764] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:46.707506 28650 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:46.707726 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.723481 28648 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:46.726006 28654 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:46.708130 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.656023 31012 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:11:46.649829 31016 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:11:46.721974 31027 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:11:46.695456 28651 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:46.660656 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.723539 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:46.724015 31034 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:11:46.733351 28647 raft_consensus.cc:2410] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:46.724278 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:46.727278 28649 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:46.740005 31021 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.740643 30755 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:46.731386 31024 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:46.746444 31016 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:46.746722 30949 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:46.735545 30912 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:46.763368 28649 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.751784 30755 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:46.764649 30729 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:46.765085 30729 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:46.764950 30755 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.758059 31010 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.760183 30949 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:46.761888 30912 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.772836 31010 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.787163 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:46.787585 30912 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:46.832887 30998 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.833662 30998 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:46.838882 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 338609us
I20260709 13:11:46.842087 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:46.829121 31032 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:46.846195 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:46.847167 28578 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:46.848656 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:46.849704 28647 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:46.773806 30729 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.836678 30998 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.845773 31010 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.843475 31032 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:46.858546 28649 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.859285 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.858152 31032 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.860404 28651 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:46.873957 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:46.876382 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.873755 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.880720 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.880935 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.881754 28650 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:46.883490 28648 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
W20260709 13:11:46.884020 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:46.886161 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.886034 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.891003 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:46.887164 28647 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:46.894140 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.894905 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:46.895638 28650 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.901391 31040 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:46.902132 31040 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:46.903453 31040 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.905671 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:46.905961 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:46.906368 28651 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.906663 28653 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.909437 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1607) took 1332 ms. Trace:
I20260709 13:11:46.880789 30754 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.909940 28655 rpcz_store.cc:276] 0709 13:11:45.574771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.575020 (+   249us) service_pool.cc:224] Handling call
0709 13:11:46.906826 (+1331806us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540027ef54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:46.906953 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812203904}
I20260709 13:11:46.917438 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:46.879467 30947 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:46.918385 28654 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
W20260709 13:11:46.918668 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 45007.4us
I20260709 13:11:46.921408 28648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49584
I20260709 13:11:46.924045 28648 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.924721 28648 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.934553 28724 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:46.936810 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:46.922102 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:46.945768 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 465890us
I20260709 13:11:46.929437 31040 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:46.921406 31019 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:46.921456 30947 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:46.928895 30810 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:46.929664 30904 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:46.959167 29224 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:46.946408 31032 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.962571 28648 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.929193 30754 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:46.859825 30949 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:46.964363 30823 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.683s	user 0.026s	sys 0.061s
I20260709 13:11:46.957165 30998 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.952442 30859 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:11:46.981784 31021 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.964020 28654 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:46.985255 30835 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:46.996167 30823 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.715s	user 0.027s	sys 0.062s
I20260709 13:11:46.993539 31048 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:47.115374 28650 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:46.964149 31050 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:11:47.102648 31010 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.032125 31021 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:46.993413 31030 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:46.985663 30810 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.123593 28648 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:46.982722 31019 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.142504 28647 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:47.146888 28651 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
W20260709 13:11:47.131330 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 209419us
I20260709 13:11:47.166235 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:47.177330 30859 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.177544 30949 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.177259 31039 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:47.052801 30998 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:46.985888 30904 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.129125 31042 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:47.194926 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:47.110106 30835 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:47.193405 31037 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:47.137972 31021 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.197101 28653 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:47.141625 31048 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:11:47.177332 30974 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.666s	user 0.019s	sys 0.019s
W20260709 13:11:47.199146 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 239794us
I20260709 13:11:47.178117 30859 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:47.204335 31042 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:47.211555 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:47.197372 30948 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:47.210419 31038 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.214808 31024 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.218667 30859 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.222435 30985 raft_consensus.cc:2243] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:47.151520 31030 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.225406 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2177) took 1827 ms. Trace:
I20260709 13:11:47.237447 28575 rpcz_store.cc:276] 0709 13:11:45.398413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.398651 (+   238us) service_pool.cc:224] Handling call
0709 13:11:45.399001 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.563041 (+164040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.225081 (+1662040us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400352ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:47.225302 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368627072}
W20260709 13:11:47.225835 31044 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:11:47.228771 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:47.231957 28580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2173) took 1940 ms (client timeout 1802 ms). Trace:
I20260709 13:11:47.141691 31010 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.235659 30810 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:47.245584 28727 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.044s	sys 0.037s
W20260709 13:11:47.245793 28580 rpcz_store.cc:269] 0709 13:11:45.285989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.286143 (+   154us) service_pool.cc:224] Handling call
0709 13:11:47.226277 (+1940134us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001fb654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:47.226418 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355670784}
I20260709 13:11:47.182230 30947 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.264326 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:47.296283 30754 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.268509 31040 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:47.256388 28727 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.044s	sys 0.037s
I20260709 13:11:47.196977 31039 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.222435 30904 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.266798 30948 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:47.286963 31050 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:47.321995 31016 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:47.267158 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.414498 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 464404us
W20260709 13:11:47.296262 31051 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:11:47.244716 31024 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.339908 30985 raft_consensus.cc:2272] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:47.286103 31042 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.340224 30998 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.324985 31032 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:47.409135 30981 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.415488 30835 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.424909 28722 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:47.428623 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 164395us
I20260709 13:11:47.325543 31021 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:47.414352 31028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.029s
I20260709 13:11:47.411690 31039 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.413524 30936 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.415539 31040 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.536777 30936 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:47.536984 31040 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.413558 31050 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:47.410004 31048 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.433851 28724 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:47.458006 28726 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:47.444451 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.502053 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:47.503473 28572 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:11:47.505383 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 479500us
W20260709 13:11:47.550069 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.421576 31016 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:47.551649 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49890.8us
I20260709 13:11:47.552277 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:47.424198 30904 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.433537 30840 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.550709 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:47.515290 30948 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:47.522222 30973 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:47.527834 31008 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.364s	user 0.004s	sys 0.012s
I20260709 13:11:47.532961 31021 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.559617 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:47.537405 30936 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.326934 31030 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:47.426422 31010 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.574590 30982 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.575287 30982 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:47.420981 30947 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.546365 31040 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:47.505223 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 245996us
W20260709 13:11:47.431876 30912 consensus_meta.cc:287] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.592s	user 0.004s	sys 0.008s
I20260709 13:11:47.459935 31042 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:47.481505 30983 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.458690 31024 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.578896 31054 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:47.509336 31028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.009s	sys 0.029s
I20260709 13:11:47.559686 31066 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:47.594197 28647 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:47.594614 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:47.427345 31019 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.573421 30859 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.573870 30899 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.576568 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:47.604099 28728 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:47.551257 31037 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:47.464847 31032 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.570333 30929 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.583297 28653 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:47.584590 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.559657 30999 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.585855 30912 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.555295 31062 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:47.559193 30689 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:47.486804 31061 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.596307 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:47.598883 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.602752 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:47.550856 30981 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:47.568720 31057 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.586634 31021 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:47.555411 30904 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.579903 31003 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:47.555433 30840 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:47.612258 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62121.4us
W20260709 13:11:47.657281 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61045.5us
I20260709 13:11:47.581933 31068 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:47.617587 30999 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.593814 31054 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.643883 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:47.586015 31050 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.623994 30929 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.674975 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:47.648744 31065 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:47.598412 30983 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:47.606211 31028 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:47.652949 30912 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.678525 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:47.663116 30999 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.623996 30899 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.641176 31061 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.663645 30823 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.609284 30859 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:47.605406 31037 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.668380 30985 ts_tablet_manager.cc:1916] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:47.662608 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:47.710868 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:47.659837 31068 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:47.674198 31030 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:47.713963 28724 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:47.686319 28576 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:47.681316 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:47.714907 28653 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:47.715637 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:47.715883 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.690412 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:47.691612 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.694083 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.716957 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:47.717283 28648 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:47.703425 31072 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:11:47.703586 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:11:47.719991 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 57479.4us
I20260709 13:11:47.716818 28575 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:47.661899 31070 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.630203 30689 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.661115 31003 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:47.707887 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:47.717342 28651 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:47.681639 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:47.718279 28653 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.728982 29258 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:47.680552 30840 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.682651 30929 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.645871 30948 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.723007 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:47.724380 28648 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:47.710752 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.668787 31039 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.737986 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.719368 31040 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.727913 29255 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.729357 28577 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
W20260709 13:11:47.729907 28579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2184) took 2207 ms (client timeout 2769 ms). Trace:
I20260709 13:11:47.683632 30904 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.737330 28580 raft_consensus.cc:1813] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Handling vote request from an unknown peer 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:47.742261 28580 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:11:47.740218 28576 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:47.739910 28579 rpcz_store.cc:269] 0709 13:11:45.518726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.518947 (+   221us) service_pool.cc:224] Handling call
0709 13:11:47.725763 (+2206816us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54001aac54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:47.725883 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142513920}
I20260709 13:11:47.722405 30952 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:47.744845 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.714555 30982 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.720871 31068 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.745918 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.670836 31066 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:11:47.743314 29260 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:47.761848 28647 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:47.764047 28654 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:47.724731 31070 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:47.630905 31062 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.762684 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:47.721297 30823 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:47.723366 31030 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.654359 31057 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.731078 30936 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.705354 31028 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.861287 31072 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.863592 31016 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.824244 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:47.857827 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:47.829954 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:47.866291 28652 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:47.741595 31040 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.869288 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:11:47.873116 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.730084 30981 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.844099 30689 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:47.900000 31071 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:11:47.868909 31073 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:47.867614 30982 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:47.870645 31040 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.905799 28581 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:47.901351 31073 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.768831 30958 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 13:11:47.864813 30983 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.834612 31077 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:47.894183 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:47.863845 31072 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:47.948519 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 222720us
I20260709 13:11:47.854332 31032 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.949335 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:47.965529 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 272052us
W20260709 13:11:47.969296 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 128705us
I20260709 13:11:47.908263 31037 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.744294 31038 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.768584 30899 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:47.981534 31032 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:47.986701 31061 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:47.938211 31077 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:47.984791 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:47.942375 29253 raft_consensus.cc:2376] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5. Re-sending same reply.
I20260709 13:11:47.914597 30982 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.993382 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:47.966735 30859 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.973165 31070 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.984129 31054 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:48.002838 30959 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:48.008282 30959 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:47.992106 31003 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:47.987142 31032 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.019486 31062 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:48.002954 30899 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:48.020467 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:48.022439 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:48.027856 28581 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:48.010324 31038 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.032277 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:48.011298 30958 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:48.045562 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:48.021485 30949 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.008424 30970 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:48.040918 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:48.003265 31078 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.033149 30647 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.022518 30996 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.046867 31075 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 13:11:48.039117 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:48.053933 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:48.043174 30958 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.042224 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:48.011894 31080 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:48.037770 30912 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:48.031440 30689 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.031270 30899 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.081574 31057 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:48.022226 31010 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:11:48.084061 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45020.6us
I20260709 13:11:48.085201 28650 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:48.083576 30959 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:48.037310 30925 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:11:48.053193 30840 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:11:48.112613 31032 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:48.070289 30936 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:48.083829 30996 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.037634 31024 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:11:48.064034 31030 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:48.080484 30970 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:48.043534 31038 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.104592 30899 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:48.065173 30949 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.106576 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:48.111411 30982 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:48.566174 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.612529 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:48.288246 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:48.261938 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.616469 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 509926us
I20260709 13:11:48.202380 28581 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:48.145735 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:48.625377 28650 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:48.288627 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:48.088753 30926 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:48.486584 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:48.087497 30958 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:48.089022 30912 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.725875 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:48.201615 28580 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:48.647528 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:48.745226 30977 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:48.748191 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.115648 30947 consensus_meta.cc:287] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
W20260709 13:11:48.756292 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 108886us
I20260709 13:11:48.097134 31080 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:48.570451 31042 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.975s	user 0.011s	sys 0.003s
W20260709 13:11:48.592449 31070 consensus_meta.cc:287] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:11:48.771617 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:48.170042 31054 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.727695 31025 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:48.115378 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:48.785244 28730 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:48.786923 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:48.228739 30999 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.004s
I20260709 13:11:48.257201 30969 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.095999 30823 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:48.084570 31077 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.791769 31048 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:48.751644 31072 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:48.795440 31080 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.484128 30936 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:48.150009 31028 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:48.795564 28650 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:48.806648 31054 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.822552 31048 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.839740 31048 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:48.794132 31070 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.847023 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:48.858587 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:48.818306 30969 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.859674 28650 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:48.820715 30823 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.800102 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:48.088738 31078 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:48.580749 30647 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.000s
I20260709 13:11:48.757164 30912 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:48.105086 30689 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.806839 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:48.746773 30948 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:48.807422 29260 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:48.811600 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:48.771104 30984 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:48.869078 31040 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.009s
I20260709 13:11:48.726150 30996 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:48.752120 30926 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.841853 30936 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.808746 31025 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.860898 30899 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.785053 31010 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:48.841579 31077 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.864269 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:48.865577 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 65595.2us
I20260709 13:11:48.839915 31054 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:48.816733 30999 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:48.871529 28579 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.023s	sys 0.024s
W20260709 13:11:48.872867 28574 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.012s	sys 0.027s
I20260709 13:11:48.908316 30926 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:48.929418 28574 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.013s	sys 0.027s
I20260709 13:11:48.881385 29252 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
W20260709 13:11:48.885578 28695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.009s	sys 0.059s
W20260709 13:11:48.933318 28695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.009s	sys 0.059s
W20260709 13:11:48.933877 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 949054us
I20260709 13:11:48.934599 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:48.935786 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:48.936547 30647 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:48.936946 30647 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:48.937413 30647 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.785748 30977 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.890237 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 148572us
I20260709 13:11:48.869684 31024 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:48.938294 31024 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.937992 30977 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.938701 31024 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.940119 28578 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:48.940339 30977 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:48.941123 30999 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:48.941704 30949 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:48.942288 30949 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:48.942875 30689 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:48.942796 30949 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:48.944226 28578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 604) took 1359 ms (client timeout 1592 ms). Trace:
I20260709 13:11:48.945724 30675 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:48.907166 31040 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.947484 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1143) took 1228 ms. Trace:
I20260709 13:11:48.947819 30926 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.947862 29254 rpcz_store.cc:276] 0709 13:11:47.718769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.718890 (+   121us) service_pool.cc:224] Handling call
0709 13:11:47.727976 (+  9086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.738917 (+ 10941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.738949 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:47.739001 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:47.739032 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.947253 (+1208221us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b54006b8ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:48.947297 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.947420 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24701184}
W20260709 13:11:48.909799 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 162438us
W20260709 13:11:48.923292 28579 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.023s	sys 0.024s
I20260709 13:11:48.953974 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:48.958961 29260 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:48.944639 28578 rpcz_store.cc:269] 0709 13:11:47.584640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.584793 (+   153us) service_pool.cc:224] Handling call
0709 13:11:48.944029 (+1359236us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003534d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:48.944167 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3092476288}
I20260709 13:11:48.955624 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:48.962193 28650 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:48.913830 31025 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:48.965605 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.922451 31010 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:11:48.915808 30720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.332s	user 0.032s	sys 0.092s
I20260709 13:11:48.953481 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:48.966539 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.948757 31040 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:48.871104 30823 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:48.988389 31028 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.988986 31028 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.989924 30823 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:48.970395 29260 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:48.990877 31028 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:48.991096 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:48.991967 29260 raft_consensus.cc:2410] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:11:48.954263 31082 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:11:48.891431 30948 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:48.936899 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:48.981541 29258 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 3: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:48.982270 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:49.004194 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 67347.1us
I20260709 13:11:48.940999 30977 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:49.012193 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:49.012614 28721 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:48.997377 31028 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:49.000306 31048 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:49.019886 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.020663 29252 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:48.902348 30984 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:48.971120 30720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.387s	user 0.032s	sys 0.093s
I20260709 13:11:49.010093 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:48.974196 30689 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.954547 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.014634 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:49.015431 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.032959 29260 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:49.016937 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:49.014531 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:48.966077 30949 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.034149 28655 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:49.019045 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.035275 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:49.036659 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.035109 29254 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:49.015731 30675 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:49.015269 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.023177 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:49.030511 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:48.969635 31019 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:11:49.013195 31038 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:48.970930 31010 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:49.064160 28620 leader_election.cc:336] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.004s (SENT)
I20260709 13:11:49.012310 30977 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:49.075320 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.076220 29254 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:48.950312 31024 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:49.044615 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:49.046286 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:49.041337 29258 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:49.061184 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:49.065531 28620 leader_election.cc:336] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.032s (SENT)
W20260709 13:11:49.072773 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.081358 28721 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:49.094049 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:49.094769 28655 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:49.095958 29252 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 3: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:49.095037 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:49.024960 31040 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:11:49.099328 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.097632 28578 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:49.057603 30720 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.064726 30949 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.101233 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.113794 29252 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:49.085048 30977 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:49.121500 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 111528us
I20260709 13:11:49.091747 31023 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.118588 28723 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
W20260709 13:11:49.098646 31068 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.111s	user 0.007s	sys 0.005s
W20260709 13:11:49.097880 31089 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:11:49.102291 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:49.086380 30823 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:49.114292 29251 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:49.105643 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.035514 30689 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.101714 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2275) took 1427 ms. Trace:
I20260709 13:11:49.103210 28728 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:49.125074 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.094524 30675 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:49.098451 31019 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:49.100517 30999 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:49.163697 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:49.174039 28655 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:49.112840 31080 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:49.580826 31099 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.362s	user 0.000s	sys 0.000s
I20260709 13:11:49.171690 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:49.819948 28621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.010s	sys 0.001s
I20260709 13:11:49.794708 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:49.820390 28621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.010s	sys 0.001s
I20260709 13:11:49.819999 28723 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:49.822702 29254 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:49.823510 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.824400 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:49.809690 28695 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.802s (SENT) [suppressed 13 similar messages]
I20260709 13:11:49.824973 29254 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
W20260709 13:11:49.558005 28727 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.014s	sys 0.037s
W20260709 13:11:49.505924 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.127135 31097 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:49.821209 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.820678 29257 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:49.809680 28578 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:49.829697 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.509378 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 346690us
I20260709 13:11:49.830648 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:49.827402 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.831631 29252 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:49.811126 28574 rpcz_store.cc:276] 0709 13:11:47.673955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.679212 (+  5257us) service_pool.cc:224] Handling call
0709 13:11:47.679611 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:47.689792 (+ 10181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.689838 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:47.709672 (+ 19834us) log.cc:844] Serialized 52 byte log entry
0709 13:11:48.189383 (+479711us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:48.929851 (+740468us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.101402 (+171551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.101478 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.101521 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:49.101533 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.101661 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19167,"prepare.queue_time_us":798775,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":27800,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":5391,"thread_start_us":1291669,"threads_started":3,"wal-append.queue_time_us":993499}
W20260709 13:11:49.589985 30970 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.475s	user 0.019s	sys 0.003s
I20260709 13:11:49.120114 30720 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.834748 30904 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.835255 31014 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.835232 30904 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:49.836431 30720 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:49.818889 30947 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.810050 31019 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:49.837297 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.837936 29257 raft_consensus.cc:1813] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Handling vote request from an unknown peer 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:49.838604 29257 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:11:49.837978 31019 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.838812 30904 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:49.839372 31019 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.839354 30904 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.840025 30904 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:49.841084 31097 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.842123 30904 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:49.842621 30904 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.842962 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:49.843226 31097 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.843099 30904 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.843837 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1626) took 2053 ms. Trace:
I20260709 13:11:49.843806 31097 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:49.844347 28648 rpcz_store.cc:276] 0709 13:11:47.790734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.842677 (+2051943us) service_pool.cc:224] Handling call
0709 13:11:49.843776 (+  1099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.845187 30970 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.845332 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:49.846015 29254 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:49.845695 30970 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:49.846166 30985 ts_tablet_manager.cc:1929] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:49.846776 30985 log.cc:1199] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: Deleting WAL directory at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/wals/6caf9ec933124d00b3e0e2cfeccd317b
I20260709 13:11:49.847141 29254 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:49.848106 30985 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50986 (request call id 95) took 4656 ms. Trace:
I20260709 13:11:49.848501 29253 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:49.839443 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:49.855844 29257 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:49.856240 29257 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:11:49.516848 30958 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.745s	user 0.005s	sys 0.002s
W20260709 13:11:49.512876 31077 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.000s
I20260709 13:11:49.833138 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:11:49.716112 31025 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.000s
I20260709 13:11:49.878830 31025 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.848539 30985 rpcz_store.cc:276] 0709 13:11:45.218546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.243441 (+ 24895us) service_pool.cc:224] Handling call
0709 13:11:45.485097 (+241656us) ts_tablet_manager.cc:1151] Deleting tablet 6caf9ec933124d00b3e0e2cfeccd317b
0709 13:11:45.485212 (+   115us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:11:49.146221 (+3661009us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:49.846028 (+699807us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:49.848013 (+  1985us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1619879,"tablet-delete.queue_time_us":218685,"thread_start_us":168962,"threads_started":1}
I20260709 13:11:49.847898 30970 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:49.883513 30970 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:49.883970 30970 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:49.885103 30970 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:49.850152 30675 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.886283 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:49.887320 28651 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:49.851401 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 880) took 1066 ms. Trace:
I20260709 13:11:49.851191 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:49.127233 31070 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.149513 30997 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.851662 31050 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.562520 31040 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:49.852052 30689 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:49.170898 31068 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:49.509934 30948 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:49.852308 31010 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.758s	user 0.005s	sys 0.001s
I20260709 13:11:49.819558 30899 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.811471 30999 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.852521 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:49.915956 28648 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:49.845345 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:49.916706 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 587) took 1303 ms. Trace:
I20260709 13:11:49.917101 28728 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:49.917219 28648 rpcz_store.cc:276] 0709 13:11:48.613520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.852238 (+1238718us) service_pool.cc:224] Handling call
0709 13:11:49.916607 (+ 64369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.848984 31105 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:49.858846 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:49.505676 31096 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:49.869889 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.201773 31098 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.107131 30647 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.876175 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:49.877058 31014 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:49.877993 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:49.890522 28655 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
W20260709 13:11:49.927340 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51271.5us
I20260709 13:11:49.927567 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1632) took 1964 ms. Trace:
I20260709 13:11:49.928110 28655 rpcz_store.cc:276] 0709 13:11:47.962885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.832373 (+1869488us) service_pool.cc:224] Handling call
0709 13:11:49.927490 (+ 95117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.124840 30949 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:49.819005 30936 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.701162 31024 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:49.892199 30958 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.888641 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:49.935732 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:49.818959 30926 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.871546 29257 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.889168 29256 rpcz_store.cc:276] 0709 13:11:48.785087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.785229 (+   142us) service_pool.cc:224] Handling call
0709 13:11:48.785619 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.798227 (+ 12608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.798275 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.803290 (+  5015us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.083992 (+280702us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:49.084060 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.084158 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.851225 (+767067us) raft_consensus.cc:1685] finished
0709 13:11:49.851246 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.851351 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10926,"raft.queue_time_us":15436,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6844,"thread_start_us":240949,"threads_started":1,"wal-append.queue_time_us":296013}
I20260709 13:11:49.853116 30904 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.943112 31025 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.945207 31080 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:49.934397 31098 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.945802 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:49.946475 30647 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.947029 31068 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:49.947278 31014 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:49.947960 31098 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:49.948628 31014 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:49.907096 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 97387.2us
I20260709 13:11:49.827330 30823 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.171458 31023 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.963505 28655 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:49.964080 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:49.914417 28578 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:11:49.966593 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 882) took 1180 ms. Trace:
W20260709 13:11:49.938216 30912 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.048s	user 0.010s	sys 0.003s
I20260709 13:11:49.918597 28729 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:49.969332 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1629) took 2110 ms. Trace:
I20260709 13:11:49.938691 29257 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.920030 30999 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:49.954329 28728 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:11:49.954936 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 145271us
I20260709 13:11:49.936594 31113 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.957986 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:49.902182 30997 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.959442 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:49.960839 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:49.837294 30947 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.905090 31040 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.931010 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:49.970614 28655 rpcz_store.cc:276] 0709 13:11:47.853688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.928967 (+2075279us) service_pool.cc:224] Handling call
0709 13:11:49.960064 (+ 31097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.964027 (+  3963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.964277 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.957787 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:49.972738 28695 connection.cc:256] RPC call timeout handler was delayed by -2.6571436049998738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:11:49.915253 31010 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:49.926327 31096 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:49.967016 29255 rpcz_store.cc:276] 0709 13:11:48.785959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.786084 (+   125us) service_pool.cc:224] Handling call
0709 13:11:48.793683 (+  7599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.911517 (+117834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.911560 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.912181 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.130562 (+218381us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:49.130619 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.952968 (+822349us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54005b1dd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:49.953064 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.953135 (+    71us) raft_consensus.cc:1685] finished
0709 13:11:49.953158 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.966518 (+ 13360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31782,"raft.queue_time_us":1681,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":4974,"spinlock_wait_cycles":269781888,"thread_start_us":165184,"threads_started":1,"wal-append.queue_time_us":741913}
W20260709 13:11:50.058495 28722 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.002s
W20260709 13:11:50.058413 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 97652.6us
I20260709 13:11:49.965167 31098 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.025775 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:49.999660 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.007647 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.078495 28727 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
W20260709 13:11:50.076493 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 145588us
I20260709 13:11:50.027571 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.080564 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:50.075269 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:50.082428 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:50.081348 28651 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.083353 29257 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:50.086371 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 886) took 1035 ms. Trace:
I20260709 13:11:50.086946 29257 rpcz_store.cc:276] 0709 13:11:49.050667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.839176 (+788509us) service_pool.cc:224] Handling call
0709 13:11:50.086268 (+247092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:50.084233 28547 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:11:50.073238 28722 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.011s	sys 0.003s
I20260709 13:11:49.977779 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.103546 28621 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:50.106964 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:50.110008 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:50.110635 29256 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:11:50.111197 28695 connection.cc:256] RPC call timeout handler was delayed by -2.0235436049998725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27690000000000003s for a response
I20260709 13:11:50.113672 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:50.114526 29252 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.103910 28728 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:11:49.977859 30977 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.000s
W20260709 13:11:50.018893 31052 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 2.710s	user 0.006s	sys 0.020s
W20260709 13:11:50.057874 31110 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:11:50.056805 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2270) took 3748 ms. Trace:
I20260709 13:11:50.155471 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.155730 28579 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:50.006472 30926 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:50.021071 31114 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:50.124569 28621 raft_consensus.cc:2686] T 6caf9ec933124d00b3e0e2cfeccd317b P 0c0ecde0af494dc9b152dee191c6d3e6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:11:50.176987 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 73579.9us
I20260709 13:11:50.167413 29252 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:50.168805 29256 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
W20260709 13:11:50.169803 28695 connection.cc:256] RPC call timeout handler was delayed by -1.0202478899999505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
I20260709 13:11:50.180610 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:50.172086 28651 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:50.118003 30904 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:50.077462 30758 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:50.301676 30758 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.182085 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.118940 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2147) took 1112 ms. Trace:
I20260709 13:11:50.118371 30936 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.152681 30913 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.152704 30973 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.973856 30912 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.119068 31025 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:50.245239 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 67376.5us
I20260709 13:11:50.316430 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:50.154390 31105 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:49.977560 31113 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.155695 31115 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.249637 28726 raft_consensus.cc:1217] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:11:50.326462 28726 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:50.252766 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1495) took 3420 ms. Trace:
I20260709 13:11:50.119145 31070 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.157159 30948 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:50.256310 31108 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.086s	user 0.003s	sys 0.009s
I20260709 13:11:50.256913 30958 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.258129 31023 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.259744 31040 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:50.329885 30948 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:50.174049 30647 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.331100 31113 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.331301 30912 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.331056 30647 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.331856 31113 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:50.332158 30948 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:50.314214 30936 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.176076 30926 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.165982 30977 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:50.275436 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1625) took 2512 ms. Trace:
I20260709 13:11:50.153703 31117 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.147s
I20260709 13:11:50.182904 30899 raft_consensus.cc:2764] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:50.118827 31098 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.287114 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.246706 31080 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:11:50.275846 30675 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:50.294503 28572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2185) took 4739 ms (client timeout 1868 ms). Trace:
I20260709 13:11:50.298651 29260 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:50.347807 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.298933 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:50.348582 29256 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:50.348675 28654 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:50.360306 30647 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:50.360687 28654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1627) took 2540 ms (client timeout 3093 ms). Trace:
W20260709 13:11:50.361325 28654 rpcz_store.cc:269] 0709 13:11:47.820127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.298604 (+2478477us) service_pool.cc:224] Handling call
0709 13:11:50.360629 (+ 62025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:50.362349 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.362946 28654 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:50.347640 28572 rpcz_store.cc:269] 0709 13:11:45.552633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.553492 (+   859us) service_pool.cc:224] Handling call
0709 13:11:50.291493 (+4738001us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54001f8954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:50.291721 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4455697664}
I20260709 13:11:50.305294 28722 rpcz_store.cc:276] 0709 13:11:49.006786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.006894 (+   108us) service_pool.cc:224] Handling call
0709 13:11:49.011987 (+  5093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.021405 (+  9418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.021465 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.033642 (+ 12177us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.526425 (+492783us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:50.118396 (+591971us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.118626 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.118699 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.118736 (+    37us) raft_consensus.cc:1685] finished
0709 13:11:50.118746 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.118872 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35849,"prepare.queue_time_us":138250,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":57,"raft.queue_time_us":46161,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":20280,"thread_start_us":959654,"threads_started":2,"wal-append.queue_time_us":744328}
I20260709 13:11:50.352667 31098 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.153177 31111 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.309244 31010 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.169523 28573 rpcz_store.cc:276] 0709 13:11:46.308400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.311598 (+  3198us) service_pool.cc:224] Handling call
0709 13:11:46.332664 (+ 21066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.505515 (+172851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.505551 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.506096 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:11:46.507057 (+   961us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:46.507106 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.056295 (+3549189us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54000ebfd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:50.056389 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.056445 (+    56us) raft_consensus.cc:1685] finished
0709 13:11:50.056460 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.056711 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15334,"raft.queue_time_us":40850,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":8931,"spinlock_wait_cycles":241005952,"thread_start_us":24798,"threads_started":2,"wal-append.queue_time_us":64971,"wal-append.run_cpu_time_us":3407,"wal-append.run_wall_time_us":1129566}
W20260709 13:11:50.311681 31126 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:50.367568 31111 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.316565 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1635) took 1228 ms. Trace:
I20260709 13:11:50.102718 31014 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.368889 31014 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.364929 31073 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:50.315359 31001 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:50.371393 31001 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.372262 30729 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.372577 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 590) took 1625 ms. Trace:
W20260709 13:11:50.333348 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.372947 28650 rpcz_store.cc:276] 0709 13:11:48.747041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.863984 (+116943us) service_pool.cc:224] Handling call
0709 13:11:50.372384 (+1508400us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b540003fcd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:50.372523 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97852800}
I20260709 13:11:50.374058 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.369841 28653 rpcz_store.cc:276] 0709 13:11:49.087949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.936439 (+848490us) service_pool.cc:224] Handling call
0709 13:11:49.936722 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.937724 (+  1002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.937770 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.959601 (+ 21831us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.284512 (+324911us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:50.284575 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.284685 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.316257 (+ 31572us) raft_consensus.cc:1685] finished
0709 13:11:50.316287 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.316483 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1209,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":266628,"threads_started":1,"wal-append.queue_time_us":339659}
I20260709 13:11:50.374610 28650 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.375281 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:50.376102 28653 raft_consensus.cc:2410] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:50.378137 28652 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:50.378304 31001 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.378708 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1619) took 2668 ms. Trace:
I20260709 13:11:50.379073 28652 rpcz_store.cc:276] 0709 13:11:47.710512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.370065 (+2659553us) service_pool.cc:224] Handling call
0709 13:11:50.377821 (+  7756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.378485 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.378658 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:50.379531 30936 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.300796 30904 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:50.327445 28725 rpcz_store.cc:276] 0709 13:11:46.827573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.827712 (+   139us) service_pool.cc:224] Handling call
0709 13:11:46.838762 (+ 11050us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:46.842673 (+  3911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.842719 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:46.852626 (+  9907us) log.cc:844] Serialized 52 byte log entry
0709 13:11:46.991367 (+138741us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:46.991442 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.991538 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.973118 (+2981580us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b2400240878. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24baf9c4 00007f4a24badacb 00007f4a24d68dc9 00007f4a24d68a55 00007f4a24d6809d 00007f4a2799a10e 00007f4a279b188c 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221
0709 13:11:50.181235 (+208117us) raft_consensus.cc:1685] finished
0709 13:11:50.181256 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.247424 (+ 66168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5888,"raft.queue_time_us":3547,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":4865,"spinlock_wait_cycles":51233536,"thread_start_us":92470,"threads_started":1,"wal-append.queue_time_us":408233}
I20260709 13:11:50.338442 28648 rpcz_store.cc:276] 0709 13:11:47.763710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.924681 (+2160971us) service_pool.cc:224] Handling call
0709 13:11:49.925100 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.925366 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:50.089232 (+163866us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.274807 (+185575us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.275019 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:50.275082 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:50.275132 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.275200 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.275355 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":340504,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":1718,"raft.queue_time_us":1004,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3239,"thread_start_us":298050,"threads_started":2,"wal-append.queue_time_us":205977}
I20260709 13:11:50.307113 30758 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.334582 31128 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.349056 31117 consensus_queue.cc:1243] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:50.332800 31114 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:11:50.335489 31070 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:50.349263 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.333276 30982 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:50.336915 30926 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.349748 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.405992 28578 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
W20260709 13:11:50.406176 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 78158.5us
I20260709 13:11:50.350050 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.315601 30973 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.349789 31080 consensus_queue.cc:1243] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:50.350487 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.325255 31025 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.350906 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.351539 28651 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:50.346706 30912 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.352689 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:50.352777 30823 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.353420 30949 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:50.337756 31115 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.354847 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1622) took 2628 ms. Trace:
I20260709 13:11:50.354743 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:50.355733 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:50.412832 29257 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:50.356614 31019 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.001s
I20260709 13:11:50.412611 28647 rpcz_store.cc:276] 0709 13:11:47.726493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.354066 (+2627573us) service_pool.cc:224] Handling call
0709 13:11:50.354353 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.354544 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.354568 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:50.354606 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:50.354634 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.354687 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.354793 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:50.359027 30977 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:50.359581 31102 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.718s	user 0.005s	sys 0.006s
I20260709 13:11:50.417302 30997 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.419230 31115 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:50.419751 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 64102.2us
I20260709 13:11:50.420454 28547 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:50.421217 31132 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:50.421607 30997 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:50.422004 31132 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:50.422197 30997 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:50.421298 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:50.423106 31132 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.310551 30969 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:50.368582 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.298180 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 117600us
I20260709 13:11:50.423169 30997 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.426378 30973 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.359717 30947 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.401095 28650 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:50.369439 31014 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.429827 28650 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:50.404098 28654 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:50.432345 31019 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:50.392534 31076 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.433310 31076 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.394558 30904 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.434000 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.434927 29255 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 1.
I20260709 13:11:50.436241 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.409096 28581 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:50.410305 29256 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:50.437371 30758 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:50.411533 29252 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 2: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:50.411753 30912 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:50.414037 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.411196 31025 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.440217 30912 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.441385 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:50.442327 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:50.442988 31066 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:50.443343 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.443583 31066 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:50.444077 28654 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.444262 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:50.421280 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 740) took 2113 ms. Trace:
I20260709 13:11:50.448498 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.449183 28650 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.437166 29251 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:50.451210 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:50.406994 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:11:50.455775 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 48893.3us
I20260709 13:11:50.408766 30982 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:50.452806 29257 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:50.455936 28654 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:50.457365 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:50.461404 28578 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:50.461825 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:50.463181 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.463359 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:50.463625 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.466892 28647 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:50.467275 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.404000 31128 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.468467 28647 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:50.468677 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.474850 28729 raft_consensus.cc:2410] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:50.474907 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.478355 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.446525 28724 rpcz_store.cc:276] 0709 13:11:48.307869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.308079 (+   210us) service_pool.cc:224] Handling call
0709 13:11:48.312223 (+  4144us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:48.890200 (+577977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.890251 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:48.910855 (+ 20604us) log.cc:844] Serialized 52 byte log entry
0709 13:11:49.097728 (+186873us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:49.132621 (+ 34893us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.132967 (+   346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.849057 (+716090us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540008c854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:49.849106 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.359066 (+509960us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:11:50.421080 (+ 62014us) raft_consensus.cc:1685] finished
0709 13:11:50.421100 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.421225 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6451,"prepare.queue_time_us":464653,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":21704,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":32089,"spinlock_wait_cycles":1351595648,"thread_start_us":178857,"threads_started":2,"wal-append.queue_time_us":694343}
I20260709 13:11:50.475347 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.479195 28577 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:50.480100 28728 raft_consensus.cc:2410] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.423267 31070 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:50.481469 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.482450 28725 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:50.483028 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.483325 28650 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:50.483848 28727 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:50.464756 31114 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:50.486538 31114 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.486927 31114 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.487881 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:50.488752 28578 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:50.481665 30973 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.489806 30973 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.489899 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.490293 30973 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.491168 31078 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:50.490217 29223 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:50.493561 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:50.493728 31078 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:50.495327 31090 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 1.630s	user 0.010s	sys 0.014s
I20260709 13:11:50.495500 31078 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:50.496038 31078 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.497458 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.498239 28728 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:50.498978 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.499500 28728 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:50.502050 31073 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.502827 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.503525 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.477571 28722 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:50.462764 30977 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.516129 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.520895 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.522819 28728 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:50.525539 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:50.514801 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:50.527240 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.528067 28728 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:11:50.533703 28725 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:50.536170 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.486575 30982 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.538626 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.455276 30999 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.540483 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:50.544485 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.547649 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.545267 31111 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.516204 30823 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:50.549711 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:50.444834 31066 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.525323 31024 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:11:50.493533 31014 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.550760 28578 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:50.543521 31016 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:50.625192 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:50.626006 28577 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:50.529939 30969 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:50.562963 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.605321 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.636253 28572 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:50.636191 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:50.614274 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.631978 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.632688 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.619903 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2150) took 1612 ms. Trace:
I20260709 13:11:50.593921 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.640111 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:50.640228 28728 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:50.642555 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.645769 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:50.646376 29256 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.638355 28721 rpcz_store.cc:276] 0709 13:11:49.007779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.093656 (+ 85877us) service_pool.cc:224] Handling call
0709 13:11:49.161931 (+ 68275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.178158 (+ 16227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.178208 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.808234 (+630026us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.912893 (+104659us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:49.912931 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.912999 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.914929 (+  1930us) raft_consensus.cc:1685] finished
0709 13:11:49.914954 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.619570 (+704616us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b54002814d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:50.619825 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15788,"raft.queue_time_us":15926,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":305089,"spinlock_wait_cycles":120225664,"thread_start_us":13212,"threads_started":1,"wal-append.queue_time_us":38460}
I20260709 13:11:50.648270 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.648423 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:50.649526 28721 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:50.650830 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.650991 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:50.651773 29257 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
W20260709 13:11:50.652751 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 103142us
I20260709 13:11:50.657269 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:50.660171 29257 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:50.653199 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:50.663147 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.663602 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:50.668848 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.669548 29259 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:50.596812 30729 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:50.621347 30970 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.687270 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.617072 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.605402 30999 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:50.635196 31016 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.687928 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.688580 29259 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:50.693544 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.635366 30823 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:50.645702 30977 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.696244 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:50.700600 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:50.701287 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.702850 29256 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:50.664613 30912 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:50.668309 30963 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:50.648178 31070 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:50.708105 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.709092 29254 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.706350 29255 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:50.720562 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:50.712553 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 187080us
I20260709 13:11:50.716614 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.722610 28725 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:50.600767 30973 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.670598 31105 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.597266 30926 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:50.692039 31076 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:50.685696 30913 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:50.718752 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 55223.4us
I20260709 13:11:50.547986 31134 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:11:50.646054 30969 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.722709 29252 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:50.949743 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:50.950183 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.711601 30912 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:50.951122 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.951524 30912 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.952189 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.853513 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.954097 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.952785 28728 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:50.922537 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.955969 28723 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:50.956727 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.929898 28647 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:50.957530 28650 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:50.958137 28728 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:50.924677 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.852632 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.929464 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1636) took 1841 ms. Trace:
I20260709 13:11:50.959755 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.960780 29257 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 2.
I20260709 13:11:50.958786 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:50.961162 28728 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:50.858261 29254 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:50.960959 28653 rpcz_store.cc:276] 0709 13:11:49.088218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.376685 (+1288467us) service_pool.cc:224] Handling call
0709 13:11:50.380216 (+  3531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:50.380715 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.380748 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.381205 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.630708 (+249503us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:50.630746 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.630827 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.929218 (+298391us) raft_consensus.cc:1685] finished
0709 13:11:50.929239 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.929385 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":6396,"thread_start_us":220943,"threads_started":1,"wal-append.queue_time_us":315119}
I20260709 13:11:50.956856 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.972283 28723 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:50.973520 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:50.974272 28723 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.696029 31016 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.822109 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:50.978214 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:50.992348 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.993292 28728 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:50.994765 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.695428 30997 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:50.996227 28728 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:50.998119 28572 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:50.915688 30729 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:51.009322 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:51.010129 28725 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:51.008688 29252 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:51.015043 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:50.910665 30823 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:50.714663 31111 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:51.018417 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:51.019659 28650 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:50.721060 30963 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:50.977735 31066 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.853996 30960 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.799503 31128 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:51.018273 28581 raft_consensus.cc:2368] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
W20260709 13:11:51.033697 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 380155us
I20260709 13:11:50.854216 31130 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:51.028128 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.038350 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:51.028903 28723 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:50.990571 30890 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:51.039809 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:51.040457 28723 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:51.031976 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1637) took 1943 ms. Trace:
I20260709 13:11:51.003530 30997 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.758781 31070 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.001379 30913 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:51.007366 30902 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.723877 30999 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.303s
I20260709 13:11:51.028601 30977 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:51.066838 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.068318 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.069276 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:51.069875 29252 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.070644 28725 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:51.071631 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:51.072052 28723 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:51.072296 28725 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 3: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:51.041530 28652 rpcz_store.cc:276] 0709 13:11:49.088459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.379765 (+1291306us) service_pool.cc:224] Handling call
0709 13:11:50.380074 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:50.380427 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.380454 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.380869 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.526471 (+145602us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:50.548214 (+ 21743us) log.cc:844] Serialized 14 byte log entry
0709 13:11:51.031637 (+483423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.031714 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:51.031755 (+    41us) raft_consensus.cc:1685] finished
0709 13:11:51.031772 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.031920 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28015,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":44137,"raft.queue_time_us":78773,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10536,"spinlock_wait_cycles":18274048,"thread_start_us":593636,"threads_started":2,"wal-append.queue_time_us":302147}
I20260709 13:11:51.027966 30963 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.017073 30729 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.025398 31111 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.075565 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:50.704403 31114 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.026484 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:51.061657 30837 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:51.027212 30947 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:51.048521 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.064604 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:51.049762 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:51.043794 31078 consensus_meta.cc:287] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.001s
I20260709 13:11:51.044140 31128 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:11:51.046011 31010 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:11:51.120815 31078 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.122735 30963 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.037889 30960 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.123497 30755 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:51.084028 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 652972us
I20260709 13:11:51.078704 30729 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:51.125825 28728 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:11:51.046177 31014 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:51.126658 30904 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.000s
I20260709 13:11:51.004320 31105 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:51.127096 30904 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.127993 31016 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.128095 31105 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.132809 30984 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:51.133651 30960 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:51.066623 30890 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:11:51.066151 31073 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.001s
I20260709 13:11:51.097061 29251 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:51.170362 28654 raft_consensus.cc:2368] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:11:51.115065 28725 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.108266 30947 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.085652 31111 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.122650 30913 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.138149 28651 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.072911 30977 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.053144 30997 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.085700 30926 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:51.085739 30758 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.173501 29252 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:51.176637 28650 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.173094 31073 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.170210 30837 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:51.044654 31130 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.205217 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:51.224983 28725 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:51.219043 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:51.212283 28656 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:51.218348 28651 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:51.234862 30859 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.257300 30859 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.259544 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:51.260334 28572 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:51.259914 31016 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:51.265689 30837 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.269151 31130 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:51.270000 30973 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:51.272270 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:51.273627 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:51.274153 28725 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:51.274936 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:51.275380 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 149862us
I20260709 13:11:51.293357 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:51.275393 28725 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.296806 28650 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:11:51.307542 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 351494us
W20260709 13:11:51.324481 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.204252 31132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.020s	sys 0.028s
W20260709 13:11:51.312570 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 2.13459e+06us
I20260709 13:11:51.218885 30890 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:51.357640 31141 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.441s	user 0.003s	sys 0.000s
I20260709 13:11:51.320312 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:51.216799 30758 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.292546 30947 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:51.358440 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.393256 30969 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:51.318459 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:51.415138 31016 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:51.416653 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:51.417112 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.418344 31016 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.419023 31016 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:51.420720 31054 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 13:11:51.384665 31025 consensus_meta.cc:287] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.935s	user 0.012s	sys 0.000s
W20260709 13:11:51.426164 31148 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:11:51.455178 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 373079us
I20260709 13:11:51.456558 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:51.326326 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:51.416764 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 98448us
W20260709 13:11:51.814345 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 749466us
I20260709 13:11:51.817726 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:51.821416 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 614) took 1296 ms. Trace:
W20260709 13:11:51.809574 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 351273us
I20260709 13:11:51.821851 28572 rpcz_store.cc:276] 0709 13:11:50.524743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.423326 (+898583us) service_pool.cc:224] Handling call
0709 13:11:51.821360 (+398034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.822962 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:51.789486 28725 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
W20260709 13:11:51.341728 31132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.022s	sys 0.029s
W20260709 13:11:51.812561 29224 connection.cc:256] RPC call timeout handler was delayed by -1.7784469590000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:11:51.831950 29224 connection.cc:256] RPC call timeout handler was delayed by -1.6416469590000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:11:51.832381 29224 connection.cc:256] RPC call timeout handler was delayed by -1.5462469589999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 13:11:51.827116 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:51.827677 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 318362us
W20260709 13:11:51.834915 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.838701 28725 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.839638 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 750) took 1331 ms. Trace:
I20260709 13:11:51.840133 28725 rpcz_store.cc:276] 0709 13:11:50.508326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.835824 (+1327498us) service_pool.cc:224] Handling call
0709 13:11:51.838482 (+  2658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.839340 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.839572 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:51.852645 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.859192 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:51.860245 29252 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:51.832736 29224 connection.cc:256] RPC call timeout handler was delayed by -1.3464469589999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:11:51.861821 29224 connection.cc:256] RPC call timeout handler was delayed by -1.3464469589999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:11:51.862234 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1520469590000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
W20260709 13:11:51.862664 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1520469590000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
W20260709 13:11:51.862423 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 569104us
W20260709 13:11:51.863205 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1448469590000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.225s for a response
W20260709 13:11:51.863654 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1448469590000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.225s for a response
I20260709 13:11:51.863867 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:51.865588 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:51.487154 30969 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.749017 30963 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:51.803417 31054 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.890827 28725 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.864676 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:51.813544 31078 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:51.891881 30996 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:51.892302 29260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 794) took 2858 ms (client timeout 1606 ms). Trace:
I20260709 13:11:51.892482 30996 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.893121 30996 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:51.892910 29260 rpcz_store.cc:269] 0709 13:11:49.034027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.036384 (+  2357us) service_pool.cc:224] Handling call
0709 13:11:51.892005 (+2855621us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54006cbe54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:51.892169 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2900469120}
I20260709 13:11:51.696091 30977 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:51.464263 31025 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.899471 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 754) took 1376 ms. Trace:
I20260709 13:11:51.558004 31009 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.885594 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:51.900987 28572 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:51.901623 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2207) took 1324 ms. Trace:
I20260709 13:11:51.901949 28572 rpcz_store.cc:276] 0709 13:11:50.621424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.831527 (+1210103us) service_pool.cc:224] Handling call
0709 13:11:51.901557 (+ 70030us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:51.888542 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 61510.9us
I20260709 13:11:51.903402 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:51.824594 30904 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:51.892594 31160 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:11:51.861734 30912 consensus_meta.cc:287] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.910s	user 0.012s	sys 0.000s
I20260709 13:11:51.542776 31070 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:51.899884 28725 rpcz_store.cc:276] 0709 13:11:50.522660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.841400 (+1318740us) service_pool.cc:224] Handling call
0709 13:11:51.890658 (+ 49258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.891591 (+   933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.899406 (+  7815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.911778 28725 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.904091 29252 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:51.906257 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:51.884088 30902 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:51.892154 31078 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:51.906149 30755 consensus_meta.cc:287] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.782s	user 0.012s	sys 0.000s
I20260709 13:11:51.914136 28572 raft_consensus.cc:2410] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:51.883760 30864 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:51.917129 29260 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:51.918174 28655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1643) took 1973 ms (client timeout 1886 ms). Trace:
W20260709 13:11:51.934676 28655 rpcz_store.cc:269] 0709 13:11:49.944463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.275116 (+330653us) service_pool.cc:224] Handling call
0709 13:11:51.917970 (+1642854us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540001d6d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:51.918108 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822026112}
I20260709 13:11:51.935297 28574 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:11:51.935418 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:51.935566 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:51.920028 30970 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.223s	user 0.012s	sys 0.000s
I20260709 13:11:51.922024 31062 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:51.932086 31078 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.937101 31078 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.935889 31023 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.938388 31023 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.923650 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 746) took 1417 ms. Trace:
I20260709 13:11:51.926111 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1647) took 1237 ms. Trace:
W20260709 13:11:51.928496 30758 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.003s
I20260709 13:11:51.902733 31054 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.905205 30969 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:51.885264 31096 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:51.896981 31156 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.933454 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 759) took 1384 ms. Trace:
W20260709 13:11:51.918956 28730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 742) took 3496 ms (client timeout 1804 ms). Trace:
I20260709 13:11:51.936064 28650 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:51.936139 28576 raft_consensus.cc:2368] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:51.931169 30902 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.888077 31132 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:11:51.941808 28656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2136) took 5281 ms (client timeout 2065 ms). Trace:
I20260709 13:11:51.947542 28653 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:11:51.961761 28653 pending_rounds.cc:85] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 1
I20260709 13:11:51.962165 28653 pending_rounds.cc:107] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 13:11:51.961664 28656 rpcz_store.cc:269] 0709 13:11:46.660157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.660330 (+   173us) service_pool.cc:224] Handling call
0709 13:11:51.941583 (+5281253us) spinlock_profiling.cc:243] Waited 4.48 s on lock 0x7b5400259254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:51.941689 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10301904128}
I20260709 13:11:51.962513 28653 raft_consensus.cc:2889] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:51.963532 28656 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:51.959940 31156 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.950809 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 619) took 1331 ms. Trace:
I20260709 13:11:51.965178 31159 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:51.965720 28572 rpcz_store.cc:276] 0709 13:11:50.619819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.902562 (+1282743us) service_pool.cc:224] Handling call
0709 13:11:51.950736 (+ 48174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.946794 28722 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.967331 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 745) took 1462 ms. Trace:
I20260709 13:11:51.912176 30963 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.911574 30977 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.953162 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:51.972436 29260 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
W20260709 13:11:51.960764 31111 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.002s
I20260709 13:11:51.941170 28723 rpcz_store.cc:276] 0709 13:11:50.506016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.046602 (+540586us) service_pool.cc:224] Handling call
0709 13:11:51.071890 (+ 25288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.072444 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.923439 (+850995us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54000d61d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:51.923589 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56998784}
W20260709 13:11:51.954054 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 89491.6us
I20260709 13:11:51.942245 30864 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:51.954691 31039 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:51.941588 31023 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:51.957633 28725 rpcz_store.cc:276] 0709 13:11:50.549091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.911321 (+1362230us) service_pool.cc:224] Handling call
0709 13:11:51.911629 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.912169 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.933376 (+ 21207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.961253 30902 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:51.929908 31066 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.898s	user 0.010s	sys 0.001s
I20260709 13:11:51.958979 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:11:51.957739 28730 rpcz_store.cc:269] 0709 13:11:48.422913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.423067 (+   154us) service_pool.cc:224] Handling call
0709 13:11:51.918711 (+3495644us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b54002d8554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:51.918861 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133910400}
W20260709 13:11:51.959537 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 633248us
I20260709 13:11:51.941710 28651 rpcz_store.cc:276] 0709 13:11:50.688909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.924359 (+235450us) service_pool.cc:224] Handling call
0709 13:11:51.925915 (+1001556us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540025a654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:51.926044 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410214656}
I20260709 13:11:51.968019 28722 rpcz_store.cc:276] 0709 13:11:50.504461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.505157 (+   696us) service_pool.cc:224] Handling call
0709 13:11:50.513682 (+  8525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.946558 (+1432876us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b54001d5c20. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8ddc0 00007f4a27e181c0 00007f4a27e19231 00007f4a27e15d8f 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c
0709 13:11:51.967025 (+ 20467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.967260 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19364096}
I20260709 13:11:51.952689 31128 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:51.974726 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:51.930900 30912 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.977607 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:51.977632 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:51.989956 28722 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:51.987425 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 781) took 3037 ms. Trace:
W20260709 13:11:51.992038 31155 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:11:51.991971 29253 rpcz_store.cc:276] 0709 13:11:48.950382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.975042 (+ 24660us) service_pool.cc:224] Handling call
0709 13:11:49.040630 (+ 65588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.848957 (+808327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.987086 (+2138129us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54004b4e54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:51.987298 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856982912}
I20260709 13:11:51.966305 30996 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:51.988297 31016 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
W20260709 13:11:51.989106 28578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2208) took 1367 ms (client timeout 1722 ms). Trace:
W20260709 13:11:51.996997 28578 rpcz_store.cc:269] 0709 13:11:50.621748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.892979 (+271231us) service_pool.cc:224] Handling call
0709 13:11:51.988875 (+1095896us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400165654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:51.989051 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230511360}
I20260709 13:11:51.990612 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1501) took 1323 ms. Trace:
I20260709 13:11:52.001691 28722 rpcz_store.cc:276] 0709 13:11:50.667400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.985980 (+1318580us) service_pool.cc:224] Handling call
0709 13:11:51.989757 (+  3777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.990383 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.990562 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:51.955835 30758 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:51.958282 30969 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:51.971539 31105 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:52.004235 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 181313us
I20260709 13:11:51.978747 30963 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:51.975871 31010 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:11:52.025673 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.038476 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47026us
I20260709 13:11:52.039546 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:51.979857 31062 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:11:51.976800 31111 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.043555 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:52.002036 31157 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:52.037127 28650 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:52.066638 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.067939 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2210) took 1445 ms. Trace:
I20260709 13:11:52.001277 31128 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:52.068416 28572 rpcz_store.cc:276] 0709 13:11:50.622297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.034213 (+1411916us) service_pool.cc:224] Handling call
0709 13:11:52.067849 (+ 33636us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:52.029451 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 165735us
I20260709 13:11:52.071717 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:52.073880 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:52.001859 31039 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:11:52.077625 28696 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:52.083513 28654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2161) took 1654 ms (client timeout 1891 ms). Trace:
W20260709 13:11:52.083948 28654 rpcz_store.cc:269] 0709 13:11:50.429628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.463370 (+ 33742us) service_pool.cc:224] Handling call
0709 13:11:52.083307 (+1619937us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b540023e454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:52.083454 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623323520}
I20260709 13:11:52.064055 31157 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.002416 31016 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:52.075053 31158 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.133s	user 0.004s	sys 0.000s
I20260709 13:11:52.045405 31163 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.089217 28696 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:52.091524 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.071285 31156 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:52.081115 30970 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:52.075384 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:52.078536 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 92765.2us
I20260709 13:11:52.078925 31096 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:52.041733 31105 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.102092 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:52.085078 30960 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:52.088891 28573 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:52.078487 31168 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:52.096998 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 122357us
I20260709 13:11:52.108386 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1502) took 1415 ms. Trace:
I20260709 13:11:52.080870 31165 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:52.112270 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:52.044831 30864 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:52.113629 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:11:52.115106 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 137514us
I20260709 13:11:52.090768 31054 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:52.119989 28696 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:52.076031 31070 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:52.143962 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:52.092213 30947 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.146411 31019 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:52.146821 31019 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.147177 31019 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.149446 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:52.150781 30904 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:52.151562 31105 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.152186 31105 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:52.152258 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:52.153177 31171 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.134631 31066 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:52.153505 30864 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:52.149504 31164 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:52.094789 31157 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:52.137387 28730 rpcz_store.cc:276] 0709 13:11:50.692798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.988935 (+1296137us) service_pool.cc:224] Handling call
0709 13:11:51.989261 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.989539 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:52.085129 (+ 95590us) log.cc:844] Serialized 14 byte log entry
0709 13:11:52.107968 (+ 22839us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:52.108030 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:52.108091 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.108167 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.108313 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1317,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":16609,"thread_start_us":115241,"threads_started":2}
I20260709 13:11:52.094094 31153 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:52.156884 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:52.107242 30977 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:52.159189 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:52.161480 29260 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:52.161594 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.162302 28572 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:52.161916 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:52.153795 31171 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.111315 31096 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:52.168188 31169 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:52.170259 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:52.171790 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:52.173525 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:52.152855 31105 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:52.183104 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:52.202980 28572 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:52.203611 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 620) took 1583 ms. Trace:
I20260709 13:11:52.204079 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.204470 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:52.204981 28649 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.196574 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1506) took 1481 ms. Trace:
I20260709 13:11:52.205683 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:52.205924 28730 rpcz_store.cc:276] 0709 13:11:50.715384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.155235 (+1439851us) service_pool.cc:224] Handling call
0709 13:11:52.155563 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.155776 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:52.156076 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:11:52.194505 (+ 38429us) log.cc:844] Serialized 14 byte log entry
0709 13:11:52.195967 (+  1462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:52.196041 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:52.196192 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.196299 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.196487 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7946,"thread_start_us":38699,"threads_started":3}
I20260709 13:11:52.208206 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:52.208909 28730 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:52.197664 31174 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:52.175310 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:52.197713 28650 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.209755 31174 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:52.210011 29254 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:52.189347 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:52.210757 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.211979 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.203711 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.203975 28572 rpcz_store.cc:276] 0709 13:11:50.620085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.181168 (+1561083us) service_pool.cc:224] Handling call
0709 13:11:52.203554 (+ 22386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.213093 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.213716 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.214196 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.214773 28650 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:52.214907 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:52.215432 28572 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.215732 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.216764 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.217388 28650 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:52.218189 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.219247 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.220252 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.222564 28572 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:52.223291 28650 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:52.223603 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.224207 28572 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:11:52.224627 28650 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:52.225471 28572 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:52.226111 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2205) took 1722 ms. Trace:
I20260709 13:11:52.141415 31165 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.226503 28572 rpcz_store.cc:276] 0709 13:11:50.503753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.224864 (+1721111us) service_pool.cc:224] Handling call
0709 13:11:52.225316 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.225906 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.226066 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.160715 30904 raft_consensus.cc:2764] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:52.166874 31066 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:52.230028 29251 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:52.184399 31156 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:52.184115 31096 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:52.202148 31158 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:52.183846 31169 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.229480 30899 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:52.107023 31163 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.235532 30995 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:52.240154 28649 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:52.176654 31070 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:11:52.231608 31165 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.176332 31153 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.259171 30977 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:52.259791 30977 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:52.242684 28651 raft_consensus.cc:2368] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:11:52.260897 31153 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.260696 30977 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:52.261454 31016 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.253541 31169 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.239629 30912 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.140473 30963 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.237588 31023 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:11:52.140283 31128 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.272686 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1651) took 1222 ms. Trace:
I20260709 13:11:52.275602 31180 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.276470 31180 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.277500 31019 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.278780 31105 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:52.279716 31019 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.243916 31156 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.280714 31156 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.283602 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1646) took 1595 ms. Trace:
I20260709 13:11:52.284197 28653 rpcz_store.cc:276] 0709 13:11:50.688630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.995279 (+306649us) service_pool.cc:224] Handling call
0709 13:11:50.995760 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.963211 (+967451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.283330 (+320119us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b540027e554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:52.283535 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177146624}
I20260709 13:11:52.287079 31163 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:52.288419 30996 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.289486 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2282) took 4608 ms. Trace:
I20260709 13:11:52.289893 28575 rpcz_store.cc:276] 0709 13:11:47.680913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.725851 (+ 44938us) service_pool.cc:224] Handling call
0709 13:11:47.726149 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.726447 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.726482 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:47.726905 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.120294 (+3393389us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18004097e0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:11:51.539060 (+418766us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:51.556001 (+ 16941us) log.cc:844] Serialized 14 byte log entry
0709 13:11:51.557814 (+  1813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.564475 (+  6661us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.033735 (+469260us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b2400121448. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24baf9c4 00007f4a24badacb 00007f4a24d68dc9 00007f4a24d68a55 00007f4a24d6809d 00007f4a2799a10e 00007f4a279b188c 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221
0709 13:11:52.289250 (+255515us) raft_consensus.cc:1685] finished
0709 13:11:52.289270 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.289404 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16740,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":3413,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":14129,"spinlock_wait_cycles":45195392,"thread_start_us":418455,"threads_started":1,"wal-append.queue_time_us":4204941}
I20260709 13:11:52.273377 28652 rpcz_store.cc:276] 0709 13:11:51.050026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.097085 (+ 47059us) service_pool.cc:224] Handling call
0709 13:11:51.097506 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.824915 (+727409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.824958 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.825411 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.086562 (+261151us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:52.228518 (+141956us) log.cc:844] Serialized 14 byte log entry
0709 13:11:52.228745 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.228820 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.272313 (+ 43493us) raft_consensus.cc:1685] finished
0709 13:11:52.272344 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.272572 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":726996,"raft.queue_time_us":727864,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":64607,"thread_start_us":289946,"threads_started":2,"wal-append.queue_time_us":272297}
I20260709 13:11:52.264729 29260 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:52.266032 30969 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:52.267627 31111 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.292495 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 615) took 1745 ms. Trace:
I20260709 13:11:52.305403 28575 rpcz_store.cc:276] 0709 13:11:50.547656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.291707 (+1744051us) service_pool.cc:224] Handling call
0709 13:11:52.292013 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.292178 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.292208 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:52.292248 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:52.292280 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.292333 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.292445 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.306957 28575 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.307777 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 616) took 1750 ms. Trace:
W20260709 13:11:52.294276 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 127395us
I20260709 13:11:52.253953 30758 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.313647 28575 rpcz_store.cc:276] 0709 13:11:50.557250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.306475 (+1749225us) service_pool.cc:224] Handling call
0709 13:11:52.306781 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.307531 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.307720 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:52.307953 31127 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 2.007s	user 0.009s	sys 0.012s
W20260709 13:11:52.263916 30997 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.045s	user 0.004s	sys 0.004s
I20260709 13:11:52.365515 30997 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.366986 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 896) took 3300 ms. Trace:
I20260709 13:11:52.368075 30997 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.367390 29258 rpcz_store.cc:276] 0709 13:11:49.066712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.847280 (+780568us) service_pool.cc:224] Handling call
0709 13:11:49.847572 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.847956 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:49.959964 (+112008us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.176486 (+216522us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.177093 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.177235 (+   142us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:50.177267 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.177346 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.282200 (+2104854us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:11:52.366652 (+ 84452us) raft_consensus.cc:1685] finished
0709 13:11:52.366755 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.366923 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2018,"prepare.queue_time_us":172361,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":7636,"raft.run_cpu_time_us":595,"raft.run_wall_time_us":95299,"spinlock_wait_cycles":8273664,"thread_start_us":281179,"threads_started":2,"wal-append.queue_time_us":311182}
I20260709 13:11:52.317000 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:52.369611 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1496) took 1715 ms. Trace:
W20260709 13:11:52.369850 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52957.3us
I20260709 13:11:52.335053 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 815) took 1208 ms. Trace:
I20260709 13:11:52.370114 28723 rpcz_store.cc:276] 0709 13:11:50.653897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.978622 (+1324725us) service_pool.cc:224] Handling call
0709 13:11:51.981937 (+  3315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.990312 (+  8375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.990357 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.029631 (+ 39274us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.103272 (+ 73641us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:52.103335 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.103435 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.369367 (+265932us) raft_consensus.cc:1685] finished
0709 13:11:52.369393 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.369547 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2921,"thread_start_us":29304,"threads_started":1,"wal-append.queue_time_us":321796}
I20260709 13:11:52.373360 29255 rpcz_store.cc:276] 0709 13:11:51.127132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.821799 (+694667us) service_pool.cc:224] Handling call
0709 13:11:51.837147 (+ 15348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.032227 (+195080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.032278 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.032815 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.163067 (+130252us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:52.163121 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.163211 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.334731 (+171520us) raft_consensus.cc:1685] finished
0709 13:11:52.334758 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.334970 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84249,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":275831,"threads_started":2,"wal-append.queue_time_us":169140}
I20260709 13:11:52.375195 28723 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:52.375912 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1510) took 1618 ms. Trace:
I20260709 13:11:52.376266 28723 rpcz_store.cc:276] 0709 13:11:50.757889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.374386 (+1616497us) service_pool.cc:224] Handling call
0709 13:11:52.374777 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.375638 (+   861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.375849 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.377985 28723 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:52.378544 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1511) took 1485 ms. Trace:
I20260709 13:11:52.378847 28723 rpcz_store.cc:276] 0709 13:11:50.893481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.377153 (+1483672us) service_pool.cc:224] Handling call
0709 13:11:52.377459 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.378302 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.378492 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.381170 31062 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:52.382066 31062 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:52.382511 31062 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:52.380721 30996 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:52.383126 30996 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.383558 30996 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.347720 30859 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:52.292557 30995 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:52.358071 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.359930 31171 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:52.280848 31078 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.386053 30995 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.386757 31078 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:52.350973 30947 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:52.382586 31180 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:52.383430 31062 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.382066 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:52.409955 29252 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:52.381381 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:52.389205 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:52.410722 29258 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.345286 28725 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.391227 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1503) took 1692 ms. Trace:
I20260709 13:11:52.380353 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1512) took 1441 ms. Trace:
I20260709 13:11:52.412724 28723 rpcz_store.cc:276] 0709 13:11:50.939360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.379563 (+1440203us) service_pool.cc:224] Handling call
0709 13:11:52.379827 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.379996 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.380033 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:52.380076 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:52.380121 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.380192 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.380303 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.414817 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1515) took 1341 ms. Trace:
I20260709 13:11:52.415232 28723 rpcz_store.cc:276] 0709 13:11:51.073243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.413851 (+1340608us) service_pool.cc:224] Handling call
0709 13:11:52.414171 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.414377 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.414426 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:52.414501 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:52.414553 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.414623 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.414753 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.417157 28723 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:11:52.418180 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1516) took 1338 ms. Trace:
I20260709 13:11:52.418648 28723 rpcz_store.cc:276] 0709 13:11:51.079966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.416364 (+1336398us) service_pool.cc:224] Handling call
0709 13:11:52.416713 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.417556 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.417776 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.420341 28723 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:52.422787 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1518) took 1342 ms. Trace:
I20260709 13:11:52.423300 28723 rpcz_store.cc:276] 0709 13:11:51.080620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.419661 (+1339041us) service_pool.cc:224] Handling call
0709 13:11:52.420123 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.422339 (+  2216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.422716 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:52.425505 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:52.436065 29258 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
I20260709 13:11:52.420768 28722 rpcz_store.cc:276] 0709 13:11:50.698997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.002773 (+1303776us) service_pool.cc:224] Handling call
0709 13:11:52.010434 (+  7661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.010690 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:52.163652 (+152962us) log.cc:844] Serialized 14 byte log entry
0709 13:11:52.390787 (+227135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:52.390861 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:52.390931 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.391018 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.391160 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":139090,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":91,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":358448,"threads_started":2,"wal-append.queue_time_us":227497}
I20260709 13:11:52.442363 30902 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:52.380497 31157 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.445730 31062 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.429891 29251 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.454735 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:52.454372 31169 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.455160 31156 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.455727 31165 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.456303 31168 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:52.470978 31187 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:11:52.475832 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:52.479126 28656 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:52.486755 29256 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.489265 31156 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.490168 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:52.490833 29252 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.496588 28655 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:52.498157 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2193) took 2152 ms. Trace:
I20260709 13:11:52.498751 31157 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.500742 31025 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.502395 29256 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:52.503571 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.505848 31114 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:52.508225 29251 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:52.498577 28574 rpcz_store.cc:276] 0709 13:11:50.345500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.345817 (+   317us) service_pool.cc:224] Handling call
0709 13:11:52.497988 (+2152171us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540036d654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:52.498094 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3524691712}
I20260709 13:11:52.510246 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.511078 28574 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:52.486104 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2300) took 1973 ms. Trace:
I20260709 13:11:52.513361 28572 rpcz_store.cc:276] 0709 13:11:50.512287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.228620 (+1716333us) service_pool.cc:224] Handling call
0709 13:11:52.228906 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.233902 (+  4996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.234326 (+   424us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.235008 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.471028 (+236020us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:52.471066 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.471135 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.485108 (+ 13973us) raft_consensus.cc:1685] finished
0709 13:11:52.485137 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.486022 (+   885us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3108,"raft.queue_time_us":11812,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3516,"thread_start_us":171959,"threads_started":1,"wal-append.queue_time_us":230003}
I20260709 13:11:52.515232 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:52.516149 28572 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:11:52.516587 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.500677 30902 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:52.524905 29252 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:52.532214 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.533272 30859 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.533855 30859 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.536366 30859 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:52.538276 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.539369 31096 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.530707 31097 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:52.545115 31097 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.548921 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.549968 28722 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 3: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:52.551128 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.552353 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:52.570487 28622 connection.cc:256] RPC call timeout handler was delayed by -1.9768089310000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 13:11:52.574105 28622 connection.cc:256] RPC call timeout handler was delayed by -1.9516089310000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 13:11:52.577854 28622 connection.cc:256] RPC call timeout handler was delayed by -1.7770089310000685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:11:52.580569 28622 connection.cc:256] RPC call timeout handler was delayed by -1.578108931000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:11:52.581135 28622 connection.cc:256] RPC call timeout handler was delayed by -1.5574089310000545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260709 13:11:52.581652 28622 connection.cc:256] RPC call timeout handler was delayed by -1.3549089310000682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24020000000000002s for a response
W20260709 13:11:52.582652 28622 connection.cc:256] RPC call timeout handler was delayed by -1.2955089310000858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24680000000000002s for a response
W20260709 13:11:52.583148 28622 connection.cc:256] RPC call timeout handler was delayed by -1.2928089310000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24710000000000001s for a response
W20260709 13:11:52.583550 28622 connection.cc:256] RPC call timeout handler was delayed by -1.119108931000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2664s for a response
I20260709 13:11:52.596933 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:52.522325 31165 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:52.618497 28475 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 387) took 12709 ms (client timeout 15000 ms). Trace:
W20260709 13:11:52.596582 31196 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:11:52.637579 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:52.641827 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:52.642462 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.534595 28465 catalog_manager.cc:5028] TS 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): tablet 6caf9ec933124d00b3e0e2cfeccd317b (table test-workload [id=968a8e8c399e43e1b6426057d66f2f19]) successfully deleted
W20260709 13:11:52.647939 28465 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 117243us
W20260709 13:11:52.649286 28577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2298) took 2139 ms (client timeout 1766 ms). Trace:
I20260709 13:11:52.649420 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.650607 28729 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.638317 28722 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:52.651667 31168 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:52.649801 28577 rpcz_store.cc:269] 0709 13:11:50.509483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.535801 (+ 26318us) service_pool.cc:224] Handling call
0709 13:11:52.584684 (+2048883us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b54001a9354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:52.649208 (+ 64524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203757440}
I20260709 13:11:52.654659 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.655591 31097 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.657361 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:52.657743 28649 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 13:11:52.658084 28652 raft_consensus.cc:2376] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4. Re-sending same reply.
I20260709 13:11:52.658248 31113 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:52.657248 31169 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.584723 31096 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.662091 28479 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 4, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 4 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:52.663795 28479 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:52.639995 28475 rpcz_store.cc:269] 0709 13:11:39.842473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.842601 (+   128us) service_pool.cc:224] Handling call
0709 13:11:40.680783 (+838182us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b5400163d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d80090 00007f4a27e1ef3a 00007f4a2dbd51cc 00007f4a2dcd337e 00007f4a2c1942a4 00007f4a2c194232 00007f4a2c194161 00007f4a2c1940dc 00007f4a2c193392 00007f4a2615148c 00007f4a261508c6
0709 13:11:52.552175 (+11871392us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:45.424646 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:45.481149 (+ 56503us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:45.481182 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:11:45.481198 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:45.481558 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:45.481632 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:45.481665 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:45.481858 (+   193us) tablet.cc:701] Row locks acquired
0709 13:11:45.481876 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:45.482015 (+   139us) write_op.cc:270] Start()
0709 13:11:45.482124 (+   109us) write_op.cc:276] Timestamp: P: 1783602705481966 usec, L: 0
0709 13:11:45.482146 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:45.483030 (+   884us) log.cc:844] Serialized 533 byte log entry
0709 13:11:46.038246 (+555216us) op_driver.cc:464] REPLICATION: finished
0709 13:11:46.422476 (+384230us) write_op.cc:301] APPLY: starting
0709 13:11:46.438844 (+ 16368us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:46.444492 (+  5648us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:46.449149 (+  4657us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:46.484159 (+ 35010us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:46.498341 (+ 14182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:46.503666 (+  5325us) write_op.cc:312] APPLY: finished
0709 13:11:46.514944 (+ 11278us) log.cc:844] Serialized 23 byte log entry
0709 13:11:46.518674 (+  3730us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:46.518772 (+    98us) write_op.cc:454] Released schema lock
0709 13:11:46.518813 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:46.519211 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:46.519246 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":82043136,"child_traces":[["op",{"apply.queue_time_us":351566,"apply.run_cpu_time_us":4995,"apply.run_wall_time_us":101268,"num_ops":1,"prepare.queue_time_us":205475,"prepare.run_cpu_time_us":2982,"prepare.run_wall_time_us":85555,"replication_time_us":491036,"thread_start_us":282471,"threads_started":2}]]}
I20260709 13:11:52.637414 30902 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.673810 28479 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 5, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.675648 28729 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:52.678894 28479 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 4 to 5, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:11:52.675644 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.683588 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.684309 28722 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.686380 28650 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.687626 28574 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:52.682253 28479 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 3, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:11:52.689414 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:52.690385 28729 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:52.690272 28479 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 2, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.692310 28650 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.692317 28479 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.697048 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.697260 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.697780 28652 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:11:52.698061 28729 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:52.698940 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:52.697781 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.706820 28652 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:52.707778 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.708451 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1638) took 3619 ms. Trace:
I20260709 13:11:52.708550 28649 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:52.705416 28479 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 4, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 4 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.711791 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.708947 28648 rpcz_store.cc:276] 0709 13:11:49.088704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.393522 (+1304818us) service_pool.cc:224] Handling call
0709 13:11:50.393890 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:50.397869 (+  3979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.397914 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.401869 (+  3955us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.387495 (+1985626us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18003514c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:11:52.657182 (+269687us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:52.657801 (+   619us) log.cc:844] Serialized 14 byte log entry
0709 13:11:52.658007 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.658084 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.708067 (+ 49983us) raft_consensus.cc:1685] finished
0709 13:11:52.708182 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.708368 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1095,"prepare.queue_time_us":187,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":8046,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":5924,"spinlock_wait_cycles":3049344,"thread_start_us":269493,"threads_started":1,"wal-append.queue_time_us":2294679}
I20260709 13:11:52.712492 28650 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:52.722143 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:52.724169 28545 connection.cc:256] RPC call timeout handler was delayed by -1.3076163800000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 13:11:52.724866 28545 connection.cc:256] RPC call timeout handler was delayed by -1.2653163800000584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:11:52.725966 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.722086 31033 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:52.729545 31033 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.733112 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.733528 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.734838 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.735306 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.735903 28648 raft_consensus.cc:2368] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4.
I20260709 13:11:52.736438 28574 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:52.741760 28729 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:11:52.744632 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:52.749295 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.750315 28649 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:52.752709 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.753934 28729 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.759248 31014 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:52.761425 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.766139 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:52.767994 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.694967 30902 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:52.747718 31023 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:11:52.776237 28579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2296) took 2819 ms (client timeout 1541 ms). Trace:
I20260709 13:11:52.680245 30996 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.782099 31111 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:52.789631 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.866436 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:52.868444 28649 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.850896 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:52.870405 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.852557 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.874738 28653 raft_consensus.cc:2410] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:11:52.875471 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.872663 28579 rpcz_store.cc:269] 0709 13:11:49.956991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.957527 (+   536us) service_pool.cc:224] Handling call
0709 13:11:52.776037 (+2818510us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54000e4f54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:52.776159 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438628224}
I20260709 13:11:52.876890 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.877662 28652 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:11:52.878389 28650 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:52.882324 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:52.801285 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.884864 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:52.885488 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.874514 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:52.732782 31033 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.881500 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:52.895321 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:52.896111 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.893828 28578 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:52.896924 28579 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:52.876587 28727 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.898422 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:52.899053 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:52.904420 28649 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:11:52.907255 28722 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:52.908247 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:52.882076 31010 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:52.912609 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.914588 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.918370 28730 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.908852 28722 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:52.924398 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.892187 31062 raft_consensus.cc:2764] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:11:52.881573 31014 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:52.931285 28729 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:52.895484 31078 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.896350 31165 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.896103 31156 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.900736 31024 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:11:52.895917 31097 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.929337 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:52.902383 31168 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:52.905200 31134 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:52.876372 31111 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:52.911742 30859 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:52.937798 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:52.939327 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:52.941043 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.944629 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.920718 30963 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:52.916721 31010 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.003468 31010 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.980019 31156 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.976954 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.009446 28722 raft_consensus.cc:2368] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:11:53.009737 31156 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:52.975832 31078 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.011190 30996 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.011301 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.012053 28724 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:52.984073 28727 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:52.880537 31023 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:52.902699 31190 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:11:52.976924 31114 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.010423 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:52.922418 31050 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:11:52.979831 31165 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.013829 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.018765 31023 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.025877 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.015230 28722 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.016080 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.029383 28729 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:52.986537 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:53.030040 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 90814.6us
I20260709 13:11:53.012971 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.032160 28724 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:53.030918 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:52.935385 30837 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:11:53.001533 30859 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:52.980816 31062 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:11:53.052047 28730 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:53.066955 28722 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:53.058176 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1497) took 2403 ms. Trace:
I20260709 13:11:53.050645 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.056336 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2192) took 2711 ms. Trace:
I20260709 13:11:53.032878 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:53.068830 28580 rpcz_store.cc:276] 0709 13:11:50.345147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.345286 (+   139us) service_pool.cc:224] Handling call
0709 13:11:50.345645 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.377210 (+ 31565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.377239 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:50.377280 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:50.377317 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.055985 (+2678668us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b5400352fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:53.056058 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.056241 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72146816}
W20260709 13:11:53.041169 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.068214 28725 rpcz_store.cc:276] 0709 13:11:50.654262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.980740 (+1326478us) service_pool.cc:224] Handling call
0709 13:11:51.981083 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.412253 (+431170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.057858 (+645605us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54002341d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:53.058086 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836284672}
I20260709 13:11:53.036765 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.038456 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:53.072878 28729 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:52.982928 31097 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.058641 31165 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.052870 31111 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:53.077092 31096 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.012943 31078 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:53.082073 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.001784 31168 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:53.083530 28725 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:53.086402 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53607.9us
I20260709 13:11:53.079850 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2216) took 1133 ms. Trace:
I20260709 13:11:53.089833 28574 rpcz_store.cc:276] 0709 13:11:51.946668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.078892 (+1132224us) service_pool.cc:224] Handling call
0709 13:11:53.079259 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.079463 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.079499 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:53.079548 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:53.079590 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.079657 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.079784 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:53.067703 30859 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:53.060619 28573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 621) took 2440 ms (client timeout 1955 ms). Trace:
I20260709 13:11:53.095275 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2145) took 4089 ms. Trace:
I20260709 13:11:53.093511 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:53.096729 28730 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.095882 28726 rpcz_store.cc:276] 0709 13:11:49.006158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.006270 (+   112us) service_pool.cc:224] Handling call
0709 13:11:50.181405 (+1175135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:50.327042 (+145637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.095013 (+2767971us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001b7e50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.095190 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662747008}
I20260709 13:11:53.098573 29223 leader_election.cc:400] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:11:53.098964 29223 leader_election.cc:403] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:53.087090 31062 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:53.069450 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 144507us
I20260709 13:11:53.116132 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:53.091965 31078 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:53.126667 28730 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:11:53.115079 31062 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.119278 31114 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:53.164299 28580 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:53.175256 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 276920us
W20260709 13:11:53.123051 31039 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.010s	sys 0.002s
I20260709 13:11:53.090245 31096 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:53.127028 31078 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:53.179396 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:11:53.181337 28576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2199) took 2737 ms (client timeout 1802 ms). Trace:
W20260709 13:11:53.185895 28576 rpcz_store.cc:269] 0709 13:11:50.443876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.443998 (+   122us) service_pool.cc:224] Handling call
0709 13:11:53.172630 (+2728632us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54001fb654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.181254 (+  8624us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3429153024}
I20260709 13:11:53.188083 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:53.171468 31062 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:53.098186 28573 rpcz_store.cc:269] 0709 13:11:50.620337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.064289 (+443952us) service_pool.cc:224] Handling call
0709 13:11:53.060364 (+1996075us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54001aa754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.060533 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2149430656}
W20260709 13:11:53.183204 31039 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.010s	sys 0.003s
I20260709 13:11:53.128829 31026 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:11:53.204239 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 297530us
I20260709 13:11:53.193688 31114 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:53.213164 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 90446.4us
I20260709 13:11:53.202509 31039 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:53.217299 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 101261us
I20260709 13:11:53.219282 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:53.221882 28622 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:53.218297 29223 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:53.227272 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:53.228806 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:53.228799 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:53.230129 28721 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:53.229904 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:53.217036 30902 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:53.239161 28728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 1499) took 2584 ms (client timeout 3326 ms). Trace:
I20260709 13:11:53.239430 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:53.241250 28652 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:53.189090 31168 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.241765 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:53.243976 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:53.243160 28728 rpcz_store.cc:269] 0709 13:11:50.654894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.014727 (+359833us) service_pool.cc:224] Handling call
0709 13:11:53.238982 (+2224255us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001b9254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.239103 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252675840}
I20260709 13:11:53.215896 31201 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:53.227406 30970 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:53.214037 31128 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:11:53.231382 31190 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:53.231313 31097 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.242650 31105 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:53.248050 31033 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:53.250370 31211 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:53.245944 31023 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:53.280571 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 58791.7us
I20260709 13:11:53.282852 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:53.289665 31205 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:53.290221 31205 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.290558 31205 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:53.292706 29224 leader_election.cc:336] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.953s (SENT)
I20260709 13:11:53.298942 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:53.272400 31211 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.306071 30859 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.300612 31010 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:53.307086 31024 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:53.307230 28652 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:53.307684 31097 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:53.308251 30859 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.253156 30970 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:53.255800 31190 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.272763 30963 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:53.245568 31207 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:11:53.308773 31010 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:53.320147 28652 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:53.319897 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2166) took 1116 ms. Trace:
I20260709 13:11:53.320931 28655 rpcz_store.cc:276] 0709 13:11:52.203215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.203358 (+   143us) service_pool.cc:224] Handling call
0709 13:11:53.319673 (+1116315us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540001ccd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.319836 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650801408}
I20260709 13:11:53.323997 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.309319 31033 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:53.325346 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.326099 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.326272 29259 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:53.326756 29252 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:53.238590 31078 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.326900 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.325368 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.327657 29258 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:53.327795 29251 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:53.317519 30859 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:53.328171 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.309975 31211 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.315781 31190 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.329843 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.331297 29255 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:53.318486 30970 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.317580 31023 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:53.318010 31105 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:53.318104 31209 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:53.340629 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.341272 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.341910 29258 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:53.342041 29259 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:53.342695 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.343483 29256 raft_consensus.cc:2368] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6.
I20260709 13:11:53.344391 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.345140 29256 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:53.346124 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.346745 29256 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:11:53.347743 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.342751 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.349268 28696 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:53.349596 29258 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:53.350111 31165 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:53.350477 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:53.350495 31165 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:53.343312 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.351142 31165 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.351387 31156 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:53.351958 31156 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.352434 31156 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.350560 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.329727 30963 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:11:53.364643 31200 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:11:53.336349 31096 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:53.337540 31024 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:53.339197 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.355464 30963 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:53.377023 30949 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.448s	user 0.004s	sys 0.009s
W20260709 13:11:53.384424 31098 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.214s	user 0.004s	sys 0.014s
W20260709 13:11:53.388033 30949 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.457s	user 0.004s	sys 0.009s
I20260709 13:11:53.367998 31078 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.365520 31033 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:53.388584 31098 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.219s	user 0.005s	sys 0.015s
I20260709 13:11:53.420914 31190 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.582731 29252 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:53.580854 31062 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:53.462352 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 216420us
W20260709 13:11:53.588675 31229 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:11:53.486073 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:53.496098 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.496739 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:53.501430 28648 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:11:53.501946 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.503862 28721 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:11:53.507656 29224 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 2.114s (SENT)
I20260709 13:11:53.507841 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.509979 28727 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:53.514981 28728 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:53.496089 28652 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:53.517675 30890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.703s	user 0.013s	sys 0.011s
I20260709 13:11:53.395288 31023 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:53.596765 30890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.782s	user 0.013s	sys 0.012s
I20260709 13:11:53.593397 28652 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:53.596751 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:53.599401 28575 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:11:53.599620 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 92234.3us
I20260709 13:11:53.391125 31024 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:53.425477 31201 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:11:53.426757 31211 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:53.557549 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62685.2us
W20260709 13:11:53.613721 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.457551 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 215592us
I20260709 13:11:53.482780 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:53.400414 31105 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.599310 28652 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.616441 28649 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:53.617027 28652 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.617879 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:53.619987 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:53.620199 31224 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:53.425621 31205 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.621210 30913 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:53.621553 29258 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:53.621721 30913 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:53.622274 30913 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.623281 31205 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.624418 30890 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:53.625080 30890 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:53.626603 30890 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:53.629695 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 346808us
W20260709 13:11:53.631388 28621 leader_election.cc:336] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.541s (SENT)
I20260709 13:11:53.612735 31211 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:53.632783 29253 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:53.634308 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.635479 29253 raft_consensus.cc:2368] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6.
I20260709 13:11:53.636053 28652 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:11:53.638935 28696 leader_election.cc:400] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6.
I20260709 13:11:53.640851 28696 leader_election.cc:403] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:53.584940 31190 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:53.639700 30913 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.641788 29256 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:53.636619 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.642198 28652 pending_rounds.cc:85] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 6
I20260709 13:11:53.641813 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:53.650442 30913 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.655270 28649 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
W20260709 13:11:53.669275 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 183651us
I20260709 13:11:53.642030 31130 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6.
I20260709 13:11:53.675235 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:53.677155 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:53.678210 28728 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.680038 31174 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.681571 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:53.682614 28721 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:53.694989 28581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2197) took 3256 ms (client timeout 1891 ms). Trace:
W20260709 13:11:53.695673 28581 rpcz_store.cc:269] 0709 13:11:50.438640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.441105 (+  2465us) service_pool.cc:224] Handling call
0709 13:11:53.694287 (+3253182us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54000ec4d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.694632 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324605184}
I20260709 13:11:53.698045 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:53.696218 29255 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:11:53.663447 28652 pending_rounds.cc:107] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:11:53.711102 28652 raft_consensus.cc:2889] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:53.698907 29253 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.742146 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.743444 29255 raft_consensus.cc:2368] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
I20260709 13:11:53.745422 28696 leader_election.cc:400] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
I20260709 13:11:53.746035 28696 leader_election.cc:403] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:53.747571 31130 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
I20260709 13:11:53.750319 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2158) took 3793 ms. Trace:
I20260709 13:11:53.640997 31165 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.744685 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:53.787370 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1656) took 1904 ms. Trace:
W20260709 13:11:53.788725 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 71690.8us
W20260709 13:11:53.750689 28651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2168) took 1545 ms (client timeout 1741 ms). Trace:
I20260709 13:11:53.835167 28647 rpcz_store.cc:276] 0709 13:11:49.956633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.480451 (+523818us) service_pool.cc:224] Handling call
0709 13:11:50.929661 (+449210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.977869 (+ 48208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.749732 (+2771863us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54003b1350. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.750051 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032333184}
I20260709 13:11:53.833501 28656 rpcz_store.cc:276] 0709 13:11:51.882753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.964397 (+ 81644us) service_pool.cc:224] Handling call
0709 13:11:51.964724 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.481172 (+516448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.752220 (+1271048us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540001d1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:53.787117 (+ 34897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182205184}
I20260709 13:11:53.787633 31201 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.839027 28651 rpcz_store.cc:269] 0709 13:11:52.205382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.205483 (+   101us) service_pool.cc:224] Handling call
0709 13:11:53.750096 (+1544613us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b540018ef54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.750412 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83316096}
I20260709 13:11:53.787708 31190 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:53.845868 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:53.841913 31174 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.856415 31233 raft_consensus.cc:2764] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:11:53.857362 29259 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:11:53.787132 31220 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:53.873314 29251 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:53.878304 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:53.878736 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2302) took 3188 ms. Trace:
I20260709 13:11:53.879312 28729 raft_consensus.cc:2376] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3. Re-sending same reply.
I20260709 13:11:53.873445 31224 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:53.881592 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:53.881803 31066 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:53.881944 30970 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.007s
W20260709 13:11:53.871634 31212 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.565s	user 0.002s	sys 0.000s
I20260709 13:11:53.874034 31054 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:53.883188 29255 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
W20260709 13:11:53.873602 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 252574us
I20260709 13:11:53.885727 28721 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:53.879146 28580 rpcz_store.cc:276] 0709 13:11:50.690179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.082611 (+2392432us) service_pool.cc:224] Handling call
0709 13:11:53.082880 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.175239 (+ 92359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.878079 (+702840us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b54000e4554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:53.878482 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186777856}
I20260709 13:11:53.881604 31224 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:53.890282 28620 leader_election.cc:336] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.717s (SENT)
I20260709 13:11:53.890647 31054 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:53.890872 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:53.886436 31066 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.895625 31066 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.895915 28728 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:53.898191 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2301) took 3208 ms. Trace:
I20260709 13:11:53.898651 28575 rpcz_store.cc:276] 0709 13:11:50.689867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.389171 (+1699304us) service_pool.cc:224] Handling call
0709 13:11:52.389491 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:53.600029 (+1210538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.897872 (+297843us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001fca54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:53.898107 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2780983552}
I20260709 13:11:53.901953 31220 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:53.905468 31111 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:53.905550 31062 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:53.909687 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 60685.2us
W20260709 13:11:53.917338 28578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 628) took 1514 ms (client timeout 1581 ms). Trace:
W20260709 13:11:53.917857 28578 rpcz_store.cc:269] 0709 13:11:52.403184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.503270 (+100086us) service_pool.cc:224] Handling call
0709 13:11:53.916902 (+1413632us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54003511d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:53.917142 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895261440}
I20260709 13:11:53.886467 30970 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:53.925349 31235 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.276s	user 0.001s	sys 0.001s
I20260709 13:11:53.929786 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:53.930617 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1172) took 1764 ms. Trace:
I20260709 13:11:53.931450 29260 rpcz_store.cc:276] 0709 13:11:52.165989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.166155 (+   166us) service_pool.cc:224] Handling call
0709 13:11:52.166541 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.300632 (+134091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.929828 (+1629196us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b5400610154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:53.930293 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225063296}
I20260709 13:11:53.933496 31062 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:53.935775 29257 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:53.938083 30970 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.938864 29257 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:11:53.942931 29224 leader_election.cc:336] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.560s (SENT)
I20260709 13:11:53.892587 31054 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:53.914811 31165 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:53.951238 31033 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:53.977819 31050 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:53.977918 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:53.958571 31208 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:53.959592 31151 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:53.932860 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:53.971410 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:53.971684 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:53.973884 28580 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:53.970841 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:53.997921 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 93452.3us
W20260709 13:11:54.047652 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.057518 28621 leader_election.cc:336] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.766s (SENT)
I20260709 13:11:54.048269 31054 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:54.061311 31156 consensus_meta.cc:287] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.000s
W20260709 13:11:54.063138 31240 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:11:54.069813 31224 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:54.076475 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 375665us
I20260709 13:11:54.077543 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:53.978261 31033 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.081432 31201 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.086206 29258 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:54.090250 31236 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.440s	user 0.003s	sys 0.000s
I20260709 13:11:53.978535 31050 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:54.092445 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:54.093699 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.109906 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.093466 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 113802us
I20260709 13:11:54.094182 30890 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:54.098228 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.098310 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.979573 31190 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.046527 29256 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:54.104086 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.115000 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:54.121531 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:54.121832 31201 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:54.122321 29254 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:54.129590 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.109287 31156 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.130928 28572 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:54.131817 28724 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:54.129647 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 72183.4us
I20260709 13:11:54.133482 31159 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:11:54.134789 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.136607 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.136888 31033 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:54.139748 31190 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:54.141160 31165 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.141517 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 198623us
I20260709 13:11:54.142140 31165 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:54.143062 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:54.144502 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.120582 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:54.144702 31165 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:54.145555 31165 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:54.155393 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 222665us
I20260709 13:11:54.156507 28724 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:54.105465 29253 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:54.146071 31165 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.161316 31156 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:54.162145 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 69870.8us
W20260709 13:11:54.163129 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 48333.2us
I20260709 13:11:54.163704 30890 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:54.164376 31184 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:54.166100 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.166920 31211 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.185982 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:54.189608 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.175132 31165 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:54.193821 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.195205 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.168720 29254 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:54.160199 31050 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.159446 29224 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:54.197254 28581 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:54.196244 28572 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:54.197431 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.179838 30890 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:54.184731 31211 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.199997 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:54.183358 31184 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:54.203266 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.203959 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:54.203779 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:54.235232 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:54.233654 31134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.170s	user 0.005s	sys 0.024s
W20260709 13:11:54.238222 31134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.217s	user 0.006s	sys 0.025s
I20260709 13:11:54.201829 30890 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.201457 31211 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.238272 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:11:54.242834 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 88007.7us
I20260709 13:11:54.231537 31151 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.231776 31184 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:54.240114 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 53082.2us
I20260709 13:11:54.242615 31062 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:54.238518 31169 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.238693 31134 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:54.252647 28575 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:54.254765 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.258517 28721 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:54.247746 31151 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:54.250736 31159 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:54.253198 31050 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.265182 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.277400 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:54.286427 28579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.021s
W20260709 13:11:54.286978 28579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.007s	sys 0.021s
I20260709 13:11:54.264959 31151 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.280469 31208 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:11:54.297948 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.331004 31174 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.282199 31062 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:11:54.331691 31174 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.297514 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:54.333642 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.334108 31174 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:54.334321 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.334362 31190 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:54.335222 31190 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:11:54.337723 31248 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:11:54.340358 31250 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:54.332767 31062 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.341918 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.341415 31134 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.343240 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:11:54.343497 31245 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.281s	user 0.001s	sys 0.001s
I20260709 13:11:54.340780 28577 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:54.341508 31062 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:11:54.328641 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62603.9us
I20260709 13:11:54.346036 31062 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.346915 31026 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:54.347416 31026 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:54.347604 31062 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.348925 31014 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:54.350497 31014 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.353638 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.302465 31159 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:11:54.293330 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 107246us
I20260709 13:11:54.295277 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:54.357985 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52635.8us
I20260709 13:11:54.295040 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.360387 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.369453 29223 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:54.280002 30970 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:54.369552 28620 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.076s (SENT)
I20260709 13:11:54.291380 31078 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.365818 28576 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:11:54.365342 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 112152us
W20260709 13:11:54.379534 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 93706.7us
W20260709 13:11:54.371114 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 226766us
I20260709 13:11:54.382863 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:54.390827 28581 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:54.336452 31190 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.356304 31159 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:54.395045 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:54.401665 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 43860.6us
W20260709 13:11:54.406648 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 142487us
I20260709 13:11:54.405831 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:54.416486 31226 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:54.419947 28695 leader_election.cc:336] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.802s (SENT)
I20260709 13:11:54.423115 29223 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:54.425590 29224 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:54.426571 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:54.399446 31169 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:54.421945 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2303) took 3706 ms. Trace:
I20260709 13:11:54.391597 31033 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:11:54.396725 31173 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:11:54.438366 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:54.421180 31233 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:54.439535 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.423869 31224 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.409304 30970 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:54.431183 31065 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:54.452677 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 89762.5us
I20260709 13:11:54.454762 31168 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:54.445943 31233 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.456339 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.461954 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:11:54.466176 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 64658.5us
I20260709 13:11:54.495369 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:54.459347 31130 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.431771 31156 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:11:54.463696 31233 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.437101 28579 rpcz_store.cc:276] 0709 13:11:50.716027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.085909 (+2369882us) service_pool.cc:224] Handling call
0709 13:11:53.092431 (+  6522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.093228 (+   797us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:53.093544 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:11:53.684083 (+590539us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b180043c060. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a 00007f4a27e20a2a
0709 13:11:54.380480 (+696397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:54.387615 (+  7135us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:54.399609 (+ 11994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.413263 (+ 13654us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.421871 (+  8608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56923,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":10094,"raft.queue_time_us":31667,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"spinlock_wait_cycles":8340864,"thread_start_us":603104,"threads_started":1,"wal-append.queue_time_us":1235467}
W20260709 13:11:54.500253 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51434.8us
I20260709 13:11:54.511942 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:54.513226 28653 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:54.513800 28653 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:54.514804 28655 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:54.514909 28653 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.516434 28653 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.521847 31009 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:11:54.522503 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 76232.7us
I20260709 13:11:54.524140 30970 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:54.527648 31253 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:54.529111 31163 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:54.529793 31009 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:54.530285 31009 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:54.531388 31009 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.532079 31221 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:54.534261 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.524839 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:54.534762 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.497206 31174 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:54.534016 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1178) took 1031 ms. Trace:
I20260709 13:11:54.496742 31201 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:54.517495 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:54.546710 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1188) took 1026 ms. Trace:
I20260709 13:11:54.547250 31168 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:11:54.612159 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.613056 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.614059 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 89293.3us
I20260709 13:11:54.541929 29252 rpcz_store.cc:276] 0709 13:11:53.502803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.948996 (+446193us) service_pool.cc:224] Handling call
0709 13:11:53.949664 (+   668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:53.950688 (+  1024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.950719 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:53.951450 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 13:11:54.257894 (+306444us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:54.257962 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.259698 (+  1736us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:54.533782 (+274084us) raft_consensus.cc:1685] finished
0709 13:11:54.533800 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.533948 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":258,"thread_start_us":303101,"threads_started":1,"wal-append.queue_time_us":476195}
I20260709 13:11:54.549049 29251 rpcz_store.cc:276] 0709 13:11:53.520580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.976367 (+455787us) service_pool.cc:224] Handling call
0709 13:11:53.976783 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.977103 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:54.263191 (+286088us) log.cc:844] Serialized 14 byte log entry
0709 13:11:54.546259 (+283068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:54.546330 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:54.546392 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.546475 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.546636 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1244,"prepare.queue_time_us":314870,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":5255,"thread_start_us":542000,"threads_started":3}
I20260709 13:11:54.453583 31026 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:54.620527 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 122978us
I20260709 13:11:54.613135 31169 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.615903 31009 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:54.646445 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 162700us
I20260709 13:11:54.638366 28696 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:54.640085 28655 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:54.651477 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:54.620638 31163 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:54.500547 31258 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.155s
W20260709 13:11:54.666682 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 126980us
I20260709 13:11:54.668983 28622 leader_election.cc:400] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6.
I20260709 13:11:54.671980 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:54.685385 28622 leader_election.cc:403] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:11:54.666705 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 228413us
I20260709 13:11:54.648975 31130 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:54.687892 28728 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:54.692016 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:54.645756 31169 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.656428 30970 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:54.699085 28721 raft_consensus.cc:2410] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:54.634291 31065 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:54.662945 31054 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.710078 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.711906 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49271.1us
W20260709 13:11:54.718572 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 66360.5us
I20260709 13:11:54.719388 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:54.721535 28724 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:54.725322 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:54.707367 30970 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.706934 31169 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.737883 28574 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:54.664230 31226 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:11:54.739352 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:54.741734 28721 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:54.671682 31190 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:11:54.745098 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:54.746037 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:54.733157 31205 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6.
I20260709 13:11:54.719761 31054 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.751863 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:54.753520 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:54.754415 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:54.755590 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.720854 31066 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:54.760025 30890 consensus_meta.cc:287] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
I20260709 13:11:54.762419 31267 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.739009 30970 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:54.767477 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 639) took 2230 ms. Trace:
W20260709 13:11:54.772214 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.775013 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 132672us
I20260709 13:11:54.705225 31221 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:11:54.818586 28653 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:54.820706 28727 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:54.822570 29252 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:54.760938 31165 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.001s
W20260709 13:11:54.849556 29224 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.833s (SENT) [suppressed 56 similar messages]
I20260709 13:11:54.826766 31066 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:54.832082 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:54.838232 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.833890 28572 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:54.826603 28574 rpcz_store.cc:276] 0709 13:11:52.537601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.095434 (+557833us) service_pool.cc:224] Handling call
0709 13:11:53.095937 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:54.765547 (+1669610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.767181 (+  1634us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001fbb54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:54.767414 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3541696384}
I20260709 13:11:54.826601 31274 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.826973 30890 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.838436 31190 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:54.770416 31163 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.862067 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:54.843587 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.835769 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:54.843976 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:54.845631 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:54.849251 31165 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.830940 31267 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.875090 28724 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:54.877140 28728 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:54.850790 31174 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.897406 28695 leader_election.cc:400] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:11:54.900458 28695 leader_election.cc:403] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:54.900465 29252 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
W20260709 13:11:54.904704 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.905303 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.899099 31205 raft_consensus.cc:2764] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:11:54.910847 28573 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:54.911213 31205 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:54.912137 31267 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:54.914168 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:54.914999 28721 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:54.915648 30890 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:54.823151 31151 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.917932 31151 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:54.918107 31165 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:54.919561 31054 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:54.861876 31190 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:54.912256 31205 consensus_queue.cc:1243] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:11:54.935549 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 179432us
I20260709 13:11:54.904255 31174 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:54.921252 31062 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.006s
I20260709 13:11:54.944669 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:54.940747 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 70318.2us
I20260709 13:11:54.773066 31168 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:54.940217 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:54.923108 31201 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:54.958914 28728 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:54.966382 29255 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
W20260709 13:11:54.969666 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 217889us
I20260709 13:11:54.948483 31174 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.993177 29253 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:54.994681 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.995935 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 159326us
I20260709 13:11:54.999846 29259 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:54.999696 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:54.894929 31065 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.020574 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:55.021791 28728 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:54.934250 31066 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.028193 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:55.014084 30996 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.019555 31062 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.010926 30970 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.054756 28730 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:55.065934 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:55.072530 31264 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:55.055946 31201 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:55.071609 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 222050us
I20260709 13:11:55.048637 30996 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:55.081874 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:55.076620 31062 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.086798 31296 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 13:11:55.087244 31268 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:11:55.027740 31190 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:55.107899 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:55.096758 29224 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 2.026s (SENT)
I20260709 13:11:55.110255 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:55.325773 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:55.311558 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:55.128759 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.123085 29257 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:55.115604 28728 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:55.114104 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:55.094868 31218 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.339854 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:55.116324 30970 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:55.307013 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.340783 29257 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:11:55.190649 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 145997us
W20260709 13:11:55.339702 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 242948us
I20260709 13:11:55.090656 31062 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:55.359544 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.360321 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:55.361436 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:55.362555 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:55.333562 31286 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.149322 31275 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:55.365353 31249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.004s	sys 0.011s
W20260709 13:11:55.354589 31233 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.806s	user 0.008s	sys 0.005s
I20260709 13:11:55.366968 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2171) took 3194 ms. Trace:
W20260709 13:11:55.114631 31292 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:55.270864 31105 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:55.369133 31289 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:11:55.372435 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:55.142491 31262 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.518s	user 0.003s	sys 0.000s
W20260709 13:11:55.113072 31211 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.004s
I20260709 13:11:55.378429 28729 raft_consensus.cc:2376] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5. Re-sending same reply.
I20260709 13:11:55.380172 28727 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:55.380839 28722 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:11:55.112267 31169 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:55.398856 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:55.444851 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 473722us
I20260709 13:11:55.474002 28721 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:55.145329 31294 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:55.392961 31184 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.141s	user 0.007s	sys 0.006s
W20260709 13:11:55.476341 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 129270us
W20260709 13:11:55.474437 28620 leader_election.cc:336] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.511s (SENT)
I20260709 13:11:55.340318 31218 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.494690 28725 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:55.494766 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:55.394614 31249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.004s	sys 0.011s
W20260709 13:11:55.509686 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.378675 31066 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:55.476009 31275 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.516181 28729 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.458375 31267 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:55.521044 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 148664us
I20260709 13:11:55.473872 28723 rpcz_store.cc:276] 0709 13:11:52.172090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.428933 (+256843us) service_pool.cc:224] Handling call
0709 13:11:53.239456 (+810523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:53.246200 (+  6744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.246230 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:53.246678 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:11:54.097918 (+851240us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b18000702a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:11:54.328276 (+230358us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:54.328352 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.359963 (+ 31611us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:54.533673 (+173710us) raft_consensus.cc:1685] finished
0709 13:11:54.533690 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.366621 (+832931us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54001b9250. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:55.366764 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7971,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7335,"spinlock_wait_cycles":1878138368,"thread_start_us":161807,"threads_started":1,"wal-append.queue_time_us":1178855}
I20260709 13:11:55.413394 31165 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:55.480813 31294 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:55.474108 31105 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:55.513288 31299 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:55.483829 31065 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:55.517795 31130 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.026s	sys 0.031s
I20260709 13:11:55.535343 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:55.544452 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:55.539264 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:55.544008 31130 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.027s	sys 0.031s
I20260709 13:11:55.551641 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:55.446537 31286 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.481678 31233 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.478222 31211 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:55.561900 29224 leader_election.cc:336] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.580s (SENT)
I20260709 13:11:55.564615 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:55.566670 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.489558 31184 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:55.569072 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2314) took 1272 ms. Trace:
I20260709 13:11:55.569638 28572 rpcz_store.cc:276] 0709 13:11:54.296742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.332778 (+ 36036us) service_pool.cc:224] Handling call
0709 13:11:55.568779 (+1236001us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54000ec9d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:55.568894 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080578944}
I20260709 13:11:55.558224 31130 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:11:55.575415 31307 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:11:55.575754 31105 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:55.575927 31130 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.582049 28652 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:55.529444 31275 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.588459 29251 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:55.535034 31267 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.532179 31165 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.594128 28577 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:55.597795 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.602118 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:55.553750 31065 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.618924 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:55.619104 28578 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:55.617736 28730 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:55.584314 31310 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:55.609411 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:55.631161 31233 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:55.632238 31211 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.632586 31218 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:55.633630 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:55.637554 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:55.558226 31299 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:55.643239 28723 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:55.646888 31267 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.603485 31311 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.648181 31311 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.651290 31311 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:55.657279 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55830.8us
I20260709 13:11:55.659272 31233 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:55.659487 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:55.659721 31233 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.659756 31293 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.660154 31233 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.662642 31275 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:55.665627 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 95476us
I20260709 13:11:55.666900 31301 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:55.667443 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:55.672500 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:55.674521 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:55.678352 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 116468us
I20260709 13:11:55.633955 31105 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.682667 31233 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:11:55.683368 31305 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:11:55.682701 31313 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:11:55.694581 30996 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:55.684162 31302 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:11:55.696126 31233 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.631170 31184 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.636291 31159 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.697410 31159 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.699664 31159 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:55.680085 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:55.693768 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.768513 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:55.769385 28578 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.770613 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:55.692085 31267 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:55.690833 31218 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.682106 31275 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:55.791240 29224 leader_election.cc:336] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.591s (SENT)
I20260709 13:11:55.791409 28578 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:55.792683 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:55.793248 28730 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:55.794078 31205 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:55.794407 28727 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:11:55.794905 31205 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:55.795423 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:55.796046 28727 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:55.796296 31205 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:55.766237 31169 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:55.812403 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:55.801685 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:55.717325 31310 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:55.791952 30970 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.633353 31294 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.832244 31294 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.834930 31289 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:55.835597 31289 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:55.813305 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.837386 28649 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:55.813643 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.838797 28650 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:55.775171 31267 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.839543 31267 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.840059 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:55.841589 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:55.843319 31293 consensus_queue.cc:1175] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "178f22d83287460fb8c0db0ba2799895" responder_term: 5 status { last_received { term: 5 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:55.844549 31310 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:55.845853 31211 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.823539 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:55.847005 31310 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.847165 28656 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:55.847491 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:55.847999 31286 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:55.848304 31078 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.848747 31078 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:55.848948 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 133487us
I20260709 13:11:55.809357 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.791759 31233 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:55.829327 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.799520 31306 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:55.849130 31078 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.789592 31275 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.806866 31311 raft_consensus.cc:2764] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:55.858508 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:55.851619 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:55.841856 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:55.816969 31174 consensus_meta.cc:287] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.817s	user 0.010s	sys 0.000s
W20260709 13:11:55.827526 31274 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.954s	user 0.012s	sys 0.003s
I20260709 13:11:55.855836 28729 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:11:55.859694 28727 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.858016 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:55.864300 28656 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:55.871749 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:11:55.872288 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.872642 28649 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:55.872704 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:55.874502 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.874704 31286 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:55.874913 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:55.875137 31315 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:55.875651 28724 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:55.876176 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2188) took 1128 ms. Trace:
I20260709 13:11:55.876576 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:55.875488 31286 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:55.877354 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:55.878304 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.804049 30996 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:11:55.876489 28724 rpcz_store.cc:276] 0709 13:11:54.747341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.876125 (+128784us) service_pool.cc:224] Handling call
0709 13:11:55.874774 (+998649us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b58001e0098. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:11:55.876122 (+  1348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4030208}
I20260709 13:11:55.858255 31211 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:55.883059 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:55.869841 31309 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:55.836596 31289 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.862318 31275 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:55.900152 28727 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:11:55.862602 31163 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.905716 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:55.914337 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:55.880160 31274 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:55.920989 28721 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:11:55.918658 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 151420us
I20260709 13:11:55.893843 31211 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.922443 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.929800 28649 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
W20260709 13:11:55.930079 29224 leader_election.cc:336] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 2.242s (SENT)
I20260709 13:11:55.930593 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:55.861755 30970 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:55.902045 31226 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:55.896423 31311 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:55.931573 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 55145.8us
W20260709 13:11:55.933794 31312 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:11:55.935050 28724 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:55.910604 31159 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.881454 31233 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.939004 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.953547 28656 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:55.870764 31306 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:55.931140 31211 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:55.959455 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 180715us
I20260709 13:11:55.930658 31165 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:55.869910 31174 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.956840 31065 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.967268 28725 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:55.969964 28647 raft_consensus.cc:2376] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8. Re-sending same reply.
I20260709 13:11:55.963832 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:55.971750 31267 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.956260 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:55.975282 31299 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.975912 31299 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.976269 31299 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.976732 31299 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.981105 28725 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:55.984005 28725 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:55.956921 31062 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:55.985687 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 55647.5us
W20260709 13:11:55.986490 29224 leader_election.cc:336] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 2.250s (SENT)
I20260709 13:11:55.986919 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:55.988118 29224 leader_election.cc:336] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 2.449s (SENT)
I20260709 13:11:55.988574 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:55.990401 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.991364 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:55.992411 28656 raft_consensus.cc:2368] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:55.992498 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.922410 31163 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:55.995178 31163 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.995831 31163 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:55.996695 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:55.997380 28651 raft_consensus.cc:2376] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3. Re-sending same reply.
I20260709 13:11:55.997498 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:55.998294 28656 raft_consensus.cc:2376] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3. Re-sending same reply.
I20260709 13:11:55.998389 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:55.998513 31306 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:55.963321 31311 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:56.000639 31311 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:56.002645 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.003181 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.004621 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.006703 29258 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:11:56.021368 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61281.1us
W20260709 13:11:56.024601 29224 leader_election.cc:336] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 2.563s (SENT)
I20260709 13:11:56.025101 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:56.025272 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.023474 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:56.027367 31322 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:56.028055 31322 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:11:56.030529 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 107155us
I20260709 13:11:56.031615 31329 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:55.962616 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:56.032502 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:56.032739 31329 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:56.034761 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 72227.6us
I20260709 13:11:56.000653 31174 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:56.037510 28725 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:56.043232 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:56.047511 28725 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:56.033432 31226 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:56.054065 28649 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:56.042199 31009 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:56.019953 31169 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:56.038714 31033 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:56.081100 28725 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:56.044513 31208 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:11:56.029052 31322 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.057384 31226 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:56.084957 31169 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.110882 31306 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.111135 31303 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.109869 31211 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.114251 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2304) took 1912 ms. Trace:
W20260709 13:11:56.099858 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.091702 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.137656 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.139935 28725 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:11:56.142315 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 117731us
I20260709 13:11:56.154506 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.162870 28725 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:56.163815 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:56.165326 28725 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:56.089989 31173 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:11:56.141364 31033 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:56.143359 31226 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.171260 29255 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
W20260709 13:11:56.173779 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 126304us
I20260709 13:11:56.143584 31205 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:56.158561 31294 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:56.184640 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:11:56.185331 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.190102 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 51404.1us
I20260709 13:11:56.168428 31174 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.159051 31306 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.195613 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:56.197124 29255 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:56.183907 31258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.451s	user 0.027s	sys 0.017s
I20260709 13:11:56.192728 31267 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:56.200855 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 160562us
I20260709 13:11:56.154094 28573 rpcz_store.cc:276] 0709 13:11:54.205798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.237963 (+ 32165us) service_pool.cc:224] Handling call
0709 13:11:54.238393 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:54.911555 (+673162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.113890 (+1202335us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54000ebfd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:56.114173 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528922368}
I20260709 13:11:56.208781 29253 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:56.210131 31169 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:56.210950 31330 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:11:56.158872 31303 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.200963 31173 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:11:56.203853 28695 connection.cc:256] RPC call timeout handler was delayed by -3.6495751270000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2942s for a response
W20260709 13:11:56.203454 31258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.473s	user 0.028s	sys 0.017s
I20260709 13:11:56.194717 31009 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:11:56.191640 31294 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.202915 30970 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:56.229854 31336 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:11:56.230840 31173 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:56.232187 31078 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:56.264447 28695 connection.cc:256] RPC call timeout handler was delayed by -2.3378855559999465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 13:11:56.234874 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:56.193549 31205 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.196269 31174 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:56.260222 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 72956.2us
I20260709 13:11:56.262543 28649 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:11:56.265486 31310 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:56.233517 31211 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:56.269434 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 82342.7us
W20260709 13:11:56.269711 28695 connection.cc:256] RPC call timeout handler was delayed by -2.3140871439999273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 13:11:56.271271 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:11:56.278781 28695 connection.cc:256] RPC call timeout handler was delayed by -2.1452855559999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:11:56.279412 28695 connection.cc:256] RPC call timeout handler was delayed by -1.8689855559999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2555s for a response
I20260709 13:11:56.280294 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:56.283161 31335 raft_consensus.cc:2764] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:56.282225 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:56.225828 31275 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.293530 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.293494 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:56.297732 29255 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:56.263696 31173 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:56.268673 31311 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.257622 31169 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:11:56.308084 28581 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:56.309144 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:56.310565 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:56.228077 31033 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:56.295147 31335 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:56.313151 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:56.313822 31211 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.315282 31078 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:56.286543 30970 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:11:56.320839 29255 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:56.307475 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:56.323740 29256 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:56.347174 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:56.315356 31273 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:56.333484 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:56.329873 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 44126.2us
I20260709 13:11:56.294906 31310 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:56.329273 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:56.307560 31311 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.364583 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:56.368067 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:56.352990 31258 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:56.370591 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62083.3us
I20260709 13:11:56.333987 31296 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:56.376395 28728 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:56.348106 31275 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:56.379606 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.325489 31221 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:11:56.386327 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:56.390658 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.401036 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:56.402076 29255 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:11:56.404498 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 117681us
I20260709 13:11:56.406497 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:11:56.409935 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:56.412102 29255 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:56.412470 31174 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:56.413389 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.413038 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:56.415273 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:56.416139 29255 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:56.416069 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:56.421716 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 92905.5us
I20260709 13:11:56.389631 31258 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:56.390887 31296 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:56.427675 29255 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:56.429821 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69483.9us
W20260709 13:11:56.415009 31105 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.000s
I20260709 13:11:56.430356 31358 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:56.430935 31105 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:56.432454 28572 raft_consensus.cc:2410] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:56.438318 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.441345 31354 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:56.442005 31354 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:56.442494 31354 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:56.443890 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.450670 28655 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:56.348423 31173 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.421267 31130 raft_consensus.cc:2764] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:56.465525 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.466454 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:56.467239 28653 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:56.469856 28655 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:56.469856 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.465756 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:56.473814 31360 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:56.468761 31347 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:56.437198 31306 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:56.477248 28656 raft_consensus.cc:2410] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:56.474660 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:56.478405 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:11:56.478624 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 75813.2us
I20260709 13:11:56.436714 31299 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:56.479890 31345 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:11:56.481384 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:56.492545 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:56.493116 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.493744 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.494235 31311 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:56.495137 29255 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:56.461901 31303 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:56.495664 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.591116 31211 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.592168 29257 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:56.494249 31174 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.592751 29254 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:56.592880 31173 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:56.593559 28653 raft_consensus.cc:2368] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:11:56.594448 28581 raft_consensus.cc:606] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
W20260709 13:11:56.509210 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 102174us
I20260709 13:11:56.604162 28581 raft_consensus.cc:614] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:56.606310 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:56.595773 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 165085us
I20260709 13:11:56.544200 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:56.599411 28654 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:56.612690 28648 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:56.619840 28656 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:56.606909 28651 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:11:56.620851 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:56.542992 31310 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:56.620370 28656 pending_rounds.cc:85] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 5
I20260709 13:11:56.630373 28656 pending_rounds.cc:107] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:11:56.630688 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 138227us
I20260709 13:11:56.630800 28656 raft_consensus.cc:2889] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:56.631469 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:56.624749 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 80663.9us
I20260709 13:11:56.629176 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:56.600900 31303 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.634016 29255 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:56.634802 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:56.637480 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:56.641750 29257 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:56.642074 28655 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:56.645587 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.542387 31338 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:11:56.654796 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:56.633687 30996 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.658949 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.613245 31336 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:11:56.665194 28655 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:56.670300 31299 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:56.666375 30996 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:56.674424 30996 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.676786 28651 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:56.678678 28653 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:56.644358 31211 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:56.614877 31174 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.646296 31274 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.633849 31033 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:11:56.632282 31350 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:11:56.681613 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 60866.9us
I20260709 13:11:56.694952 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:56.646127 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:56.633216 31311 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:11:56.700870 29255 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:56.647185 31303 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.597427 31360 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:56.710242 31303 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:56.710515 31174 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:56.695307 31274 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:56.711220 31274 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.712044 31303 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:56.712555 31303 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:56.688674 31233 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:56.713824 31311 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:56.714694 31303 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:56.716429 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:11:56.717847 31226 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 13:11:56.714831 31311 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:56.718333 31226 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.719548 31311 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.620380 31258 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:56.737488 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.680099 31362 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:56.759922 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:56.628293 31296 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:56.721148 31311 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:56.761132 31303 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:56.772642 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:56.773525 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 143421us
I20260709 13:11:56.776626 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:56.732365 31273 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:56.761982 31335 raft_consensus.cc:2764] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:56.781031 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:56.714998 31354 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:56.774230 31310 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:56.775578 31299 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:56.792511 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 164003us
I20260709 13:11:56.763667 31233 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:11:56.804829 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:56.794854 31078 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:56.816344 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:56.818531 28574 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:11:56.818950 28574 pending_rounds.cc:85] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 5
I20260709 13:11:56.819176 28574 pending_rounds.cc:107] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:11:56.819387 28574 raft_consensus.cc:2889] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:56.821295 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.826992 31353 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:56.827667 31353 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:56.829362 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:56.829924 31349 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:56.830054 28573 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:56.832610 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 193610us
I20260709 13:11:56.812482 31358 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.803515 31169 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:56.810699 31026 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.792742 31362 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:56.834090 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:56.817610 31233 consensus_queue.cc:1243] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:56.803045 31226 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:56.830674 31349 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:56.869787 28581 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:56.849217 28620 leader_election.cc:336] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.945s (SENT)
I20260709 13:11:56.811921 31299 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:11:56.880429 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.881685 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.836318 31169 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:56.910768 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:11:56.914427 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 131777us
I20260709 13:11:56.845896 31338 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:11:56.909178 31169 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.908129 31335 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:56.928385 28575 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:56.835505 30970 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:11:56.930858 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.840211 31358 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.838287 31130 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:11:56.935391 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:56.943097 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 93927.5us
W20260709 13:11:56.944191 28620 leader_election.cc:336] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.961s (SENT)
I20260709 13:11:56.946887 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:11:56.954414 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 120359us
I20260709 13:11:56.956890 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:56.954763 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.930161 31211 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:56.959187 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:56.966374 28620 leader_election.cc:336] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.778s (SENT)
I20260709 13:11:56.968923 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.934722 31303 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:56.978384 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:56.979480 28654 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:56.980733 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:56.983812 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.978561 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.985862 28655 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:56.987262 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:56.988727 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.956976 30970 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:56.977170 31322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.016s	sys 0.009s
I20260709 13:11:56.966114 31233 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:56.995682 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.995635 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:56.967207 31130 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.998838 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:57.000049 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.000267 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:57.001876 28654 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:57.003918 28724 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:57.004685 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:56.992373 31023 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:11:57.002187 28655 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:57.010900 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:56.991072 31367 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.011557 28651 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:57.014624 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:56.996464 31366 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.999768 31233 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.974301 31211 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:56.997130 31354 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:57.016299 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.019058 31358 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.034556 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:57.034974 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1686) took 2523 ms. Trace:
I20260709 13:11:57.022161 28573 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:57.022009 31274 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.024326 31169 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.016778 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:57.029906 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:11:57.031826 28620 leader_election.cc:336] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.161s (SENT)
I20260709 13:11:57.056061 28655 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.056553 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:57.019861 31370 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:57.058823 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:57.038759 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:57.038988 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:57.040091 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.045531 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2318) took 2697 ms. Trace:
I20260709 13:11:57.035399 28652 rpcz_store.cc:276] 0709 13:11:54.511126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.513394 (+  2268us) service_pool.cc:224] Handling call
0709 13:11:54.513730 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.582644 (+1068914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.034748 (+1452104us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540027ef54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:57.034922 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2456240000}
I20260709 13:11:57.033684 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:57.047675 31375 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:57.048216 31338 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:57.049340 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:57.046224 31303 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.052383 31294 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.028887 31233 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:57.321868 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 288246us
I20260709 13:11:57.322855 31026 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:57.187197 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:57.158773 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.243924 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:57.186228 31274 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:57.048851 31332 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.846s	user 0.000s	sys 0.003s
I20260709 13:11:57.069355 28577 rpcz_store.cc:276] 0709 13:11:54.336928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.345772 (+  8844us) service_pool.cc:224] Handling call
0709 13:11:54.346101 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.603606 (+1257505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.034408 (+1430802us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54003fe154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:57.034615 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2869308800}
I20260709 13:11:57.055898 28654 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:57.171694 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:57.333539 28652 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:57.026371 31322 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:11:57.169835 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:57.186393 31169 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.298177 31211 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:57.141247 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:57.339466 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 856) took 1322 ms. Trace:
I20260709 13:11:57.339502 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:57.142567 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 110763us
I20260709 13:11:57.131002 28724 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
W20260709 13:11:57.038851 31373 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:11:57.349255 31353 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.350054 28575 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:57.350318 31353 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:57.176823 31380 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:11:57.351521 28620 leader_election.cc:336] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.969s (SENT)
I20260709 13:11:57.351965 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:57.353844 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:57.161108 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.354787 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 855) took 1350 ms. Trace:
I20260709 13:11:57.354897 28728 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
W20260709 13:11:57.355228 28620 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.166s (SENT)
I20260709 13:11:57.355172 29260 rpcz_store.cc:276] 0709 13:11:56.004403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.007547 (+  3144us) service_pool.cc:224] Handling call
0709 13:11:57.353685 (+1346138us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:11:57.354726 (+  1041us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26140032}
I20260709 13:11:57.355801 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:57.356680 31362 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:57.358491 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:57.028344 31366 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.029577 31367 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.133320 31365 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:57.181137 31384 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:57.370357 31384 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:57.187122 30996 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 13:11:57.312677 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.371990 28730 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:57.303531 31387 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:11:57.316541 28655 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:57.375283 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:57.375981 28655 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:57.376822 30996 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:57.377375 29251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1195) took 2414 ms (client timeout 2061 ms). Trace:
W20260709 13:11:57.377785 29251 rpcz_store.cc:269] 0709 13:11:54.962760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.081538 (+118778us) service_pool.cc:224] Handling call
0709 13:11:57.377165 (+2295627us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b540003edd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:57.377277 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145502464}
I20260709 13:11:57.378950 30996 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:57.337769 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 326980us
I20260709 13:11:57.379262 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:57.340879 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.341900 31358 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:11:57.382426 31358 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:57.382826 31358 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:57.382750 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:57.383163 28726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2182) took 2638 ms (client timeout 2166 ms). Trace:
I20260709 13:11:57.383525 28724 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
W20260709 13:11:57.383839 28726 rpcz_store.cc:269] 0709 13:11:54.744997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.745677 (+   680us) service_pool.cc:224] Handling call
0709 13:11:57.382867 (+2637190us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002346d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:57.383039 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3540324736}
I20260709 13:11:57.383910 31358 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.337056 31258 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.385341 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.385929 31258 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.386667 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.386868 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.387683 28722 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:57.346179 31233 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.347167 28652 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
W20260709 13:11:57.347491 28649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2188) took 1237 ms (client timeout 1613 ms). Trace:
I20260709 13:11:57.388660 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.348503 31165 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:57.340091 29258 rpcz_store.cc:276] 0709 13:11:56.010125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.010280 (+   155us) service_pool.cc:224] Handling call
0709 13:11:57.049186 (+1038906us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:11:57.332623 (+283437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23049088}
I20260709 13:11:57.316265 31033 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.138835 28578 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:57.354267 31375 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:57.395987 31358 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.417431 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.395779 28725 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:57.418319 28730 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:57.418350 28725 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:57.355955 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.407631 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 919) took 1179 ms. Trace:
I20260709 13:11:57.421708 28728 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:11:57.397145 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.422689 28726 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:11:57.423532 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:57.419646 28730 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:57.360092 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.366459 31294 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.367136 31296 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:57.367470 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.367542 31169 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.367970 31362 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.367897 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:57.368661 31299 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.384619 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.342375 31381 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.454342 31169 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.461385 31381 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.463117 31169 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.463538 31381 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.400096 31366 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.466310 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:57.459267 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:57.337570 31026 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:11:57.389283 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:57.331491 31190 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:57.472673 28577 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:57.392838 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.473856 28722 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:11:57.394219 31258 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:57.388906 28649 rpcz_store.cc:269] 0709 13:11:56.110038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.138546 (+ 28508us) service_pool.cc:224] Handling call
0709 13:11:57.347321 (+1208775us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540006e0d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:57.347433 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238264064}
I20260709 13:11:57.476900 28649 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:57.477375 28649 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:57.395185 31233 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.427166 28730 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:57.421936 29254 rpcz_store.cc:276] 0709 13:11:56.228466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.230057 (+  1591us) service_pool.cc:224] Handling call
0709 13:11:56.592549 (+362492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.602584 (+ 10035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.407412 (+804828us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540002ba50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:57.407563 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743105408}
W20260709 13:11:57.414191 28572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2325) took 1814 ms (client timeout 1849 ms). Trace:
I20260709 13:11:57.482509 28648 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:57.419611 28725 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.442129 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:11:57.446344 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 96904.5us
I20260709 13:11:57.484192 28695 leader_election.cc:400] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:57.484597 28695 leader_election.cc:403] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:11:57.436612 28621 leader_election.cc:336] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.849s (SENT)
I20260709 13:11:57.446401 31356 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:11:57.500378 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 63777.8us
I20260709 13:11:57.454195 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:57.507416 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.508329 28722 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:57.457702 28728 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:57.428403 31338 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:57.459264 28654 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:57.401437 31130 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:57.460290 28580 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:57.430830 31033 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.396380 31360 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:57.382427 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.515256 28729 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:57.465451 28726 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:57.468086 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:57.517716 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49678.3us
I20260709 13:11:57.518821 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:57.518954 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.519594 28724 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:57.520444 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:57.521108 28580 raft_consensus.cc:606] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:11:57.524158 31385 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.359s	user 0.001s	sys 0.011s
I20260709 13:11:57.525490 31366 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:57.525956 31220 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.472589 28652 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:57.527586 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:11:57.454914 31163 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:57.482475 28572 rpcz_store.cc:269] 0709 13:11:55.599614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.606538 (+  6924us) service_pool.cc:224] Handling call
0709 13:11:57.413908 (+1807370us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54001aac54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:57.414115 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825182080}
I20260709 13:11:57.430166 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:57.449291 28723 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:57.464779 29253 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.478590 28649 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:57.478353 31221 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.548269 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:57.548327 28649 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.537937 31367 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.549950 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:57.550554 29254 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.550668 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:57.551951 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.552628 28726 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
W20260709 13:11:57.537458 31311 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.763s	user 0.013s	sys 0.000s
I20260709 13:11:57.533883 28728 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:57.554576 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.558009 28649 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:57.477041 31384 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:57.516465 31356 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.467108 31299 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:57.561457 31356 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.457719 31362 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.562188 31299 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:57.563174 28722 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:57.563294 31362 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.564076 31369 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:57.564530 31369 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:57.565729 29253 raft_consensus.cc:2410] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:57.534655 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:57.566752 28723 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:57.566637 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:57.570086 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:57.570075 28572 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.572333 28580 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:57.572415 28722 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:57.516830 28730 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:57.574172 28730 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:57.546453 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 104416us
I20260709 13:11:57.577276 31258 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:11:57.578722 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:57.546886 31211 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:57.565549 31369 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.547358 31163 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.579744 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:11:57.580065 31163 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.580333 28580 raft_consensus.cc:606] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:11:57.533659 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:11:57.558495 28726 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:11:57.534343 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:57.545766 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61713.7us
I20260709 13:11:57.582707 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:57.566200 31062 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.573328 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:57.580185 31369 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:57.593868 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 60295us
I20260709 13:11:57.454741 31165 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.581845 28729 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.595093 31389 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.533627 31130 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:57.559135 28728 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:57.587774 28726 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:57.603798 31130 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:57.604985 29252 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:57.605221 31165 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.615140 28730 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:57.615556 28730 pending_rounds.cc:85] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 3
I20260709 13:11:57.615777 28730 pending_rounds.cc:107] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:11:57.616022 28730 raft_consensus.cc:2889] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:57.617072 31078 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:57.584800 31274 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.618721 31274 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.620050 31165 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.626667 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:57.627635 29255 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:11:57.587854 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:57.588277 31163 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:57.661653 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 857) took 1622 ms. Trace:
I20260709 13:11:57.662324 29252 rpcz_store.cc:276] 0709 13:11:56.039028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.039164 (+   136us) service_pool.cc:224] Handling call
0709 13:11:57.604787 (+1565623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.605534 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.661329 (+ 55795us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54005b2a50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:57.661561 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3374360960}
I20260709 13:11:57.579672 31211 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:57.530707 28724 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:11:57.624748 28729 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:11:57.597761 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:57.598994 31065 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.599607 31205 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:57.603801 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1200) took 1749 ms. Trace:
I20260709 13:11:57.601083 31384 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:57.596376 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 66775.3us
I20260709 13:11:58.146407 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 873) took 1305 ms. Trace:
W20260709 13:11:57.805864 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.596822 29252 rpcz_store.cc:276] 0709 13:11:56.841396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.845225 (+1003829us) service_pool.cc:224] Handling call
0709 13:11:58.145805 (+300580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.145981 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.146015 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.146070 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.146110 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.146182 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.146334 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.641782 29254 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
W20260709 13:11:58.528599 31369 consensus_meta.cc:287] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.919s	user 0.013s	sys 0.000s
I20260709 13:11:58.598621 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:58.598912 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 879) took 1084 ms. Trace:
I20260709 13:11:58.599440 31384 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.599628 29254 rpcz_store.cc:276] 0709 13:11:57.515003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.549646 (+ 34643us) service_pool.cc:224] Handling call
0709 13:11:58.598829 (+1049183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.600148 31384 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.601934 29254 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
W20260709 13:11:57.668721 31335 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:11:58.603420 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 804) took 1085 ms. Trace:
I20260709 13:11:57.595242 28723 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:57.820392 29253 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:11:58.604605 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:58.539760 28727 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.010s	sys 0.014s
I20260709 13:11:58.531400 31306 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:58.090204 31165 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.606299 31065 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:57.670235 28647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 621) took 1869 ms (client timeout 1580 ms). Trace:
I20260709 13:11:58.610594 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:58.612108 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 805) took 1079 ms. Trace:
I20260709 13:11:57.807842 29257 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:11:58.654184 28647 rpcz_store.cc:269] 0709 13:11:55.800677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.800885 (+   208us) service_pool.cc:224] Handling call
0709 13:11:57.670011 (+1869126us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540023da54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:57.670166 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274455296}
I20260709 13:11:57.670514 28650 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:58.654232 28727 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.010s	sys 0.019s
W20260709 13:11:58.618868 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.03618e+06us
I20260709 13:11:57.854911 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 866) took 1261 ms. Trace:
I20260709 13:11:58.654788 28724 rpcz_store.cc:276] 0709 13:11:57.518512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.518661 (+   149us) service_pool.cc:224] Handling call
0709 13:11:58.597866 (+1079205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.616973 29256 rpcz_store.cc:276] 0709 13:11:55.854738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.854902 (+   164us) service_pool.cc:224] Handling call
0709 13:11:57.603595 (+1748693us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54005b2a54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:57.603740 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976116480}
I20260709 13:11:57.620864 31274 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:58.619494 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:11:58.633574 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 940) took 1259 ms. Trace:
W20260709 13:11:58.264726 28654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.009s	sys 0.009s
W20260709 13:11:58.659852 28654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.009s	sys 0.016s
I20260709 13:11:58.638773 28729 rpcz_store.cc:276] 0709 13:11:57.518151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.534051 (+ 15900us) service_pool.cc:224] Handling call
0709 13:11:58.603306 (+1069255us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:58.105705 28649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.012s	sys 0.005s
W20260709 13:11:58.660879 28649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.012s	sys 0.016s
W20260709 13:11:58.661180 28620 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.007s	sys 0.032s
I20260709 13:11:58.655742 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 871) took 1815 ms. Trace:
W20260709 13:11:58.661636 28620 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.007s	sys 0.033s
W20260709 13:11:58.662125 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 996426us
W20260709 13:11:58.662964 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.663080 29254 rpcz_store.cc:276] 0709 13:11:57.374110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.601071 (+1226961us) service_pool.cc:224] Handling call
0709 13:11:58.601563 (+   492us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:58.633148 (+ 31585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.633496 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.656224 31306 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.660125 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 941) took 1285 ms. Trace:
I20260709 13:11:58.669605 29252 raft_consensus.cc:1217] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 13:11:58.670361 29252 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:58.661865 29257 rpcz_store.cc:276] 0709 13:11:56.839979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.671329 (+831350us) service_pool.cc:224] Handling call
0709 13:11:57.807487 (+136158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.655468 (+847981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.655685 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.670244 29256 rpcz_store.cc:276] 0709 13:11:57.374391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.658948 (+1284557us) service_pool.cc:224] Handling call
0709 13:11:58.659408 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.659655 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.659693 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.659761 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.659815 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.659901 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.660051 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.656440 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:57.845196 31387 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.671352 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 938) took 1297 ms. Trace:
I20260709 13:11:58.674522 29252 rpcz_store.cc:276] 0709 13:11:57.373540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.613131 (+1239591us) service_pool.cc:224] Handling call
0709 13:11:58.650749 (+ 37618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.671004 (+ 20255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.671277 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.677050 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2351) took 1104 ms. Trace:
I20260709 13:11:58.677623 28578 rpcz_store.cc:276] 0709 13:11:57.572163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.584584 (+ 12421us) service_pool.cc:224] Handling call
0709 13:11:58.676937 (+1092353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.799860 31258 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:58.446939 31366 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.003s	sys 0.015s
I20260709 13:11:57.654002 31033 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:58.689329 29254 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:58.687997 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1204) took 1267 ms. Trace:
I20260709 13:11:58.697582 29257 rpcz_store.cc:276] 0709 13:11:57.421073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.672520 (+1251447us) service_pool.cc:224] Handling call
0709 13:11:58.687254 (+ 14734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.687517 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.687554 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.687609 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.687660 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.687731 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.687917 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.687711 31163 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.692618 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:58.700832 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 942) took 1292 ms. Trace:
I20260709 13:11:58.633811 31130 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.706323 29254 rpcz_store.cc:276] 0709 13:11:57.408651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.663950 (+1255299us) service_pool.cc:224] Handling call
0709 13:11:58.689099 (+ 25149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.697138 (+  8039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.700752 (+  3614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.679682 31274 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:58.715420 29257 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:58.673450 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 875) took 1219 ms. Trace:
I20260709 13:11:58.695858 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1205) took 1274 ms. Trace:
W20260709 13:11:58.723558 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 67268.5us
W20260709 13:11:58.711418 28656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.005s	sys 0.035s
W20260709 13:11:58.692171 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 87641.9us
I20260709 13:11:58.682718 31205 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:58.696581 31366 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.013s	sys 0.015s
W20260709 13:11:58.718143 29258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.013s	sys 0.028s
W20260709 13:11:58.741569 29258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.014s	sys 0.028s
I20260709 13:11:58.719515 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 876) took 1261 ms. Trace:
I20260709 13:11:58.673161 31165 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.731400 29254 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:58.733337 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:58.721482 29256 rpcz_store.cc:276] 0709 13:11:57.421413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.672802 (+1251389us) service_pool.cc:224] Handling call
0709 13:11:58.695159 (+ 22357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.695401 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.695442 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.695502 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.695550 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.695620 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.695781 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:58.736634 28656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.006s	sys 0.035s
I20260709 13:11:58.747799 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 642) took 1716 ms. Trace:
I20260709 13:11:58.738265 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:58.742733 29257 rpcz_store.cc:276] 0709 13:11:57.458089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.698905 (+1240816us) service_pool.cc:224] Handling call
0709 13:11:58.710327 (+ 11422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.719097 (+  8770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.719422 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.691454 31258 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:58.689399 31387 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:58.722201 31322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.021s	sys 0.026s
I20260709 13:11:58.748456 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 877) took 1280 ms. Trace:
I20260709 13:11:58.741250 31396 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.760883 29254 rpcz_store.cc:276] 0709 13:11:57.467658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.710630 (+1242972us) service_pool.cc:224] Handling call
0709 13:11:58.731026 (+ 20396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.746164 (+ 15138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.748388 (+  2224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.746434 31338 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:58.722957 31274 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.720309 29253 rpcz_store.cc:276] 0709 13:11:57.454577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.587559 (+132982us) service_pool.cc:224] Handling call
0709 13:11:58.663375 (+1075816us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:58.745126 31009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.005s	sys 0.015s
I20260709 13:11:58.795965 31398 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:58.745443 31205 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:58.709403 31163 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.741752 31335 raft_consensus.cc:2764] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:11:58.777657 31322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.021s	sys 0.026s
I20260709 13:11:58.766260 31211 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:58.764635 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:58.795071 29256 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:58.782232 31338 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.773947 31387 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:58.720964 31130 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:58.797847 31009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.005s	sys 0.015s
I20260709 13:11:58.812881 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 878) took 1301 ms. Trace:
I20260709 13:11:58.796664 31398 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:58.816478 29256 rpcz_store.cc:276] 0709 13:11:57.511766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.748260 (+1236494us) service_pool.cc:224] Handling call
0709 13:11:58.775398 (+ 27138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.810435 (+ 35037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.812798 (+  2363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.783001 31396 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.822713 28578 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:58.813916 31338 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:58.815594 31211 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.835346 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:58.817622 31365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.002s	sys 0.036s
I20260709 13:11:58.824065 31369 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:11:58.831027 31335 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:58.848637 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.829773 31387 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.829110 31306 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:58.841236 31365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.002s	sys 0.036s
I20260709 13:11:58.841665 31258 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:58.874603 31387 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:58.881557 31387 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:58.881742 31397 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:58.875415 31293 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:58.849946 31369 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.877483 31306 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.886533 31403 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:11:58.900228 31354 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:58.900264 28652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.273s	user 0.001s	sys 0.003s
W20260709 13:11:58.900899 28652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.001s	sys 0.003s
I20260709 13:11:58.900785 31354 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:11:58.901878 31354 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.902777 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:58.903972 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 867) took 2310 ms. Trace:
I20260709 13:11:58.904254 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:58.904417 29258 rpcz_store.cc:276] 0709 13:11:56.593656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.420110 (+826454us) service_pool.cc:224] Handling call
0709 13:11:57.420393 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.455473 (+ 35080us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:57.703102 (+247629us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.742057 (+1038955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.742127 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.742192 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.903750 (+161558us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b54001559d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:58.903802 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.903917 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49608,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":43,"raft.queue_time_us":74788,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2620,"spinlock_wait_cycles":79863680,"thread_start_us":1276543,"threads_started":2,"wal-append.queue_time_us":1124026}
I20260709 13:11:58.907497 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:58.908314 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 645) took 1315 ms. Trace:
I20260709 13:11:58.907543 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:58.908686 28651 rpcz_store.cc:276] 0709 13:11:57.592986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.907226 (+1314240us) service_pool.cc:224] Handling call
0709 13:11:58.908256 (+  1030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.909515 28577 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:58.909415 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:58.909830 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:58.910475 28651 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:58.910511 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:58.920765 31275 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:58.926452 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 810) took 1398 ms. Trace:
I20260709 13:11:58.910606 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:58.922246 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 184056us
I20260709 13:11:58.927158 28723 rpcz_store.cc:276] 0709 13:11:57.520772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.567486 (+ 46714us) service_pool.cc:224] Handling call
0709 13:11:57.567742 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.666330 (+1098588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.919280 (+252950us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b54001851d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:58.919596 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61641472}
I20260709 13:11:58.928436 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:58.927630 28580 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:58.891630 31369 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:58.895040 31409 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:58.911048 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 647) took 1289 ms. Trace:
W20260709 13:11:58.922344 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 326418us
I20260709 13:11:58.933867 28651 rpcz_store.cc:276] 0709 13:11:57.621594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.909583 (+1287989us) service_pool.cc:224] Handling call
0709 13:11:58.910999 (+  1416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.919441 31165 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:58.930122 29223 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:58.888967 31293 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.933487 31275 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.954209 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:58.954310 31033 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:58.955672 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:58.955421 31033 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:58.956740 28577 raft_consensus.cc:2410] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:58.933727 31274 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:58.899646 31306 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.939512 31352 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:58.937546 31381 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.946206 31402 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:11:58.970832 28620 leader_election.cc:336] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 3.071s (SENT)
I20260709 13:11:58.976778 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:58.978925 31275 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:58.980849 31406 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:58.931978 31211 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:11:58.949306 31258 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.963887 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:58.983873 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1720) took 1621 ms. Trace:
I20260709 13:11:58.986244 28651 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:58.986934 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2203) took 1621 ms. Trace:
I20260709 13:11:58.985651 28649 rpcz_store.cc:276] 0709 13:11:57.362163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.565839 (+203676us) service_pool.cc:224] Handling call
0709 13:11:57.566161 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.568738 (+  2577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.568767 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.569230 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:11:58.661372 (+1092142us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:58.661559 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.661640 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:58.983569 (+321929us) raft_consensus.cc:1685] finished
0709 13:11:58.983601 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.983782 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1863,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":1091722,"threads_started":1,"wal-append.queue_time_us":1191971}
W20260709 13:11:58.984877 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 220423us
I20260709 13:11:58.987329 28651 rpcz_store.cc:276] 0709 13:11:57.365996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.965895 (+1599899us) service_pool.cc:224] Handling call
0709 13:11:58.985859 (+ 19964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.986672 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.986880 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:58.892062 31398 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:58.946010 31366 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:11:59.010821 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 112578us
W20260709 13:11:59.006379 29223 connection.cc:256] RPC call timeout handler was delayed by -1.2921557409999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 13:11:58.951488 31421 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:58.968041 31009 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.967406 31163 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:11:59.016710 28620 leader_election.cc:336] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 3.123s (SENT)
I20260709 13:11:59.014138 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:58.949123 31416 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:11:59.020046 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1721) took 1657 ms. Trace:
I20260709 13:11:59.024147 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:58.972488 31415 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.972867 31352 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:59.027361 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1719) took 1665 ms. Trace:
I20260709 13:11:59.030586 31421 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:59.031414 31418 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:59.048379 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.049162 28578 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:59.027145 28653 rpcz_store.cc:276] 0709 13:11:57.362477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.916944 (+1554467us) service_pool.cc:224] Handling call
0709 13:11:58.917345 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.917632 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:58.928616 (+ 10984us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.019539 (+ 90923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:59.019598 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:59.019680 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.019781 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.019968 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11616,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":1291,"thread_start_us":90345,"threads_started":1}
I20260709 13:11:58.975488 31165 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:58.984532 31130 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.021565 31420 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:59.002156 31413 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.040230 28652 rpcz_store.cc:276] 0709 13:11:57.361874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.528567 (+166693us) service_pool.cc:224] Handling call
0709 13:11:57.528919 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.585459 (+ 56540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.585509 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.595905 (+ 10396us) log.cc:844] Serialized 26 byte log entry
0709 13:11:58.901360 (+1305455us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:58.901402 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.905484 (+  4082us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b5400259254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:58.905534 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.026959 (+121425us) raft_consensus.cc:1685] finished
0709 13:11:59.026989 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.027278 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8350,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":21799,"spinlock_wait_cycles":128823040,"thread_start_us":1274370,"threads_started":1,"wal-append.queue_time_us":1294153}
I20260709 13:11:59.044255 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1722) took 1667 ms. Trace:
I20260709 13:11:59.043982 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:59.037348 31415 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.002781 31258 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:58.990386 31381 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.039740 31411 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.054963 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:59.026522 31009 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:59.047180 31407 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.173s	user 0.001s	sys 0.001s
W20260709 13:11:59.032946 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.054422 31420 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.025264 31275 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:59.079312 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:59.061342 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1725) took 1516 ms. Trace:
I20260709 13:11:59.080665 28653 rpcz_store.cc:276] 0709 13:11:57.545483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.050087 (+1504604us) service_pool.cc:224] Handling call
0709 13:11:59.060626 (+ 10539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.060879 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.060919 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:59.060973 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:59.061052 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.061124 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.061268 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:59.046492 31205 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:59.068996 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1726) took 1523 ms. Trace:
I20260709 13:11:59.055958 31184 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.057343 28649 rpcz_store.cc:276] 0709 13:11:57.376922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.018976 (+1642054us) service_pool.cc:224] Handling call
0709 13:11:59.043904 (+ 24928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.044037 (+   133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.044053 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:59.044081 (+    28us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:59.044101 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.044134 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.044210 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:59.072399 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.068930 31408 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.192s	user 0.000s	sys 0.002s
I20260709 13:11:59.058480 31418 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:59.060916 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:59.069463 31163 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:59.065313 31415 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.068619 31274 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:59.096369 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.089591 28652 rpcz_store.cc:276] 0709 13:11:57.545849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.057034 (+1511185us) service_pool.cc:224] Handling call
0709 13:11:59.068307 (+ 11273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.068544 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.068583 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:59.068640 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:59.068693 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.068763 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.068923 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:59.108807 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47952.3us
I20260709 13:11:59.126641 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:59.055672 31165 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:59.076284 31420 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:59.089535 31130 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:59.148898 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69679.1us
I20260709 13:11:59.150496 28695 leader_election.cc:400] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:11:59.151407 28695 leader_election.cc:403] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:59.152813 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:59.115569 31211 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:59.155452 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:11:59.156519 28649 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:59.157760 28652 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:11:59.088903 31423 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:11:59.161128 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:59.072486 31411 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.136511 31437 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.091833 31275 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.107537 31184 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:59.148705 31165 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:59.180655 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:59.123304 31163 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:59.181725 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 127842us
I20260709 13:11:59.160841 31033 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:59.072182 31352 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.189849 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:59.194800 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:59.196504 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:59.189033 31274 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:11:59.191077 31425 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:59.184880 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:59.185067 31211 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:11:59.221138 31440 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:59.177527 31293 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.182539 31009 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:11:59.247145 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 86932.7us
I20260709 13:11:59.184293 31306 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.236001 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.201206 31437 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.268335 31441 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:59.271498 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 72685.7us
I20260709 13:11:59.145721 31421 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.221542 31436 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:59.281862 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:59.234251 31352 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.271169 31441 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:11:59.286808 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.287858 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.235885 31438 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.290292 31163 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:59.291419 31275 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:59.271706 31130 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:11:59.293497 31384 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.692s	user 0.014s	sys 0.000s
W20260709 13:11:59.296061 31430 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:11:59.296443 31441 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.308934 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.308950 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.345732 31163 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:59.351851 31349 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:59.358726 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 197685us
W20260709 13:11:59.360740 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45611.1us
I20260709 13:11:59.309181 31440 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:59.364928 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1723) took 1987 ms. Trace:
I20260709 13:11:59.344707 31258 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:59.371682 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:11:59.374423 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 189601us
I20260709 13:11:59.370303 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.377772 28729 raft_consensus.cc:2376] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4. Re-sending same reply.
I20260709 13:11:59.377853 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:59.192356 31418 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.296912 31387 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.381110 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.377605 28579 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:11:59.382622 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.383041 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.386930 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.389407 28729 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:59.309876 31437 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:11:59.384007 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:59.369519 31436 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:59.392339 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.376421 31349 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.373943 31440 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.394718 28578 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:59.377887 31130 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:59.364123 31435 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:59.399108 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.396762 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.379379 31165 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:11:59.399639 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:11:59.399740 28574 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:11:59.402318 28724 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:59.405356 28724 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:59.412259 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.394589 31436 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.413283 31436 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.399036 31130 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:59.418448 31411 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.378207 31438 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:11:59.418941 31130 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:59.425151 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.427978 31424 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:59.316017 31274 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.430238 31415 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.417568 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.361781 31384 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.369313 31163 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.461537 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.463511 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.399513 31258 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:59.401644 31435 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.398607 31440 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:59.433473 31448 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:59.471067 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 76957.1us
I20260709 13:11:59.486692 29260 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:59.487358 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.495456 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:59.424582 31420 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:59.514895 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 103637us
I20260709 13:11:59.546568 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:59.556757 29257 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:59.546787 31415 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:59.563128 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:59.506311 31184 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:59.487630 31435 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:59.470618 31130 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.547307 29258 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
W20260709 13:11:59.615900 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 66706.3us
I20260709 13:11:59.489133 31448 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:59.621747 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.623227 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:59.459689 31424 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.156s
I20260709 13:11:59.627278 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.628528 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.629443 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.626277 29257 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:11:59.373986 28651 rpcz_store.cc:276] 0709 13:11:57.377729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.048205 (+1670476us) service_pool.cc:224] Handling call
0709 13:11:59.048608 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.048895 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:59.059485 (+ 10590us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.364420 (+304935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:59.364494 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:59.364575 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.364673 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.364838 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11051,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":133,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6804,"thread_start_us":304440,"threads_started":1}
W20260709 13:11:59.633021 31364 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 2.851s	user 0.031s	sys 0.083s
I20260709 13:11:59.637128 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:11:59.635849 31439 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.273s	user 0.008s	sys 0.000s
I20260709 13:11:59.638643 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:59.639480 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1727) took 2093 ms. Trace:
I20260709 13:11:59.639943 28653 rpcz_store.cc:276] 0709 13:11:57.546135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.081945 (+1535810us) service_pool.cc:224] Handling call
0709 13:11:59.082395 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:59.095385 (+ 12990us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:59.095417 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.095870 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.180782 (+ 84912us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:59.180821 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.180893 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.639262 (+458369us) raft_consensus.cc:1685] finished
0709 13:11:59.639283 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.639415 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1174,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8618,"thread_start_us":68745,"threads_started":1,"wal-append.queue_time_us":158098}
I20260709 13:11:59.642110 28653 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:59.643918 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.575937 31447 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:11:59.644172 31163 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:59.650564 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.644810 28723 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
W20260709 13:11:59.625332 31453 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.057s	user 0.000s	sys 0.006s
I20260709 13:11:59.658777 31447 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:59.659220 31447 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:59.660030 31447 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.662038 31448 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.664299 28725 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:59.664649 28647 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:59.665632 31365 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.666261 31365 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.671662 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:59.672618 31322 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:59.673060 31322 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:59.673300 31447 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:59.674022 31338 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.837s	user 0.010s	sys 0.001s
I20260709 13:11:59.673938 31322 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:11:59.675702 31130 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:59.676211 31130 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.676620 31130 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:59.678467 28721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 799) took 3357 ms (client timeout 1868 ms). Trace:
W20260709 13:11:59.678910 28721 rpcz_store.cc:269] 0709 13:11:56.321227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.372926 (+ 51699us) service_pool.cc:224] Handling call
0709 13:11:57.572467 (+1199541us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54001b10a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8ddc0 00007f4a27e19e18 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6
0709 13:11:59.678238 (+2105771us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b5400127fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:59.678395 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065690752}
I20260709 13:11:59.679731 31384 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:59.680236 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.684978 31130 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.685652 28725 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:59.623416 31452 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:59.688901 31156 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:59.689791 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1563) took 3829 ms. Trace:
I20260709 13:11:59.690373 31335 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.690527 31130 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.690377 28725 rpcz_store.cc:276] 0709 13:11:55.861276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.171372 (+310096us) service_pool.cc:224] Handling call
0709 13:11:56.171642 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.395666 (+1224024us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b5400424620. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8ddc0 00007f4a27e181c0 00007f4a27e19231 00007f4a27e15d8f 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c
0709 13:11:59.663671 (+2268005us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5800217dd0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d720aa 00007f4a27df4447 00007f4a27e0cfe7 00007f4a27e0e7de 00007f4a27e18b49 00007f4a27e19416 00007f4a27e15d8f 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4
0709 13:11:59.686979 (+ 23308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.689731 (+  2752us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3487826048}
W20260709 13:11:59.692032 31454 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:11:59.692972 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.693121 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.693862 31396 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.694125 28725 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:59.695487 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.657495 31258 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:59.698760 31258 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:11:59.697878 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.699206 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.699838 31258 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.675132 31322 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.703871 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:11:59.678301 31457 consensus_queue.cc:1175] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d64d870625d6461b89b1fb75cd2e26e0" responder_term: 3 status { last_received { term: 3 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 3 index: 6 } }
I20260709 13:11:59.702302 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1718) took 2340 ms. Trace:
I20260709 13:11:59.702400 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2344) took 2390 ms. Trace:
I20260709 13:11:59.706254 28581 rpcz_store.cc:276] 0709 13:11:57.312416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.312920 (+   504us) service_pool.cc:224] Handling call
0709 13:11:57.420125 (+107205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.428712 (+  8587us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:57.428746 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.428794 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:57.428835 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.428907 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.702233 (+2273326us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001aac50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:59.702342 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1261,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":10679,"spinlock_wait_cycles":245516544}
I20260709 13:11:59.706022 28654 rpcz_store.cc:276] 0709 13:11:57.361569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.532115 (+170546us) service_pool.cc:224] Handling call
0709 13:11:57.559875 (+ 27760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.564197 (+  4322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.564224 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.564652 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:11:58.660338 (+1095686us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.676235 (+ 15897us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.683139 (+  6904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.701888 (+1018749us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b540018f454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:59.701939 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.701993 (+    54us) raft_consensus.cc:1685] finished
0709 13:11:59.702091 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.702239 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7567,"prepare.queue_time_us":15896,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":32573,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":17090,"spinlock_wait_cycles":9063296,"thread_start_us":1095240,"threads_started":1,"wal-append.queue_time_us":1192340}
I20260709 13:11:59.689469 31452 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.709941 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.710225 31365 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.710599 31452 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:11:59.708582 31065 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:59.712776 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.714118 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.714782 28725 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:58.657150 29251 rpcz_store.cc:276] 0709 13:11:56.593428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.380741 (+787313us) service_pool.cc:224] Handling call
0709 13:11:57.391189 (+ 10448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.391483 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:57.457393 (+ 65910us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.854424 (+397031us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.854511 (+    87us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:57.854579 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.854665 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.854842 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63051,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4750,"raft.queue_time_us":33494,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9361,"thread_start_us":396600,"threads_started":1}
W20260709 13:11:59.716956 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.718026 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.719522 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.700852 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 83345.2us
I20260709 13:11:59.722782 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.680889 28721 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:11:59.664114 31448 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.729687 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:11:59.731459 29251 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:59.733541 29254 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:59.727453 31065 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:59.738915 31065 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.736608 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:11:59.735591 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:59.740716 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.742110 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:11:59.748211 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.754247 31441 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.756613 31441 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.757537 28728 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:59.759896 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.760109 31440 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:11:59.761646 31460 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.129s	user 0.003s	sys 0.000s
I20260709 13:11:59.764012 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:59.760706 28730 raft_consensus.cc:2376] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6. Re-sending same reply.
I20260709 13:11:59.768280 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:59.734356 31174 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:59.773850 28723 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:59.740480 31258 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.778149 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:59.779719 31443 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:59.780154 31443 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:11:59.780516 31443 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:59.740077 31062 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:11:59.781539 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 629) took 3859 ms. Trace:
I20260709 13:11:59.781922 28650 rpcz_store.cc:276] 0709 13:11:55.921979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.922210 (+   231us) service_pool.cc:224] Handling call
0709 13:11:57.670149 (+1747939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.655209 (+985060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.781347 (+1126138us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540023da50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:59.781479 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3992892288}
I20260709 13:11:59.776773 31065 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:11:59.777175 29260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 936) took 2824 ms (client timeout 3234 ms). Trace:
I20260709 13:11:59.783186 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 637) took 2813 ms. Trace:
I20260709 13:11:59.674523 31338 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.743575 31387 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:59.744378 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:59.741321 31384 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:11:59.743717 31163 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:11:59.849171 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:59.787891 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:11:59.803846 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.746209 31274 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.816227 28730 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:11:59.822234 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.824121 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.896461 28721 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:11:59.744206 31281 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:11:59.897554 31281 consensus_queue.cc:1243] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:59.794910 31436 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.898130 31159 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:59.889245 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.740222 31273 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
W20260709 13:11:59.865942 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 831707us
I20260709 13:11:59.903996 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.851400 31446 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.905827 29223 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:11:59.889568 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:11:59.744818 31344 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 13:11:59.746918 31352 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 13:11:59.891990 29251 raft_consensus.cc:2410] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:59.817020 31174 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.773623 31421 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:59.890062 31420 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:11:59.890070 28578 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:59.898936 28647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 646) took 2305 ms (client timeout 1686 ms). Trace:
I20260709 13:11:59.933617 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:11:59.934199 28647 rpcz_store.cc:269] 0709 13:11:57.593296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.673632 (+1080336us) service_pool.cc:224] Handling call
0709 13:11:59.898711 (+1225079us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b540027ea54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:59.898843 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204364800}
I20260709 13:11:59.900475 31436 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.690985 31335 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.898934 28722 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:11:59.900481 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:59.939148 29254 raft_consensus.cc:2410] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:59.902462 31159 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:11:59.888121 28648 rpcz_store.cc:276] 0709 13:11:56.969619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.177100 (+207481us) service_pool.cc:224] Handling call
0709 13:11:57.177456 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.483364 (+305908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.782978 (+2299614us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b540001bdd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:59.783133 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689025408}
I20260709 13:11:59.773998 31415 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:59.913780 31387 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:59.909898 28620 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.370s (SENT) [suppressed 32 similar messages]
I20260709 13:11:59.907991 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 874) took 2470 ms. Trace:
W20260709 13:11:59.783838 29260 rpcz_store.cc:269] 0709 13:11:56.953228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.598217 (+1644989us) service_pool.cc:224] Handling call
0709 13:11:59.776804 (+1178587us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54004b5ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:11:59.777113 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007610752}
I20260709 13:11:59.942075 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.907855 28580 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:11:59.949548 31415 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:11:59.955062 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.956029 28723 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.953318 29252 rpcz_store.cc:276] 0709 13:11:57.437658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.675526 (+1237868us) service_pool.cc:224] Handling call
0709 13:11:58.690748 (+ 15222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.934849 (+244101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.936882 (+  2033us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:58.950180 (+ 13298us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.043372 (+ 93192us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:59.043410 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.901295 (+857885us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b5400215f54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:11:59.901356 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.901422 (+    66us) raft_consensus.cc:1685] finished
0709 13:11:59.901442 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.907931 (+  6489us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103155,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":3483,"spinlock_wait_cycles":176044416,"thread_start_us":220050,"threads_started":2,"wal-append.queue_time_us":110115}
I20260709 13:11:59.935541 31275 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:11:59.954209 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 174901us
W20260709 13:11:59.953480 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 43613.8us
W20260709 13:11:59.964486 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.964931 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.965646 28620 leader_election.cc:336] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.475s (SENT)
I20260709 13:11:59.954438 28578 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:11:59.966060 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:11:59.941155 31359 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:59.967823 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:59.969156 31429 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.226s
I20260709 13:11:59.969352 31275 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.971055 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:11:59.971589 31420 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:59.972035 31420 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:11:59.972115 29251 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:11:59.972448 31420 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:59.974248 28723 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:11:59.975217 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.977455 31159 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.979259 31159 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:59.983728 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:11:59.984206 31415 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:11:59.984949 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:11:59.986460 28723 raft_consensus.cc:2410] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:59.992568 31338 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:11:59.953182 31387 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.994593 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:11:59.995782 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:11:59.942119 31421 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:00.019755 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54136.9us
I20260709 13:12:00.021299 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:00.021999 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.022539 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.022675 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:00.023182 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.023638 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.023974 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.024308 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.024876 28653 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:00.025071 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:11:59.993647 31387 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.028276 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.026446 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:00.029237 28653 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.029495 29260 raft_consensus.cc:2410] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:00.030773 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:00.028720 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.032773 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.026911 31065 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:00.033169 31365 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.033529 28652 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:59.993947 31359 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:00.033703 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.034729 28650 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:00.039186 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.040354 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:11:59.966950 31371 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.033628 31163 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.047886 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.050770 31349 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.046823 31376 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:00.054154 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.062944 28654 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:00.029214 31369 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.070814 28653 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:00.038614 31396 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.093521 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.049350 31065 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:00.047389 31365 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:00.064111 31349 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.048921 31466 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:00.121973 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:00.112589 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 77768.9us
W20260709 13:12:00.119571 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 73904.5us
I20260709 13:12:00.111196 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:00.172997 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61960.1us
I20260709 13:11:58.748895 28656 rpcz_store.cc:276] 0709 13:11:57.031157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.352697 (+321540us) service_pool.cc:224] Handling call
0709 13:11:57.353047 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.353281 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:57.495156 (+141875us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.747439 (+1252283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.747492 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:58.747548 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.747615 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.747736 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":236504,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":50,"raft.queue_time_us":906,"thread_start_us":1292642,"threads_started":2}
I20260709 13:12:00.173842 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.073060 31163 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:00.186076 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.186213 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 111467us
I20260709 13:12:00.123431 31065 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.072068 31452 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:00.123221 31396 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.168112 31349 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.072474 31371 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.235777 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:00.073942 31376 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:00.236827 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.168962 31365 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.250200 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.112805 31475 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 13:12:00.238294 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.236294 31359 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.170938 31421 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.247807 29260 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:00.251565 28653 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:00.250993 28648 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:00.255066 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:00.231320 31163 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.231462 31440 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:00.259663 28656 raft_consensus.cc:2376] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4. Re-sending same reply.
I20260709 13:12:00.255174 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.258241 31174 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:00.265656 28648 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:00.266302 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.260777 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:00.267112 28654 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 3: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:00.267385 28652 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:00.260962 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:00.272847 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 161286us
I20260709 13:12:00.272457 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:00.271780 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 231506us
I20260709 13:12:00.273437 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.274940 29260 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:00.275911 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.277576 28648 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:00.270352 31281 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:00.281805 31322 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.001s
I20260709 13:12:00.281456 31281 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.281947 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.283003 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 869) took 3444 ms. Trace:
I20260709 13:12:00.283691 31281 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.283967 31420 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:00.285642 31465 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:12:00.286701 31443 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.506s	user 0.016s	sys 0.000s
W20260709 13:12:00.286890 31435 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.004s
I20260709 13:12:00.264498 31163 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.287138 31443 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.287369 31435 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.288506 29251 raft_consensus.cc:2410] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:00.260937 31366 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.288550 28724 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:12:00.289213 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.261292 31369 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.111970 31474 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
I20260709 13:12:00.275719 31387 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.250597 31452 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.253234 31134 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:12:00.287163 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1572) took 1304 ms. Trace:
I20260709 13:12:00.483575 28729 rpcz_store.cc:276] 0709 13:11:58.983183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.390677 (+407494us) service_pool.cc:224] Handling call
0709 13:11:59.390955 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:59.468041 (+ 77086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.468088 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.717884 (+249796us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b2c00116bf8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:11:59.718367 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.961302 (+242935us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:59.961338 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.961420 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:00.286861 (+325441us) raft_consensus.cc:1685] finished
0709 13:12:00.286882 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.287102 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2347,"raft.queue_time_us":9618,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":129,"spinlock_wait_cycles":9596800,"thread_start_us":316697,"threads_started":2,"wal-append.queue_time_us":345421}
W20260709 13:12:00.463403 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.260079 31477 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:00.475342 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 301554us
W20260709 13:12:00.423499 28681 heartbeater.cc:646] Failed to heartbeat to 127.26.202.62:36613 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.202.62:36613 timed out after 15.000s (SENT)
I20260709 13:12:00.499552 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.283355 29259 rpcz_store.cc:276] 0709 13:11:56.838475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.658227 (+819752us) service_pool.cc:224] Handling call
0709 13:11:57.658780 (+   553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.659325 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.659371 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.609452 (+1950081us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b18002745a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24cf72a6 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a
0709 13:11:59.762850 (+153398us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b2c00012a88. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:11:59.848546 (+ 85696us) log.cc:844] Serialized 26 byte log entry
0709 13:12:00.071889 (+223343us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:00.071940 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.072255 (+   315us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:00.282778 (+210523us) raft_consensus.cc:1685] finished
0709 13:12:00.282806 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.282930 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5491,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":18084,"spinlock_wait_cycles":350104192,"thread_start_us":166774,"threads_started":1,"wal-append.queue_time_us":225670}
I20260709 13:12:00.501570 29251 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:00.502697 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:00.514835 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.288771 31416 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.524363 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.521128 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.526072 29259 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:00.421281 28475 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 4, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 4 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.395578 31446 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.517833 31474 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.280354 31440 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.530772 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.531296 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:00.532780 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:00.514596 31443 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:00.514662 31369 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:00.430524 31396 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.446026 31376 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:00.544607 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 368720us
I20260709 13:12:00.539644 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:00.538067 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.465875 31354 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.534227 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.450295 31420 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:00.458163 31435 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.487121 31371 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.458590 31476 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:12:00.543025 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:00.529667 31477 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:00.433471 31475 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 13:12:00.552544 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.444646 31478 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:12:00.556419 29259 raft_consensus.cc:2410] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:00.543596 31446 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.550122 31396 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.551870 31376 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.544024 31369 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:00.525655 31416 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.572659 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:00.542440 31474 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:00.558996 31437 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.559226 31477 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.573590 29251 raft_consensus.cc:2376] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7. Re-sending same reply.
I20260709 13:12:00.580423 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.499177 31366 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.590518 31349 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.591877 28653 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:00.548789 31440 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:00.599072 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61069.1us
I20260709 13:12:00.569711 31483 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.602941 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:00.603421 31463 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.550s	user 0.004s	sys 0.000s
I20260709 13:12:00.569625 31371 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:12:00.588323 31065 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.579866 31396 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.600050 31376 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:00.573853 31446 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.610258 31387 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:00.596258 31477 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.596652 31437 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.571367 31163 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.623637 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.634137 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.640149 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2221) took 1084 ms. Trace:
I20260709 13:12:00.640404 28730 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:00.658135 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 111739us
I20260709 13:12:00.682400 29251 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
W20260709 13:12:00.677909 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 107147us
I20260709 13:12:00.684072 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:00.678465 28728 rpcz_store.cc:276] 0709 13:11:59.555530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.697582 (+142052us) service_pool.cc:224] Handling call
0709 13:12:00.639948 (+942366us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b540008c854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:00.640092 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132937600}
I20260709 13:12:00.611459 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:00.614805 28572 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:00.635757 29260 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:12:00.637152 31349 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.639094 31446 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:00.674612 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.636425 31440 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:00.727810 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:00.728199 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:00.637404 31065 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:00.635445 31366 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.739670 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.636967 31365 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:00.741748 31369 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.742450 31365 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:00.690570 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:00.737928 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 868) took 4084 ms. Trace:
I20260709 13:12:00.633273 31371 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
W20260709 13:12:00.744391 31450 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 1.113s	user 0.000s	sys 0.009s
I20260709 13:12:00.743350 29255 rpcz_store.cc:276] 0709 13:11:56.653556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.652149 (+998593us) service_pool.cc:224] Handling call
0709 13:11:57.652599 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:57.653074 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.653108 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:59.702640 (+2049532us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b2c00012a88. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:11:59.703235 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 13:11:59.933560 (+230325us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:59.933594 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.933695 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:00.602851 (+669156us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:00.737388 (+134537us) raft_consensus.cc:1685] finished
0709 13:12:00.737454 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.737803 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":205035136,"thread_start_us":229929,"threads_started":1,"wal-append.queue_time_us":349926}
I20260709 13:12:00.748312 29255 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:00.732573 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 121200us
I20260709 13:12:00.739100 31396 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.735422 29251 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.726686 31421 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:00.752506 31421 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.750895 31440 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:00.741711 31349 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:00.748720 31281 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.753996 31440 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.754645 29253 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:00.754400 31281 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.755290 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 948) took 1026 ms. Trace:
I20260709 13:12:00.755659 29253 rpcz_store.cc:276] 0709 13:11:59.729139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.753982 (+1024843us) service_pool.cc:224] Handling call
0709 13:12:00.754295 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.755042 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.755236 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:00.756742 31281 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.634197 31483 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.758944 31483 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.756796 31440 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:00.736728 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.635445 31474 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:00.760730 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 822) took 1212 ms. Trace:
I20260709 13:12:00.761394 28648 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:12:00.652074 31335 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.745859 31493 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.762475 31493 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.762938 31457 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:00.763489 31457 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.763794 31477 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.765633 31457 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.762979 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:00.764760 31493 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.770025 31335 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:00.761623 28722 rpcz_store.cc:276] 0709 13:11:59.547904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.629246 (+ 81342us) service_pool.cc:224] Handling call
0709 13:12:00.760459 (+1131213us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54001b8854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:00.760661 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618230016}
I20260709 13:12:00.761652 29259 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:12:00.773545 31335 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:00.773589 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 800) took 3267 ms. Trace:
I20260709 13:12:00.774307 31421 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:00.778406 28727 rpcz_store.cc:276] 0709 13:11:57.506324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.514553 (+  8229us) service_pool.cc:224] Handling call
0709 13:11:57.547477 (+ 32924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.603989 (+ 56512us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:58.668420 (+1064431us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.946398 (+277978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:58.946451 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:58.946498 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.773358 (+1826860us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b5400175f54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:00.773405 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.773530 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6365,"prepare.queue_time_us":1180380,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":25695,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":19396,"spinlock_wait_cycles":129447296,"thread_start_us":1335173,"threads_started":2,"wal-append.queue_time_us":310154,"wal-append.run_cpu_time_us":1204,"wal-append.run_wall_time_us":1006396}
I20260709 13:12:00.781378 31335 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.754006 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 946) took 1025 ms. Trace:
I20260709 13:12:00.783862 29255 rpcz_store.cc:276] 0709 13:11:59.728532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.745441 (+1016909us) service_pool.cc:224] Handling call
0709 13:12:00.745760 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.753415 (+  7655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.753679 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:00.785773 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 885) took 1054 ms. Trace:
I20260709 13:12:00.786136 29255 rpcz_store.cc:276] 0709 13:11:59.731674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.784677 (+1053003us) service_pool.cc:224] Handling call
0709 13:12:00.785045 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.785242 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.785269 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:00.785450 (+   181us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:00.785509 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.785571 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.785710 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:00.786911 31416 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.791580 31474 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.761387 31349 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:00.793689 31349 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.794194 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.798024 31474 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.799208 29257 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:12:00.800503 31490 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.167s	user 0.003s	sys 0.000s
I20260709 13:12:00.800881 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:00.804548 29254 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:00.806743 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1579) took 1780 ms. Trace:
I20260709 13:12:00.807173 28724 rpcz_store.cc:276] 0709 13:11:59.026049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.409265 (+383216us) service_pool.cc:224] Handling call
0709 13:11:59.409659 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.483760 (+1074101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.806488 (+322728us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54002d9e54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:00.806686 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020717440}
I20260709 13:12:00.807791 31474 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:00.808511 31474 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:00.809615 31474 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:00.639299 31381 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.642273 31437 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.644202 31163 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:00.691430 31184 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:12:00.816918 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.820799 31483 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.817448 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:00.818037 31477 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.823616 31437 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.825887 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 887) took 1093 ms. Trace:
I20260709 13:12:00.826380 29260 rpcz_store.cc:276] 0709 13:11:59.732260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.275645 (+543385us) service_pool.cc:224] Handling call
0709 13:12:00.825668 (+550023us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400750154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:00.825810 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825966336}
I20260709 13:12:00.826768 29251 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:00.787776 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 886) took 1055 ms. Trace:
I20260709 13:12:00.829385 29255 rpcz_store.cc:276] 0709 13:11:59.731961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.787005 (+1055044us) service_pool.cc:224] Handling call
0709 13:12:00.787298 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.787468 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.787492 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:00.787530 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:00.787566 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.787618 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.787725 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:00.830783 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.831416 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:00.832299 31381 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:00.834544 31381 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.835314 31477 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.835757 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 823) took 1114 ms. Trace:
I20260709 13:12:00.836159 28730 rpcz_store.cc:276] 0709 13:11:59.721295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.895385 (+174090us) service_pool.cc:224] Handling call
0709 13:12:00.640219 (+744834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.680008 (+ 39789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.835538 (+155530us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b540008c850. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:00.835681 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712241920}
I20260709 13:12:00.840515 28722 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:00.841307 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.842042 28728 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:00.843597 31437 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.845321 31352 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:00.845572 28648 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:00.845839 31352 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:00.844244 31437 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.846817 31352 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:00.848137 31352 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.848527 31437 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:00.850471 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:00.851344 31165 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:00.853123 31165 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.854154 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.854924 28726 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:00.732612 31484 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:00.856647 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.858626 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.859532 28722 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:00.862203 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 950) took 1132 ms. Trace:
I20260709 13:12:00.862776 29259 rpcz_store.cc:276] 0709 13:11:59.730085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.676181 (+946096us) service_pool.cc:224] Handling call
0709 13:12:00.861981 (+185800us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54006da1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:00.862125 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23825792}
I20260709 13:12:00.864174 31065 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:00.866643 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:00.868521 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.869652 28723 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:00.858881 31437 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.871470 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:00.871847 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:00.872413 28723 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.873543 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:00.875116 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.877105 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:00.878886 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.882110 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.564083 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:00.888475 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.890494 29257 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:00.891295 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.891871 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.891983 28722 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:00.892445 28723 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:00.892858 28729 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:00.893131 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:00.893420 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.832823 31275 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:00.922610 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:00.930292 28649 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:00.924896 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:00.924062 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.933609 28722 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 2.
I20260709 13:12:00.902747 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.897886 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.909451 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.928453 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:00.876624 31165 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:00.952471 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:00.966349 28724 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:00.968770 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.875996 31457 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.965984 28727 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:12:00.985061 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:00.935544 29223 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:00.985339 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:00.985952 29254 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:00.986016 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50550.3us
I20260709 13:12:00.894954 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:00.934545 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.009s	sys 0.008s
W20260709 13:12:00.986886 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.010s	sys 0.009s
W20260709 13:12:00.931229 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 445837us
W20260709 13:12:00.987176 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 711046us
I20260709 13:12:00.966001 28726 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:00.970078 28722 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:00.970124 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:00.988289 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:00.880359 31359 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.988227 29256 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:00.994800 29224 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:00.995143 28654 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:00.989287 29258 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:00.851382 31423 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:12:01.010013 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:01.011790 28655 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.879892 31441 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:00.994222 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:00.922526 31477 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:00.929397 31416 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.022094 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:12:01.026795 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54373.2us
W20260709 13:12:01.029614 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.894150 31381 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:12:00.884684 31437 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:01.033622 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:01.045897 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:01.007902 31062 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:01.048013 29257 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:01.001334 31497 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.007354 31418 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.051847 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:01.053411 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:01.060272 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:00.968606 31184 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:12:01.064647 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:01.063023 28655 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
W20260709 13:12:01.051254 31344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.033s
I20260709 13:12:01.083705 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:01.084905 29251 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:01.086447 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:01.087577 29258 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:00.996543 31165 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:01.002280 31322 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:12:01.101687 28723 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:01.103785 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:01.105463 29259 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:01.082520 31344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.006s	sys 0.033s
I20260709 13:12:01.051064 31446 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.116710 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:01.108971 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:01.128695 29258 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:01.050101 31441 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:01.120482 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:01.120388 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:01.063769 31274 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:01.110174 29254 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:01.130303 28655 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:01.083069 31415 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.059410 31418 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.091413 31062 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:01.108366 31065 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.131012 31499 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.136775 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:01.137455 31184 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:01.139473 31165 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:01.037431 31416 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.035009 31477 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:01.048542 31494 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:12:01.082792 31497 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:01.309398 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.241505 31418 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.243283 31496 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:01.262216 31452 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:01.259687 31480 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:01.339509 29254 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:12:01.273828 31184 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:01.319983 31163 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.344489 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 661) took 1087 ms. Trace:
I20260709 13:12:01.356998 28654 rpcz_store.cc:276] 0709 13:12:00.257630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.272301 (+ 14671us) service_pool.cc:224] Handling call
0709 13:12:01.344269 (+1071968us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54003d4fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:01.344421 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638700288}
W20260709 13:12:01.337141 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 454343us
I20260709 13:12:01.349650 31384 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:01.360390 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:01.317960 31165 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.319828 31211 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.362957 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:01.366632 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.009s	sys 0.039s
I20260709 13:12:01.367765 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:01.380522 29257 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:01.378297 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:01.377897 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:01.383502 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:01.384649 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.009s	sys 0.040s
W20260709 13:12:01.372843 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 469323us
I20260709 13:12:01.419629 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:01.334945 31496 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.331566 31065 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.456241 29259 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:01.356559 31184 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.467811 28546 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:01.378700 31352 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.520s	user 0.014s	sys 0.000s
I20260709 13:12:01.344909 31480 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:01.379206 31349 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.003s
I20260709 13:12:01.473286 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:01.372150 31354 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.377873 31495 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:01.463829 31483 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.456169 31488 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:01.475018 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 55532.9us
I20260709 13:12:01.518721 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:01.288159 31499 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:01.526916 28653 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.017s	sys 0.011s
W20260709 13:12:01.528368 28653 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.017s	sys 0.011s
I20260709 13:12:01.464481 31496 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.377804 31384 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.521446 28696 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:01.513614 31423 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:01.561964 28696 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:01.481326 31480 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.470480 31478 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.371726 31163 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.517762 31354 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.533342 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:01.426393 31165 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:01.540310 28656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.019s	sys 0.012s
I20260709 13:12:01.456382 31211 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.513146 31495 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:01.565963 28696 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:01.521286 31134 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.522521 31483 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.514968 31349 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:01.475838 31065 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.370909 31441 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.523762 31488 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.537184 31381 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:01.425698 31062 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.588881 31437 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:01.572660 28656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.019s	sys 0.012s
W20260709 13:12:01.601693 28545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.038s	sys 0.063s
W20260709 13:12:01.648016 28545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.039s	sys 0.063s
W20260709 13:12:01.648341 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 596578us
I20260709 13:12:01.648773 28650 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:01.562134 31510 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.572664 31354 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:01.616295 29223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.011s	sys 0.022s
W20260709 13:12:01.558701 31281 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.008s	sys 0.020s
I20260709 13:12:01.565320 31423 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:01.592841 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 59578.3us
W20260709 13:12:01.643031 31479 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:12:01.589975 31474 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:01.647329 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 81489.1us
I20260709 13:12:01.540716 31513 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.649142 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:01.602528 31483 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:01.617944 31484 consensus_meta.cc:287] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.762s	user 0.013s	sys 0.000s
I20260709 13:12:01.735097 31423 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.741257 28475 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:01.742997 28475 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:01.654584 29223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.013s	sys 0.023s
W20260709 13:12:01.640944 31498 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.494s	user 0.001s	sys 0.000s
W20260709 13:12:01.645804 31159 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.004s	sys 0.042s
I20260709 13:12:01.572291 31478 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.637777 31488 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:01.723596 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 74622.4us
W20260709 13:12:01.727298 31507 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:12:01.728299 31506 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260709 13:12:01.729246 31503 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 13:12:01.731033 31508 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:12:01.750660 28475 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 5 to 6, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:01.637339 31522 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.640093 31381 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:01.655117 31518 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.767696 31384 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:01.768699 31484 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:01.755406 31512 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:12:01.612124 31134 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:01.666777 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:01.781659 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:01.718324 31437 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:01.757102 31159 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.005s	sys 0.042s
I20260709 13:12:01.736986 31423 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.811352 31520 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:01.659157 31510 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:01.811949 31415 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 13:12:01.756595 31416 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:01.823015 28694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.001s	sys 0.033s
W20260709 13:12:01.873243 28694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.002s	sys 0.033s
I20260709 13:12:01.819380 28475 catalog_manager.cc:5697] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:01.875403 28475 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 4, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 4 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:01.820989 31474 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:01.877418 28725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.001s	sys 0.004s
W20260709 13:12:01.877813 28725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.001s	sys 0.004s
I20260709 13:12:01.877637 31474 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.878399 31474 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.878916 31474 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.814738 31477 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:01.866245 28479 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 377) took 16571 ms (client timeout 15000 ms). Trace:
I20260709 13:12:01.818086 31516 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.885399 31516 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:01.888368 31516 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:01.646988 31495 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:01.901600 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 433847us
I20260709 13:12:01.834158 31369 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.851394 31520 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.752012 31513 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:01.911792 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1735) took 1176 ms. Trace:
I20260709 13:12:01.915319 28651 rpcz_store.cc:276] 0709 13:12:00.735678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.735820 (+   142us) service_pool.cc:224] Handling call
0709 13:12:00.736170 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.736550 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.736576 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:00.738724 (+  2148us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.123176 (+384452us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:01.123234 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.123345 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:01.911527 (+788182us) raft_consensus.cc:1685] finished
0709 13:12:01.911551 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:01.911712 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4337,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":381493,"threads_started":1,"wal-append.queue_time_us":585661}
I20260709 13:12:01.921841 31516 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:01.923116 31529 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.918058 28475 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:01.873479 31484 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:01.901953 31437 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.903025 31415 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:01.935875 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.904536 31494 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.936617 28475 catalog_manager.cc:5697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:01.924480 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 405709us
I20260709 13:12:01.939853 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:01.949232 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1738) took 1060 ms. Trace:
I20260709 13:12:01.982867 28653 rpcz_store.cc:276] 0709 13:12:00.889311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.889440 (+   129us) service_pool.cc:224] Handling call
0709 13:12:00.889713 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.889949 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:01.531036 (+641087us) log.cc:844] Serialized 14 byte log entry
0709 13:12:01.948707 (+417671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:01.948781 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:01.948857 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.948948 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:01.949153 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":803251,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":43,"raft.queue_time_us":42550,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":951815,"threads_started":3}
W20260709 13:12:01.881842 28479 rpcz_store.cc:269] 0709 13:11:45.249807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.250110 (+   303us) service_pool.cc:224] Handling call
0709 13:12:01.817720 (+16567610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:53.247958 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:53.272109 (+ 24151us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:53.272153 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:11:53.272173 (+    20us) tablet.cc:662] Decoding operations
0709 13:11:53.290328 (+ 18155us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:53.290396 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:53.290442 (+    46us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:11:53.291254 (+   812us) tablet.cc:701] Row locks acquired
0709 13:11:53.291281 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:11:53.291491 (+   210us) write_op.cc:270] Start()
0709 13:11:53.291624 (+   133us) write_op.cc:276] Timestamp: P: 1783602713291411 usec, L: 0
0709 13:11:53.291654 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:11:53.331015 (+ 39361us) log.cc:844] Serialized 3200 byte log entry
0709 13:11:53.853400 (+522385us) op_driver.cc:464] REPLICATION: finished
0709 13:11:54.276915 (+423515us) write_op.cc:301] APPLY: starting
0709 13:11:54.291185 (+ 14270us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:54.291651 (+   466us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:54.291866 (+   215us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:54.408688 (+116822us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:54.462991 (+ 54303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:11:54.468331 (+  5340us) write_op.cc:312] APPLY: finished
0709 13:11:54.708465 (+240134us) log.cc:844] Serialized 65 byte log entry
0709 13:11:55.246875 (+538410us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a24d0c0ac 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b
0709 13:11:55.546182 (+299307us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:55.578644 (+ 32462us) write_op.cc:454] Released schema lock
0709 13:11:55.588397 (+  9753us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:55.630100 (+ 41703us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:55.630163 (+    63us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":578645,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":395626,"apply.run_cpu_time_us":32298,"apply.run_wall_time_us":1348087,"mutex_wait_us":2361,"num_ops":8,"prepare.queue_time_us":339082,"prepare.run_cpu_time_us":11199,"prepare.run_wall_time_us":338176,"raft.queue_time_us":195604,"raft.run_cpu_time_us":77177,"raft.run_wall_time_us":414148,"replication_time_us":547080,"spinlock_wait_cycles":59718016,"thread_start_us":1745430,"threads_started":5,"wal-append.queue_time_us":1046104,"wal-append.run_cpu_time_us":18899,"wal-append.run_wall_time_us":2565226}]]}
I20260709 13:12:01.918483 31065 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:01.914572 31514 raft_consensus.cc:2764] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:02.020231 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:01.902637 31524 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:01.918584 31520 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:02.063829 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 397183us
I20260709 13:12:01.935781 31275 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:02.065331 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 45222.2us
I20260709 13:12:02.074790 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:01.821949 31522 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:02.079437 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:02.081403 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 840) took 1186 ms. Trace:
I20260709 13:12:01.944550 31499 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:01.925069 31516 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:02.019852 31165 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:01.828079 31518 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:01.974035 31494 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.099821 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 839) took 1218 ms. Trace:
I20260709 13:12:02.105244 28727 rpcz_store.cc:276] 0709 13:12:00.881193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.985537 (+104344us) service_pool.cc:224] Handling call
0709 13:12:01.026125 (+ 40588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.026405 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:01.557570 (+531165us) log.cc:844] Serialized 14 byte log entry
0709 13:12:01.833463 (+275893us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.099377 (+265914us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.099446 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:02.099508 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.099588 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.099731 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79270,"prepare.queue_time_us":635972,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":100,"raft.queue_time_us":188640,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":6230,"thread_start_us":966885,"threads_started":3,"wal-append.queue_time_us":462010}
I20260709 13:12:02.096344 28730 rpcz_store.cc:276] 0709 13:12:00.895059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.995693 (+100634us) service_pool.cc:224] Handling call
0709 13:12:01.033117 (+ 37424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.033383 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:01.516432 (+483049us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.080997 (+564565us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.081081 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:02.081141 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.081210 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.081339 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111962,"prepare.queue_time_us":711571,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":31732,"raft.queue_time_us":92815,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":824779,"threads_started":3}
I20260709 13:12:01.973978 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 881) took 2211 ms. Trace:
I20260709 13:12:01.907305 31381 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:02.107982 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 326419us
W20260709 13:12:02.125466 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 46160.8us
I20260709 13:12:02.126569 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:02.073843 31211 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:02.182403 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.122808 28696 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:02.220959 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 94492.7us
I20260709 13:12:02.224370 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:02.227722 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:02.228592 28727 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:01.941366 31484 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:02.237170 31542 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:02.603806 28723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2244) took 1723 ms (client timeout 1602 ms). Trace:
W20260709 13:12:02.779569 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.414808 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:02.324831 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:02.241451 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 118721us
I20260709 13:12:02.631319 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1591) took 1773 ms. Trace:
I20260709 13:12:02.612982 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1733) took 1878 ms. Trace:
I20260709 13:12:02.613680 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1209) took 3120 ms. Trace:
I20260709 13:12:02.409329 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:02.742357 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.008s	sys 0.030s
I20260709 13:12:02.402915 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:03.054625 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.018s	sys 0.039s
I20260709 13:12:02.917284 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2216) took 2034 ms. Trace:
W20260709 13:12:03.055261 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.1155e+06us
I20260709 13:12:02.256191 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:03.056401 28730 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:02.948956 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:02.402789 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:02.335583 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.328857 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:02.910512 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 686204us
I20260709 13:12:02.949198 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:03.063515 28650 rpcz_store.cc:276] 0709 13:12:00.734689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.734896 (+   207us) service_pool.cc:224] Handling call
0709 13:12:00.766231 (+ 31335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.651039 (+884808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.612630 (+961591us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b540022bd54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:02.612897 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029218560}
W20260709 13:12:02.909305 28723 rpcz_store.cc:269] 0709 13:12:00.880733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.893170 (+ 12437us) service_pool.cc:224] Handling call
0709 13:12:02.603485 (+1710315us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54001b9254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:02.603695 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477012352}
I20260709 13:12:03.060472 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:02.501999 31518 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.126534 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:03.055455 28656 rpcz_store.cc:276] 0709 13:12:00.883298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.923016 (+ 39718us) service_pool.cc:224] Handling call
0709 13:12:00.923368 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.933516 (+ 10148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.933545 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:00.953758 (+ 20213us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.648076 (+694318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:01.648135 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.648218 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.593442 (+945224us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4800231e58. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2cd3faa1 00007f4a2cd36b37 00007f4a2cd369ca 00007f4a2ce2e26f 00007f4a2ce2df37 00007f4a2ce4255c 00007f4a2ce42508 00007f4a2ce42488 00007f4a2ce42443 00007f4a2ce416ec 00007f4a2bd6ba96
0709 13:12:02.908868 (+315426us) raft_consensus.cc:1685] finished
0709 13:12:02.908894 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.917196 (+  8302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9798,"raft.queue_time_us":10303,"raft.run_cpu_time_us":9338,"raft.run_wall_time_us":1658182,"spinlock_wait_cycles":31506688,"thread_start_us":616382,"threads_started":1,"wal-append.queue_time_us":1365466}
I20260709 13:12:03.126416 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.127813 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.128589 28578 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:03.128417 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:02.421048 31478 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:02.921734 31546 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:12:03.129875 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:02.260404 31441 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:03.053215 29256 rpcz_store.cc:276] 0709 13:11:59.493759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.509970 (+ 16211us) service_pool.cc:224] Handling call
0709 13:11:59.560115 (+ 50145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.009543 (+1449428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.613417 (+1603874us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540068f1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:02.613611 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283847552}
I20260709 13:12:03.130985 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:02.344859 31512 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:02.918184 31516 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:03.132196 31512 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:02.561538 31513 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:03.133298 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 837) took 2256 ms. Trace:
W20260709 13:12:02.551762 31544 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.434s	user 0.000s	sys 0.001s
W20260709 13:12:02.620638 31537 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.545s	user 0.001s	sys 0.000s
I20260709 13:12:03.134754 31512 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:02.658547 31344 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.133744 28725 rpcz_store.cc:276] 0709 13:12:00.876624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.878788 (+  2164us) service_pool.cc:224] Handling call
0709 13:12:00.879209 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.269465 (+390256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.269606 (+   141us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.270323 (+   717us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.878435 (+608112us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:01.880161 (+  1726us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.074645 (+194484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.074738 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.133087 (+1058349us) raft_consensus.cc:1685] finished
0709 13:12:03.133107 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.133239 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48775,"prepare.queue_time_us":615,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":324221,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":30396,"thread_start_us":1081729,"threads_started":3,"wal-append.queue_time_us":1118605}
I20260709 13:12:03.050958 28728 rpcz_store.cc:276] 0709 13:12:00.857816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.872586 (+ 14770us) service_pool.cc:224] Handling call
0709 13:12:00.890202 (+ 17616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.890403 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:01.157028 (+266625us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.597425 (+1440397us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18003ef380. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a
0709 13:12:02.630925 (+ 33500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.630989 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:02.631054 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.631132 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.631256 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33185,"prepare.queue_time_us":675367,"prepare.run_cpu_time_us":3419,"prepare.run_wall_time_us":20323,"raft.queue_time_us":52264,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3672,"spinlock_wait_cycles":5698944,"thread_start_us":684509,"threads_started":2,"wal-append.queue_time_us":975622}
I20260709 13:12:02.606797 31349 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.135704 31344 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.136817 31349 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.137209 31483 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.405s	user 0.010s	sys 0.003s
I20260709 13:12:03.137322 31349 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.137693 31483 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:03.138573 31344 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:02.507257 31522 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:02.689265 31359 consensus_meta.cc:287] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.688s	user 0.010s	sys 0.005s
I20260709 13:12:03.139338 31349 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.139642 31483 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.140019 31505 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.140445 31369 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.224s	user 0.009s	sys 0.000s
I20260709 13:12:03.140894 28649 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:03.141086 31556 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.140647 31505 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.141604 31556 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:02.918740 31134 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.137260 31558 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:12:02.593855 31371 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:03.182521 31184 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.698s	user 0.007s	sys 0.007s
I20260709 13:12:03.183007 31184 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:03.143569 31369 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:03.147264 31556 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.184554 28575 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:12:03.149454 31536 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:03.185438 31536 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:03.187122 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.187566 31536 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:03.187949 28575 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
W20260709 13:12:03.188278 31418 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 1.843s	user 0.003s	sys 0.012s
I20260709 13:12:03.150000 31505 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.188769 31418 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.151113 28723 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:03.140343 31483 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:03.195827 31418 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:03.178961 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:03.179715 31484 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.184506 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.147531 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1751) took 1715 ms. Trace:
I20260709 13:12:03.194197 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:02.110029 31494 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.630548 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 838) took 1749 ms. Trace:
I20260709 13:12:03.132227 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.192678 28725 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:03.211427 28649 rpcz_store.cc:276] 0709 13:12:01.432108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.484122 (+ 52014us) service_pool.cc:224] Handling call
0709 13:12:01.524151 (+ 40029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.141394 (+1617243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.147290 (+  5896us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540027e554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:03.147471 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3717691264}
I20260709 13:12:03.151342 28727 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:03.212347 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 155776us
W20260709 13:12:02.458393 31533 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:12:03.169042 31488 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.341s	user 0.009s	sys 0.005s
W20260709 13:12:03.191486 31520 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.100s	user 0.005s	sys 0.005s
I20260709 13:12:03.151861 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:03.089162 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:02.230715 31437 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.080s
W20260709 13:12:02.507932 31545 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 13:12:02.494079 31510 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.298228 28578 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:12:02.927546 31163 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.384605 28578 pending_rounds.cc:85] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 5
W20260709 13:12:03.248468 31281 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.007s	sys 0.037s
W20260709 13:12:03.342145 31524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.252s	user 0.014s	sys 0.063s
W20260709 13:12:03.350160 28547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.006s	sys 0.024s
I20260709 13:12:03.385666 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:02.931911 31354 consensus_meta.cc:287] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.186s	user 0.013s	sys 0.000s
W20260709 13:12:03.386540 28547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.007s	sys 0.025s
I20260709 13:12:03.386919 31344 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:03.387519 31344 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.387135 31520 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.388025 31344 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:03.388876 28580 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:02.907933 31541 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
W20260709 13:12:03.385982 31524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.015s	sys 0.065s
W20260709 13:12:03.202164 31496 consensus_meta.cc:287] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.635s	user 0.012s	sys 0.000s
W20260709 13:12:03.355620 28545 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.000s	sys 0.052s
W20260709 13:12:03.515204 28545 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.000s	sys 0.054s
W20260709 13:12:03.515743 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 116169us
W20260709 13:12:03.515930 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 1.14856e+06us
I20260709 13:12:03.236332 28729 rpcz_store.cc:276] 0709 13:12:00.880848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.005106 (+124258us) service_pool.cc:224] Handling call
0709 13:12:01.018548 (+ 13442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.019018 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:01.345542 (+326524us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.507035 (+1161493us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b1800314b60. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a
0709 13:12:02.630053 (+123018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.630133 (+    80us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:02.630200 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.630292 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.630468 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125325,"prepare.queue_time_us":615662,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":139234,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":5782,"spinlock_wait_cycles":9819904,"thread_start_us":658631,"threads_started":2,"wal-append.queue_time_us":520681,"wal-append.run_cpu_time_us":1522,"wal-append.run_wall_time_us":1044863}
W20260709 13:12:02.964064 31480 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.392s	user 0.008s	sys 0.002s
I20260709 13:12:03.523139 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:03.523869 28727 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:12:03.213043 28723 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
W20260709 13:12:03.399217 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 1.2965e+06us
I20260709 13:12:02.402261 31527 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:03.484915 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 395802us
W20260709 13:12:03.385728 31281 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.008s	sys 0.043s
I20260709 13:12:02.320422 31159 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:03.535143 28581 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:02.854008 31517 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 1.251s	user 0.005s	sys 0.005s
I20260709 13:12:03.390877 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2360) took 1066 ms. Trace:
I20260709 13:12:03.266207 31443 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.246008 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:03.497364 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69331.8us
W20260709 13:12:03.545284 28721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.017s	sys 0.013s
W20260709 13:12:03.545717 28721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.017s	sys 0.013s
I20260709 13:12:02.992365 31495 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:03.547858 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.252189 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.275954 28730 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:03.548755 29258 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
W20260709 13:12:03.549042 28730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2249) took 1737 ms (client timeout 2007 ms). Trace:
W20260709 13:12:03.549497 28730 rpcz_store.cc:269] 0709 13:12:01.811199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.108584 (+297385us) service_pool.cc:224] Handling call
0709 13:12:03.548957 (+1440373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:03.550542 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:03.550606 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:03.400527 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 193954us
I20260709 13:12:03.551465 28727 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:03.149464 28728 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:02.471824 31474 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.002s
W20260709 13:12:03.199944 31423 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.357s	user 0.009s	sys 0.000s
W20260709 13:12:02.458740 31540 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 13:12:03.520928 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:03.084856 31457 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.297267 31273 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.573683 29258 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:03.139971 31349 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:03.515407 31513 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:02.920192 31497 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.523371 31480 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:02.243858 31477 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:03.385138 28578 pending_rounds.cc:107] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:12:03.391652 31488 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:03.528785 28545 connection.cc:256] RPC call timeout handler was delayed by -1.0385386919999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 13:12:02.741798 31476 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:03.535746 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.505394 31275 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:03.604596 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2241) took 2725 ms. Trace:
I20260709 13:12:03.605245 28724 rpcz_store.cc:276] 0709 13:12:00.878673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.993690 (+115017us) service_pool.cc:224] Handling call
0709 13:12:00.994036 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.371247 (+377211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.371295 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.371955 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.812663 (+440708us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:01.812717 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.812801 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.604346 (+1791545us) raft_consensus.cc:1685] finished
0709 13:12:03.604365 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.604532 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":778,"raft.queue_time_us":481926,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":40823,"thread_start_us":728302,"threads_started":2,"wal-append.queue_time_us":844709}
I20260709 13:12:03.607494 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:03.608235 28724 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:03.609614 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:03.234974 31062 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.538514 29251 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:03.539294 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.235559 31387 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.540028 28580 rpcz_store.cc:276] 0709 13:12:02.327450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.327908 (+   458us) service_pool.cc:224] Handling call
0709 13:12:03.390601 (+1062693us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540031e554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:03.390792 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760565120}
I20260709 13:12:03.385136 28722 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 2.
I20260709 13:12:03.543063 28723 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:03.484506 31510 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:03.556795 28695 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.005s	sys 0.041s
I20260709 13:12:03.562254 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:03.518543 31524 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:03.574669 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53831us
I20260709 13:12:03.532941 31496 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.318877 31184 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.531302 31527 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.531747 31499 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.572044 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.529789 28572 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:03.594750 28578 raft_consensus.cc:2889] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.702118 28572 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:03.600911 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:03.386930 31354 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.610461 28724 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:03.541257 31529 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:03.554237 31159 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:03.564047 31512 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:03.673630 28695 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.337s	user 0.005s	sys 0.041s
I20260709 13:12:03.622725 28581 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:12:03.750342 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 1.41378e+06us
W20260709 13:12:03.620795 28475 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.019s	sys 0.031s
I20260709 13:12:03.596592 31273 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.677672 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.595727 31477 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:03.682575 28723 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:03.688309 31478 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:03.556998 31437 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.685742 29259 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:03.686513 28579 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:12:03.698307 28545 leader_election.cc:336] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.602s (SENT)
I20260709 13:12:03.764093 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:03.603946 28573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.188s	user 0.021s	sys 0.028s
W20260709 13:12:03.673055 31517 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:12:03.702155 29256 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:12:03.709534 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.700752 31527 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:03.620391 31275 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:03.705030 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 104283us
I20260709 13:12:03.580173 31513 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:03.713409 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.714473 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2247) took 2832 ms. Trace:
I20260709 13:12:03.784878 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2362) took 1456 ms. Trace:
I20260709 13:12:03.549937 31134 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:12:03.577708 31474 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.567831 31443 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.695883 31062 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:02.113853 29253 rpcz_store.cc:276] 0709 13:11:59.730335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.756487 (+1026152us) service_pool.cc:224] Handling call
0709 13:12:00.756828 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.883452 (+126624us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:00.923021 (+ 39569us) log.cc:844] Serialized 14 byte log entry
0709 13:12:01.735106 (+812085us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b1800356860. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a 00007f4a27e20a2a
0709 13:12:01.907265 (+172159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:01.911136 (+  3871us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:01.921306 (+ 10170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.934196 (+ 12890us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:01.941809 (+  7613us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":192,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":3360,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7377,"spinlock_wait_cycles":39929088,"thread_start_us":132646,"threads_started":1,"wal-append.queue_time_us":1620430,"wal-append.run_cpu_time_us":1282,"wal-append.run_wall_time_us":1004879}
I20260709 13:12:03.580171 31457 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.723065 31480 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.723649 31499 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.688970 31510 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:03.804661 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.731459 31496 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.580279 31349 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:03.692996 31387 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.739138 31536 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:03.745846 31524 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:03.826349 28620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.550s	user 0.025s	sys 0.080s
W20260709 13:12:03.826915 28620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.551s	user 0.025s	sys 0.080s
I20260709 13:12:03.747165 31381 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.611907 31476 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:03.620754 31563 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:03.572682 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.761461 31477 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:03.767794 31273 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:03.769186 31525 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:03.769776 28619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.022s	sys 0.042s
W20260709 13:12:03.841514 28619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.023s	sys 0.042s
I20260709 13:12:03.543804 31505 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:12:03.749081 31423 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:03.761749 31478 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.784709 28726 rpcz_store.cc:276] 0709 13:12:00.881662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.988001 (+106339us) service_pool.cc:224] Handling call
0709 13:12:00.988337 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.283973 (+295636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.284018 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.315044 (+ 31026us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.663303 (+348259us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:01.663388 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.663493 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.714228 (+2050735us) raft_consensus.cc:1685] finished
0709 13:12:03.714254 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.714390 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13249,"raft.queue_time_us":373353,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":89282,"thread_start_us":593522,"threads_started":2,"wal-append.queue_time_us":567239}
I20260709 13:12:03.772392 31437 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.793272 31513 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:03.806628 31443 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.753825 31529 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.763492 31512 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:03.804714 31474 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.837904 29252 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:12:03.802469 31457 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.844280 31423 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.825610 31536 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:03.810611 31482 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:12:03.792946 31557 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:12:03.830533 31520 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.847488 31478 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:03.829617 31504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.343s	user 0.051s	sys 0.041s
I20260709 13:12:03.798175 31344 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.850781 31062 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.846935 31563 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:03.856489 31486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.349s	user 0.000s	sys 0.049s
W20260709 13:12:03.899684 31486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.660s	user 0.002s	sys 0.050s
I20260709 13:12:03.858757 31423 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:03.902320 31529 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.838703 31159 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.857208 31560 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:12:03.911103 29225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.000s	sys 0.022s
I20260709 13:12:03.910640 31536 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:03.895236 31504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.052s	sys 0.041s
W20260709 13:12:03.917886 29255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.013s	sys 0.014s
W20260709 13:12:03.919251 29255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.013s	sys 0.014s
W20260709 13:12:03.914491 29225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.001s	sys 0.022s
I20260709 13:12:03.877677 31457 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:03.896808 31488 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.928108 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.930125 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.930724 29251 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:03.931717 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.932353 29259 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:03.936408 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.937071 29256 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:03.919596 31354 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.921926 31420 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:03.922406 31563 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:03.924860 31499 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:03.886162 31476 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:03.933604 31536 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:03.928440 31457 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:03.955054 31387 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:03.958890 31510 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:03.971307 31476 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:03.996367 31437 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.001276 31349 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:04.008460 31575 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 13:12:04.011631 31512 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:04.025795 31344 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:04.042052 31572 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:12:04.104051 31495 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.003s
I20260709 13:12:04.105558 31564 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.106266 31564 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.120141 31457 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:04.096459 31494 consensus_meta.cc:287] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.000s
W20260709 13:12:03.757419 28475 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.024s	sys 0.036s
W20260709 13:12:03.770792 28574 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 13:12:04.365849 28574 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:12:04.367072 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 683) took 1418 ms. Trace:
I20260709 13:12:04.367596 28574 rpcz_store.cc:276] 0709 13:12:02.948752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.948880 (+   128us) service_pool.cc:224] Handling call
0709 13:12:04.366867 (+1417987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:03.828718 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:03.785604 28579 rpcz_store.cc:276] 0709 13:12:02.328753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.329089 (+   336us) service_pool.cc:224] Handling call
0709 13:12:02.910128 (+581039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:03.763910 (+853782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.784519 (+ 20609us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54000ec9d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:03.784787 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773485440}
I20260709 13:12:03.793921 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:04.190956 28622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.001s	sys 0.001s
W20260709 13:12:03.770489 28573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.355s	user 0.024s	sys 0.038s
I20260709 13:12:03.773022 28577 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:04.402594 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:03.773723 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.403774 29252 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:12:04.404073 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2365) took 2071 ms. Trace:
W20260709 13:12:03.768934 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 70679.7us
I20260709 13:12:04.406124 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:04.201582 28575 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.025s	sys 0.023s
W20260709 13:12:04.203253 28621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.962s	user 0.030s	sys 0.063s
W20260709 13:12:04.223218 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.240908 28722 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.011s
W20260709 13:12:04.241190 28727 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.012s	sys 0.003s
W20260709 13:12:04.240908 28725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.001s	sys 0.008s
W20260709 13:12:04.407850 28725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.001s	sys 0.008s
W20260709 13:12:04.242282 28729 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.000s
W20260709 13:12:04.409250 28729 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.001s	sys 0.000s
I20260709 13:12:04.250422 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1595) took 3324 ms. Trace:
I20260709 13:12:04.410475 28721 rpcz_store.cc:276] 0709 13:12:00.925483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.533475 (+607992us) service_pool.cc:224] Handling call
0709 13:12:02.607026 (+1073551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.631618 (+ 24592us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:02.631661 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.632221 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.546118 (+913897us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:03.546177 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.546286 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:04.239949 (+693663us) raft_consensus.cc:1685] finished
0709 13:12:04.240040 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.249676 (+  9636us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001b9250. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:04.250140 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24018,"raft.queue_time_us":42524,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4062,"spinlock_wait_cycles":2334397824,"thread_start_us":913538,"threads_started":1,"wal-append.queue_time_us":1211854}
I20260709 13:12:04.413797 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:04.414682 28621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.174s	user 0.031s	sys 0.063s
I20260709 13:12:04.415052 31281 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.415746 31529 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:04.416306 31281 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:04.256166 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.017s
W20260709 13:12:04.417243 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.001s	sys 0.017s
I20260709 13:12:04.416415 31529 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:04.418058 29224 connection.cc:256] RPC call timeout handler was delayed by -2.0822206170000754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:12:04.418319 31349 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.259725 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:04.419124 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1914969399999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:12:04.419584 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1797969399999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 13:12:04.419237 31529 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:04.420405 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 161076us
W20260709 13:12:04.417147 28727 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.012s	sys 0.003s
I20260709 13:12:04.265354 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:04.420794 31554 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:04.422178 31554 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:04.422748 31554 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.273177 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.275244 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.264359 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1220) took 3272 ms. Trace:
I20260709 13:12:04.424494 29255 rpcz_store.cc:276] 0709 13:12:00.991578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.991919 (+   341us) service_pool.cc:224] Handling call
0709 13:12:00.992382 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.004367 (+ 11985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.004422 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.764276 (+1759854us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b2c00012a88. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:12:02.764817 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:12:03.920585 (+1155768us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:03.920640 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.923087 (+  2447us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:04.263613 (+340526us) raft_consensus.cc:1685] finished
0709 13:12:04.263652 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.264098 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23062,"raft.queue_time_us":13622,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":17560,"spinlock_wait_cycles":6207872,"thread_start_us":1015610,"threads_started":1,"wal-append.queue_time_us":1204380}
I20260709 13:12:04.404649 28573 rpcz_store.cc:276] 0709 13:12:02.332910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.364805 (+ 31895us) service_pool.cc:224] Handling call
0709 13:12:02.413635 (+ 48830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.414158 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.414224 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.414971 (+   747us) log.cc:844] Serialized 26 byte log entry
0709 13:12:04.403283 (+1988312us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:04.403393 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.403508 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:04.403598 (+    90us) raft_consensus.cc:1685] finished
0709 13:12:04.403619 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.403860 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":246201,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":3328,"thread_start_us":1987617,"threads_started":1,"wal-append.queue_time_us":1470696}
I20260709 13:12:04.276010 31184 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:04.427829 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.428067 31184 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.429353 31582 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.430537 31420 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:04.430205 31582 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.276713 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.431054 31420 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.153384 31527 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:04.434257 31477 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.004s
I20260709 13:12:04.228343 28572 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.435036 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.436094 28572 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.306425 31585 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.437579 29254 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.437463 31585 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.440056 31585 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.314334 31592 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:04.434902 31477 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.441018 31592 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:04.313688 28696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.009s	sys 0.013s
W20260709 13:12:04.442859 28696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.009s	sys 0.013s
W20260709 13:12:04.443364 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 662594us
I20260709 13:12:04.443743 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.444356 28696 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:04.314648 28695 connection.cc:256] RPC call timeout handler was delayed by -1.0080145729998549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 13:12:04.308120 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.448550 28576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2367) took 2104 ms. Trace:
I20260709 13:12:04.451117 28576 rpcz_store.cc:276] 0709 13:12:02.344750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.345092 (+   342us) service_pool.cc:224] Handling call
0709 13:12:04.447927 (+2102835us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003ff054. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:04.448193 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3483264384}
I20260709 13:12:04.372833 31536 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.452376 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:04.459903 28580 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:12:04.402158 28622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.002s	sys 0.001s
W20260709 13:12:04.193718 28648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.003s	sys 0.018s
I20260709 13:12:04.414492 31548 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:12:04.460634 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 1.38551e+06us
I20260709 13:12:04.461242 31548 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:04.461808 31281 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.462375 31281 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.462949 31369 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:04.463400 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:04.462894 31548 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.464179 29252 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.464368 31548 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:04.255501 29223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.016s
I20260709 13:12:04.464761 31568 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:04.460700 28648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.468s	user 0.004s	sys 0.018s
I20260709 13:12:04.465232 31568 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:04.466521 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2217) took 3577 ms. Trace:
I20260709 13:12:04.466624 31568 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:04.465229 29223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.000s	sys 0.017s
I20260709 13:12:04.466933 28648 rpcz_store.cc:276] 0709 13:12:00.889068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.890367 (+  1299us) service_pool.cc:224] Handling call
0709 13:12:00.895143 (+  4776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.922765 (+ 27622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.922795 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.889718 (+1966923us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b2c000f9be8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:12:02.896623 (+  6905us) log.cc:844] Serialized 26 byte log entry
0709 13:12:04.465821 (+1569198us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:04.465873 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.465986 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:04.466044 (+    58us) raft_consensus.cc:1685] finished
0709 13:12:04.466058 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.466363 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27147,"raft.queue_time_us":27282,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":18809,"spinlock_wait_cycles":12670208,"thread_start_us":1472383,"threads_started":1,"wal-append.queue_time_us":1094315}
W20260709 13:12:04.468394 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 910717us
I20260709 13:12:04.469379 31559 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:04.469888 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:04.470537 31559 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:04.471148 31559 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.471741 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:04.473407 31062 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:04.474202 31387 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:04.474749 31387 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:04.475461 31387 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.417379 31571 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.477624 31571 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.478272 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:04.260957 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.325664 31558 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.481477 31558 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.482358 31560 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:04.482858 31560 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.483157 31381 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:04.483337 31560 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.483595 31381 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:04.484056 31381 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:04.449934 28722 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.007s	sys 0.011s
I20260709 13:12:04.463656 28622 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:04.450002 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:04.420006 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1023969400000624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:12:04.450433 28575 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.025s	sys 0.024s
I20260709 13:12:04.384740 31494 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.452802 31536 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:04.500598 29224 connection.cc:256] RPC call timeout handler was delayed by -1.0573969399999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
I20260709 13:12:04.455077 28576 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:12:04.363291 28730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.011s	sys 0.006s
I20260709 13:12:04.456342 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.419139 31349 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:04.504901 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 44903.9us
I20260709 13:12:04.458253 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:04.484763 31558 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:04.461325 31275 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.006s
W20260709 13:12:04.388265 31590 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
W20260709 13:12:04.510215 28730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.012s	sys 0.006s
W20260709 13:12:04.468730 31423 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.568s	user 0.018s	sys 0.001s
I20260709 13:12:04.480685 31571 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.471096 28696 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:04.485855 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 72301.3us
I20260709 13:12:04.442881 31477 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.421572 31587 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:04.469883 31568 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.516036 29254 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:04.518385 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:04.519101 31349 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:04.519590 28621 connection.cc:256] RPC call timeout handler was delayed by -1.9128862970001137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:12:04.530965 28621 connection.cc:256] RPC call timeout handler was delayed by -1.8588862970000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 13:12:04.519979 31562 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:12:04.531358 28621 connection.cc:256] RPC call timeout handler was delayed by -1.7337862970000515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 13:12:04.552161 28621 connection.cc:256] RPC call timeout handler was delayed by -1.6383862970001246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:12:04.552539 28621 connection.cc:256] RPC call timeout handler was delayed by -1.4538862970000537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:12:04.559805 28577 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
W20260709 13:12:04.565261 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54044.8us
W20260709 13:12:04.565570 28620 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.038s
I20260709 13:12:04.529682 31585 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:04.572659 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 59704.7us
W20260709 13:12:04.576725 28620 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.011s	sys 0.038s
I20260709 13:12:04.583635 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.586055 29255 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:04.583693 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 112742us
W20260709 13:12:04.600272 31513 consensus_meta.cc:287] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.010s
I20260709 13:12:04.629557 31513 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.603999 31564 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.640556 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1598) took 1097 ms. Trace:
I20260709 13:12:04.641073 28727 rpcz_store.cc:276] 0709 13:12:03.542666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.552224 (+  9558us) service_pool.cc:224] Handling call
0709 13:12:03.552581 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.552835 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:04.432762 (+879927us) log.cc:844] Serialized 14 byte log entry
0709 13:12:04.638554 (+205792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:04.638623 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:04.638703 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.640272 (+  1569us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.640464 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12723,"prepare.queue_time_us":532856,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":40426,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":237,"thread_start_us":977947,"threads_started":2}
I20260709 13:12:04.646855 31560 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.649331 31560 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.605191 31558 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:04.607915 29252 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:04.661104 31558 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.661564 31558 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:04.665336 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 201822us
I20260709 13:12:04.667330 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:04.669874 28649 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:04.671412 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:04.672170 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:04.674573 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:04.678807 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:04.679800 28655 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:04.617244 31344 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:04.680657 31344 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.681125 31344 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.681514 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:04.682466 28648 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:12:04.583173 31581 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:04.685257 31581 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:04.685734 31581 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.619452 31582 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:04.689599 31582 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:04.691360 31494 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.692456 31477 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:04.702281 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:04.622417 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.624125 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.653492 31513 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.679527 31558 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.705716 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.551890 31275 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.707365 31592 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.707155 31581 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.604648 31159 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:12:04.620210 31587 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.615700 31536 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.717847 28579 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:12:04.578976 31585 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:04.551577 31423 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:04.720969 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 140781us
W20260709 13:12:04.718482 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 889817us
I20260709 13:12:04.728312 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:04.732681 28648 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:04.741679 28655 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.749022 31581 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:04.749336 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1605) took 1204 ms. Trace:
I20260709 13:12:04.749725 28729 rpcz_store.cc:276] 0709 13:12:03.554498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.689929 (+135431us) service_pool.cc:224] Handling call
0709 13:12:03.690320 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.690572 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:04.409800 (+719228us) log.cc:844] Serialized 14 byte log entry
0709 13:12:04.730769 (+320969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:04.743317 (+ 12548us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:04.743387 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.749134 (+  5747us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.749280 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17932,"prepare.queue_time_us":395975,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":4922,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":3231,"thread_start_us":972958,"threads_started":2}
I20260709 13:12:04.704790 31344 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.753562 31344 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.754931 31587 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:04.755319 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.756156 28578 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:04.756510 28580 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:04.731678 31477 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:04.734170 31585 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:04.773527 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.773823 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.774736 29256 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:04.774592 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.778513 31529 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:04.773806 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.789256 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48602.8us
I20260709 13:12:04.798808 31420 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.806061 31558 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.807727 31275 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:04.807969 31184 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.814462 31423 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.815215 31423 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:04.816069 31478 consensus_meta.cc:287] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.911s	user 0.012s	sys 0.008s
I20260709 13:12:04.815848 31423 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:04.816529 31478 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.817088 31527 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.817709 31349 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:04.818089 31571 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.818295 31349 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.818789 31478 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:04.818899 31571 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.820608 31349 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.821171 31369 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.821493 29258 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:04.821694 31369 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.823927 31369 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.824450 31369 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.825767 31577 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:04.826363 31577 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:04.827535 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1597) took 1285 ms. Trace:
I20260709 13:12:04.830066 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:04.834553 31571 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.836436 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:04.838380 31159 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:04.838662 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 136588us
I20260709 13:12:04.839052 31159 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:04.827937 28730 rpcz_store.cc:276] 0709 13:12:03.542448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.551506 (+  9058us) service_pool.cc:224] Handling call
0709 13:12:03.681466 (+129960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:03.681844 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:03.681881 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:03.682361 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:12:04.574498 (+892137us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:04.574564 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.574669 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:04.709079 (+134410us) raft_consensus.cc:1685] finished
0709 13:12:04.709158 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:04.827242 (+118084us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b5400234bd0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:04.827476 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":61864,"spinlock_wait_cycles":181495040,"thread_start_us":752203,"threads_started":1,"wal-append.queue_time_us":583425}
I20260709 13:12:04.837375 31527 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:04.841959 31527 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:04.824970 31369 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.843318 31527 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.844574 31369 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:04.845242 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.846172 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.846690 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:04.847522 28656 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:04.847658 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.827548 31577 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:04.854491 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 333879us
I20260709 13:12:04.881577 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:04.889410 28572 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:12:04.890726 28572 pending_rounds.cc:85] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 6
I20260709 13:12:04.895218 31577 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.895606 28577 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:04.881578 31486 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:04.897450 31486 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:04.898644 31486 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:04.899868 31486 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.900791 31423 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:04.901696 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:04.902529 28730 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:04.902711 29260 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:04.904330 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:04.905076 28729 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:04.854152 31159 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.905378 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:04.906030 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.906121 28730 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.910739 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.911520 29260 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
W20260709 13:12:04.912941 31476 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.912s	user 0.011s	sys 0.007s
I20260709 13:12:04.914482 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.915174 29258 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:04.906878 28577 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:04.917184 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:04.917375 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:04.916374 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.919338 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.920295 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.920506 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.920743 28656 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:04.921236 29259 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:04.921286 29255 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:12:04.921474 28652 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:04.922348 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:04.922438 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.923090 29256 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.923012 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:04.923374 29254 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:04.923731 28653 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.924345 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:04.925104 28649 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:04.925458 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:04.926198 29251 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:04.926194 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.927572 29252 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:04.928473 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:04.929464 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:04.929746 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.930794 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:04.932538 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:04.933882 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:04.934533 29252 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.934716 28475 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43518 (request call id 374) took 10693 ms. Trace:
I20260709 13:12:04.933888 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:04.928800 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:04.945916 28653 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:04.891062 28572 pending_rounds.cc:107] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:12:04.957231 28572 raft_consensus.cc:2889] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:04.952689 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:04.960310 28648 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.963821 28655 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
W20260709 13:12:04.965713 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 56706.5us
I20260709 13:12:04.965772 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:04.967281 29254 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.988761 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:04.990793 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62161us
I20260709 13:12:04.932475 31559 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:04.995617 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.000216 29258 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
W20260709 13:12:05.003494 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.004309 29259 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:04.993350 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:05.007618 29251 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.893874 31387 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.001964 31529 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:05.010941 31558 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.011226 31529 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.012034 31423 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:05.012385 31387 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:04.988581 31420 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:05.012908 31592 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.013116 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:05.028985 28728 raft_consensus.cc:2410] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:04.880172 31381 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.030525 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 699) took 1874 ms. Trace:
I20260709 13:12:05.030963 28572 rpcz_store.cc:276] 0709 13:12:03.128366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.529200 (+400834us) service_pool.cc:224] Handling call
0709 13:12:03.529642 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.226981 (+697339us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b5400312020. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d9406f 00007f4a27e0cf60 00007f4a27e0e7de 00007f4a27e18b49 00007f4a27e19416 00007f4a27e15d8f 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62
0709 13:12:04.989599 (+762618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.002949 (+ 13350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220449664}
W20260709 13:12:05.037591 28722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.018s
W20260709 13:12:05.038147 28722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.000s	sys 0.019s
I20260709 13:12:04.997545 31184 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.061604 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:04.935111 28475 rpcz_store.cc:276] 0709 13:11:54.302222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.413350 (+111128us) service_pool.cc:224] Handling call
0709 13:12:04.934489 (+10521139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:03.908657 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:04.000951 (+ 92294us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:04.007166 (+  6215us) write_op.cc:435] Acquired schema lock
0709 13:12:04.009025 (+  1859us) tablet.cc:662] Decoding operations
0709 13:12:04.108235 (+ 99210us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:04.108360 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:04.108402 (+    42us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:12:04.109490 (+  1088us) tablet.cc:701] Row locks acquired
0709 13:12:04.109556 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:12:04.109780 (+   224us) write_op.cc:270] Start()
0709 13:12:04.109965 (+   185us) write_op.cc:276] Timestamp: P: 1783602724109691 usec, L: 0
0709 13:12:04.109999 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:12:04.110911 (+   912us) log.cc:844] Serialized 3210 byte log entry
0709 13:12:04.164501 (+ 53590us) op_driver.cc:464] REPLICATION: finished
0709 13:12:04.362042 (+197541us) write_op.cc:301] APPLY: starting
0709 13:12:04.389519 (+ 27477us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:04.389980 (+   461us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:04.390199 (+   219us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:04.391899 (+  1700us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:04.392303 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:12:04.392376 (+    73us) write_op.cc:312] APPLY: finished
0709 13:12:04.392963 (+   587us) log.cc:844] Serialized 65 byte log entry
0709 13:12:04.411882 (+ 18919us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:04.412153 (+   271us) write_op.cc:454] Released schema lock
0709 13:12:04.412228 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:04.418324 (+  6096us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:04.418355 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1573907,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":137987,"apply.run_cpu_time_us":5363,"apply.run_wall_time_us":80795,"num_ops":8,"prepare.queue_time_us":1371940,"prepare.run_cpu_time_us":11418,"prepare.run_wall_time_us":269213,"raft.queue_time_us":4024,"raft.run_cpu_time_us":1738,"raft.run_wall_time_us":154535,"replication_time_us":54323,"thread_start_us":2100423,"threads_started":4,"wal-append.queue_time_us":46577}]]}
I20260709 13:12:05.062584 28727 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.013543 31529 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:04.939939 31281 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.069597 29255 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:05.070250 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:05.049226 28546 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.503s (SENT) [suppressed 17 similar messages]
I20260709 13:12:05.084179 28653 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:05.085620 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:05.076179 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:05.061751 31184 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.099251 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.099479 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.100077 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.100170 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:05.102602 29258 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:05.102747 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.103971 29252 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:05.104542 28572 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:05.107792 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:05.013558 31592 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:05.122879 28575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.027s
I20260709 13:12:05.084295 29253 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:05.129227 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.129626 28655 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:05.100562 31548 consensus_meta.cc:287] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.633s	user 0.017s	sys 0.005s
I20260709 13:12:05.129227 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:05.130728 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.129984 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.147318 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1601) took 1603 ms. Trace:
I20260709 13:12:05.102276 31184 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.160912 29255 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:05.158311 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:05.011610 31558 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.158497 29260 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:05.159325 28578 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:05.162073 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 560304us
I20260709 13:12:05.157968 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.163501 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:05.162989 28725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.050s	sys 0.080s
W20260709 13:12:05.164239 28725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.051s	sys 0.080s
I20260709 13:12:05.164134 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.165091 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.122177 31369 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:05.173983 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.173555 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:05.179636 31524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.043s	sys 0.109s
I20260709 13:12:05.123910 31420 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.180377 28729 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:05.180640 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:05.101900 31536 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:12:05.163519 31513 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:05.188716 31513 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.191356 31513 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.158783 28722 rpcz_store.cc:276] 0709 13:12:03.543404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.674334 (+130930us) service_pool.cc:224] Handling call
0709 13:12:03.674661 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.674865 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:04.485358 (+810493us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.092080 (+606722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.101367 (+  9287us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:05.101439 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.101523 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.147253 (+ 45730us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":411199,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":26608,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":118,"thread_start_us":1356452,"threads_started":2}
I20260709 13:12:05.154081 31349 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:05.184023 29258 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:05.133620 31423 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:05.180114 31524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.043s	sys 0.110s
I20260709 13:12:05.191979 28479 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 4 to 7, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 7 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:05.196926 29223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.027s	sys 0.039s
I20260709 13:12:05.184037 29254 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:05.184536 28728 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:05.169775 31560 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:05.164608 31571 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:05.207476 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.169046 28573 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
W20260709 13:12:05.211028 29223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.028s	sys 0.039s
I20260709 13:12:05.193859 31381 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.185998 31529 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:05.234259 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.218192 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.184537 31477 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:05.217497 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:05.193112 31134 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:12:05.230815 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 597607us
I20260709 13:12:05.207098 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 689) took 2204 ms. Trace:
I20260709 13:12:05.264062 28574 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:05.215765 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.266106 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:05.216202 31513 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:05.255761 28721 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:12:05.186568 31369 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:05.273844 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 96626.7us
I20260709 13:12:05.194656 31564 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:12:05.194217 31420 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.276847 28653 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.216526 31568 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:05.272437 29258 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:05.292573 29252 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:05.294714 28655 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:05.293255 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:05.296676 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 119427us
I20260709 13:12:05.263967 28575 rpcz_store.cc:276] 0709 13:12:03.002405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.188828 (+186423us) service_pool.cc:224] Handling call
0709 13:12:03.189482 (+   654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.189755 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:04.508946 (+1319191us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.163209 (+654263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.181376 (+ 18167us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:05.196399 (+ 15023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.206827 (+ 10428us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.207009 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":791649,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":11321,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8964,"thread_start_us":1859374,"threads_started":2}
I20260709 13:12:05.296281 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:05.318058 28578 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:05.322355 31610 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:12:05.324218 31369 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:05.325547 31585 consensus_meta.cc:287] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.542s	user 0.018s	sys 0.000s
I20260709 13:12:05.303272 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:05.281123 31559 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.230623 31349 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:05.294260 31554 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.871s	user 0.018s	sys 0.004s
I20260709 13:12:05.336100 29251 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:05.269531 31477 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:05.342410 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:05.344309 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47610.5us
I20260709 13:12:05.267458 31571 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:05.343674 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 294450us
I20260709 13:12:05.283540 31529 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:05.348953 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.326020 31585 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:05.352478 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 58469.4us
I20260709 13:12:05.285077 31513 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:05.348250 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:05.326195 31423 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.347704 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:05.347726 31281 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:05.355873 31609 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:12:05.359483 29256 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:05.288314 31560 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.336617 28479 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:05.365593 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.369535 28696 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:05.368462 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75286.2us
I20260709 13:12:05.344882 31536 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:05.379617 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:05.389238 28479 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 4 to 5, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:05.392768 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 114757us
I20260709 13:12:05.361698 31592 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.340109 31554 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.392884 28653 raft_consensus.cc:2410] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:05.341684 31568 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:05.396420 28655 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:12:05.379592 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:05.398948 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 106263us
I20260709 13:12:05.418071 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:05.418915 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1604) took 1874 ms. Trace:
I20260709 13:12:05.364503 31476 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:12:05.425858 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.426441 31476 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:05.427033 31476 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:05.427497 31476 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.428013 31613 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:12:05.429105 31613 consensus_queue.cc:1243] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:05.430322 31477 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:05.454429 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 235416us
I20260709 13:12:05.396214 31525 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:05.439893 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:05.459630 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 86340us
I20260709 13:12:05.402093 31608 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:05.461658 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46473.6us
I20260709 13:12:05.461772 28696 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:05.404152 28479 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:05.455052 31609 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:12:05.466868 28730 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.012s
I20260709 13:12:05.473896 28730 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:05.463380 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:05.470180 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:05.629545 28647 raft_consensus.cc:2368] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4.
I20260709 13:12:05.415402 31558 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.631917 31513 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:05.633838 31568 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:05.636840 31560 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.637559 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.638434 28647 raft_consensus.cc:2368] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:12:05.638685 31571 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.639307 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.640174 28647 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:05.641094 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.641604 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.642014 29260 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:05.642913 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.643141 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.644117 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.601071 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.528772 31420 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:05.419668 28725 rpcz_store.cc:276] 0709 13:12:03.544438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.684118 (+139680us) service_pool.cc:224] Handling call
0709 13:12:03.684490 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.684731 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:04.408534 (+723803us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.395561 (+987027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.406643 (+ 11082us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:05.418340 (+ 11697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.418588 (+   248us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.418832 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3654,"prepare.queue_time_us":401575,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":86719,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":21021,"thread_start_us":1658501,"threads_started":3,"wal-append.queue_time_us":954317}
I20260709 13:12:05.529305 28724 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:05.515417 28648 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.513s	user 0.014s	sys 0.000s
I20260709 13:12:05.528978 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:05.463909 31608 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.530042 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.471527 31592 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.604218 31627 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.462738 31628 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.464231 31525 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.505889 28479 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 3 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:05.624456 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 120744us
I20260709 13:12:05.606236 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:05.604552 31620 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:12:05.592401 31612 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:12:05.584656 31536 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:05.607825 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:05.602116 29256 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:05.583518 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:05.576426 31577 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.681s	user 0.012s	sys 0.010s
I20260709 13:12:05.569416 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:05.627934 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:05.632051 31622 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:12:05.637719 31619 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:12:05.644214 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.461222 31387 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:12:05.568851 31381 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:05.594857 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:05.730854 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 355413us
I20260709 13:12:05.667047 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:05.644853 28654 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
W20260709 13:12:05.743907 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 76985.7us
I20260709 13:12:05.743288 28653 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:05.648126 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:05.743417 28648 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:05.743103 28652 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.742661 29255 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.744076 29251 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:05.746927 28647 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:05.650473 28727 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.001s
I20260709 13:12:05.748983 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.749704 28649 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:05.749368 28479 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 4 to 6, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:05.751050 28479 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 3, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 3 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:05.758131 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 294813us
W20260709 13:12:05.632848 31486 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.733s	user 0.019s	sys 0.001s
I20260709 13:12:05.760732 28727 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:05.625274 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.769753 28648 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:05.799384 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 117339us
I20260709 13:12:05.800405 28655 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:05.761288 29255 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:05.727999 31369 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.685076 31513 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:05.830629 29256 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:05.807152 28656 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:05.632882 31349 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.842175 28479 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 3, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.729472 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 703) took 1204 ms. Trace:
I20260709 13:12:05.769793 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.848635 28653 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:05.730962 31477 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:05.699582 31585 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.802913 28654 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:05.800699 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 212499us
I20260709 13:12:05.746414 31525 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.742518 31628 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:05.832266 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 438014us
I20260709 13:12:05.854158 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:05.746850 31592 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.867902 31592 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.830991 31381 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:05.808204 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 390204us
I20260709 13:12:05.832543 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.759992 31387 consensus_queue.cc:1243] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:05.803282 31369 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:05.833205 31420 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.758147 31560 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.835989 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:05.911936 28655 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
W20260709 13:12:05.836489 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.841915 31615 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:12:05.844058 28479 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 4, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 4 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:05.916901 28479 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.730248 31554 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.746723 31608 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.647197 31184 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:05.849968 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:05.850660 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51798.5us
W20260709 13:12:05.852164 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49872.6us
I20260709 13:12:05.844841 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:05.848150 28573 rpcz_store.cc:276] 0709 13:12:04.525706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.558666 (+ 32960us) service_pool.cc:224] Handling call
0709 13:12:05.729280 (+1170614us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400165154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:05.729403 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019691392}
I20260709 13:12:05.857575 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.857802 31548 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:05.858331 31613 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:05.860600 31476 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.861615 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:05.862102 31513 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:05.864203 31558 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:05.865137 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1755) took 1132 ms. Trace:
I20260709 13:12:05.865491 31562 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:05.866084 31628 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.865860 31525 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.866356 31529 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.854775 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:05.937686 29256 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:05.801954 31134 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:05.758324 31536 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:05.909912 28647 raft_consensus.cc:2410] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:05.914471 28652 raft_consensus.cc:2410] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:12:05.920315 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61852.3us
I20260709 13:12:05.909984 31369 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.924062 28479 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:05.924324 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:05.924837 28622 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:05.909406 31420 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.911495 31560 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.912487 31635 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.911525 31477 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:05.928746 31625 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:12:05.942735 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:05.945689 29253 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:05.946110 31637 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:05.946535 31525 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:05.946934 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:05.949738 31381 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:05.951531 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 150171us
I20260709 13:12:05.998588 31618 raft_consensus.cc:2764] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:05.952229 31629 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:05.999398 31629 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:05.999775 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.000206 31629 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:05.953791 31606 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.497s	user 0.005s	sys 0.001s
I20260709 13:12:05.934245 28650 rpcz_store.cc:276] 0709 13:12:04.669668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.676356 (+  6688us) service_pool.cc:224] Handling call
0709 13:12:04.676959 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.677385 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:05.132656 (+455271us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.348921 (+216265us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.717779 (+368858us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b180034c5a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:12:05.801377 (+ 83598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.801427 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:05.801473 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.801539 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.801638 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369544,"prepare.queue_time_us":551811,"prepare.run_cpu_time_us":211,"prepare.run_wall_time_us":2570,"raft.queue_time_us":414879,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":15474,"spinlock_wait_cycles":9379456,"thread_start_us":719920,"threads_started":3,"wal-append.queue_time_us":668863}
I20260709 13:12:06.001494 31349 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:05.959914 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.002229 31349 consensus_queue.cc:1243] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:12:06.002725 31349 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:05.961748 31626 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.927002 31548 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:06.004105 31626 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.005275 31618 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:06.004598 31548 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.006554 31626 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:06.006835 31548 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.009720 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:06.011687 28721 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:06.012223 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.013557 31571 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:05.975653 31568 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:05.964892 28581 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
W20260709 13:12:05.975811 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51598.7us
I20260709 13:12:06.020128 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:06.021382 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:06.021626 31505 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:05.915977 31159 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.979171 28479 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.980613 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:05.970247 31134 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:05.989029 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46397us
I20260709 13:12:05.991320 31476 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:05.991768 31536 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:05.993876 31513 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:05.977778 31560 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.975478 31420 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.035808 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.995443 31477 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:05.996470 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 134952us
I20260709 13:12:05.997669 31635 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:06.068759 31494 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:06.069286 31494 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:06.070299 31494 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.070834 31635 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:05.937379 31577 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.013068 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:06.071717 31494 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.037374 31625 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:06.073488 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:06.035949 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.075186 28576 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
W20260709 13:12:06.030910 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55287.1us
I20260709 13:12:06.033949 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:05.984441 31554 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:06.034909 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.031623 31134 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:06.048027 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:06.048537 28721 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:06.084548 29256 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:06.034065 31582 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:06.085753 31582 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.086202 31582 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.051156 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:06.089617 29257 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:06.028955 31565 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:06.090613 31565 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:06.091648 31565 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.037784 31486 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:12:06.093784 31486 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:06.094193 31486 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:06.093880 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:06.094955 28727 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:06.095028 31486 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:06.096599 31486 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.056020 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:06.065711 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:06.097295 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2373) took 1195 ms. Trace:
I20260709 13:12:06.032189 31159 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.097728 28581 rpcz_store.cc:276] 0709 13:12:04.901822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.917125 (+ 15303us) service_pool.cc:224] Handling call
0709 13:12:06.097141 (+1180016us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54003520d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:06.097239 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907110656}
I20260709 13:12:06.098593 31558 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:06.067209 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 214640us
I20260709 13:12:06.099349 28724 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:06.100024 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:06.067477 31624 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:12:06.001533 31629 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.072716 31625 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:06.102212 31625 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.056655 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.084439 31554 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:06.105763 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49206.4us
I20260709 13:12:06.106143 31554 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.066154 31369 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:06.107359 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.108230 31505 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:06.108601 31505 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:06.054216 31184 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:06.097436 28696 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:06.112418 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.081522 31513 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:12:06.095764 31560 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.137305 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.137979 28647 raft_consensus.cc:2376] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4. Re-sending same reply.
I20260709 13:12:06.138929 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:06.139213 31560 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:06.139472 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.139199 31627 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.140251 28652 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:06.109319 31369 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:06.141422 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75860.3us
I20260709 13:12:06.117734 28649 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:12:06.134160 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:06.136243 28651 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:06.136822 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:06.146752 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49396.7us
I20260709 13:12:06.140955 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:06.151161 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:06.151422 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.151181 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.155473 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.156183 28656 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:06.157258 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.158941 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.108970 31505 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.114801 31525 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:06.165746 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:06.165894 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:06.162701 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.099359 31159 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:06.151988 28575 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:06.298789 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.168525 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:06.267639 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.254153 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:06.155541 31560 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:06.195648 31571 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:06.269546 28653 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:06.196086 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:06.246031 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 76067.2us
I20260709 13:12:06.246520 28574 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:06.236399 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:06.280131 28724 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:06.247500 31562 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:12:06.165275 31559 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:06.168242 31568 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:06.287882 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.334164 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:06.336637 29255 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:06.288976 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.290097 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.338127 28651 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
W20260709 13:12:06.291527 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.291872 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.339272 28648 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:06.293224 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.296483 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.297480 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.245347 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:06.319226 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:06.329986 28656 raft_consensus.cc:2376] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4. Re-sending same reply.
I20260709 13:12:06.165791 31525 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:06.346237 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 246329us
I20260709 13:12:06.347369 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.347990 28647 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:06.162570 31558 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:12:06.332201 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.275202 31638 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:06.331842 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 77773.7us
I20260709 13:12:06.333933 31536 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:06.354137 29251 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:06.354939 29259 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:06.291062 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.355929 28649 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:06.248608 31592 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.275805 31494 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:06.338228 28654 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:06.357560 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:06.361161 29258 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:12:06.357128 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 59802.4us
I20260709 13:12:06.355741 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.364223 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.373857 28649 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:06.372851 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:06.354466 31536 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.332459 31571 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:06.345829 31568 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.334681 31560 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:06.386871 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.385495 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.354002 31638 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:06.391382 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:06.391934 29260 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.377614 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.384438 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:06.392629 28572 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:06.377960 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.352943 31525 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.345590 31559 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:06.388500 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:06.390733 28726 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:06.393544 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:06.385627 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 107197us
I20260709 13:12:06.377552 31635 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:06.396160 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:06.398368 28575 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:06.399415 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:06.376006 31494 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.406318 31494 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:06.406992 31560 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.403012 29253 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:06.409961 31420 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:06.410446 31645 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:12:06.411530 28724 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:06.412017 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.412576 31420 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:06.391170 31618 raft_consensus.cc:2764] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:06.414233 31554 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:06.386428 31536 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.414706 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.427701 31592 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:06.427546 31582 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.429183 31281 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:06.428895 31638 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:06.429589 31281 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:06.429962 31638 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.430873 28575 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:06.432090 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:06.394547 31558 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:06.433332 31558 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.433517 28574 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:06.433810 31558 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.434403 28730 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:06.435423 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:06.391153 31568 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:06.436019 28722 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.413269 31642 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:06.437788 28572 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:06.401505 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:06.436717 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:06.449630 29260 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:06.451596 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.451802 31529 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.452491 28656 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:06.452800 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52514.4us
I20260709 13:12:06.454907 28721 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:06.458372 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:06.458957 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 70529.7us
I20260709 13:12:06.415598 31626 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:06.465618 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 86598.5us
I20260709 13:12:06.388105 31608 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.462064 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:06.403280 31635 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:06.463251 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:06.429980 31281 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.473758 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:06.373697 31628 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.466987 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:06.472617 28580 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:12:06.454542 31618 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.480783 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:06.481635 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:06.482929 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:06.484221 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 82780.4us
I20260709 13:12:06.486138 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.486784 29254 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:06.486948 28656 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:06.492733 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:06.480281 31652 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 13:12:06.494395 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:06.466298 31626 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:06.495823 28727 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:06.499703 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.508822 28622 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:06.509481 28728 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:06.510054 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:06.511557 31477 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:06.512053 31477 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.512460 31477 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.515219 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 1620) took 1374 ms. Trace:
I20260709 13:12:06.515658 28726 rpcz_store.cc:276] 0709 13:12:05.140477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.177723 (+ 37246us) service_pool.cc:224] Handling call
0709 13:12:06.514970 (+1337247us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54000a69d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:06.515120 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258435328}
I20260709 13:12:06.517215 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:06.518206 28723 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:06.519140 31635 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.520576 31635 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:06.521373 31655 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.156s	user 0.000s	sys 0.009s
I20260709 13:12:06.507541 31559 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:06.523873 28730 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:06.511792 31651 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:12:06.526298 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:06.523322 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:06.531385 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:06.535368 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:06.528143 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:06.465231 31571 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:06.485093 31562 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:12:06.496004 31134 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.496802 31184 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.563172 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:06.496847 31637 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:06.565341 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:07.214865 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:07.210103 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 710409us
W20260709 13:12:06.567137 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44025.2us
W20260709 13:12:07.041163 28572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.005s	sys 0.007s
W20260709 13:12:07.237613 28572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.006s	sys 0.012s
I20260709 13:12:06.716867 28730 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 3.
I20260709 13:12:07.238992 28728 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:06.794973 28573 consensus_meta.cc:287] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:12:07.240682 28573 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
W20260709 13:12:06.875592 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 379498us
I20260709 13:12:07.245625 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:12:07.209666 28722 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.773s	user 0.009s	sys 0.003s
I20260709 13:12:07.249270 28722 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
W20260709 13:12:06.775979 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 277525us
I20260709 13:12:07.210455 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:07.209883 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.564368 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.214843 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:06.564234 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:06.571419 28578 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:07.252061 28649 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:07.252223 28650 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.235543 28727 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:06.560632 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.507431 31626 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:07.256649 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.265240 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:07.261642 28579 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.009s	sys 0.012s
I20260709 13:12:07.211225 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:07.265254 28545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.023s	sys 0.057s
W20260709 13:12:07.267323 28545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.024s	sys 0.057s
W20260709 13:12:07.267055 28579 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.009s	sys 0.012s
I20260709 13:12:06.537810 31582 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:07.141650 31536 consensus_meta.cc:287] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.001s
I20260709 13:12:07.265992 28649 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:06.561107 31577 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:06.559674 31349 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:06.924698 31505 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.728s	user 0.005s	sys 0.005s
W20260709 13:12:07.204548 31281 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.000s
I20260709 13:12:07.275619 28576 raft_consensus.cc:2368] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
W20260709 13:12:07.157243 31660 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.303s	user 0.000s	sys 0.002s
W20260709 13:12:06.674585 31652 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:12:06.783754 31486 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:06.546316 31369 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.325310 31536 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.343382 31536 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:07.343653 31525 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.944s	user 0.008s	sys 0.000s
I20260709 13:12:07.344012 31536 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.344162 31525 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.601145 31585 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:12:07.309774 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 427189us
I20260709 13:12:07.142196 31608 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:07.253387 31571 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.090097 31628 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.250197 31642 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:07.312331 28725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.013s	sys 0.015s
W20260709 13:12:07.312628 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 66595.8us
W20260709 13:12:07.364980 28725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.013s	sys 0.016s
I20260709 13:12:06.546641 31627 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:07.314090 29254 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:07.315910 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 79180.7us
I20260709 13:12:06.566999 31629 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.716s
I20260709 13:12:06.567240 31632 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.716s
I20260709 13:12:07.268508 31654 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:07.321251 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 112240us
W20260709 13:12:07.311426 31635 consensus_meta.cc:287] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.790s	user 0.003s	sys 0.007s
I20260709 13:12:06.655064 31558 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:06.681717 31658 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.786s
I20260709 13:12:07.325845 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:07.327143 28726 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.010s	sys 0.026s
W20260709 13:12:07.384804 28726 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.010s	sys 0.027s
I20260709 13:12:06.545881 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:07.326936 31349 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.387677 31349 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:07.389451 31618 consensus_meta.cc:287] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.905s	user 0.011s	sys 0.000s
I20260709 13:12:07.389847 31618 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.323199 31577 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:07.391448 31626 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.392432 31577 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.393713 28729 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.341198 31369 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.575408 31529 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.311585 31613 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:07.344524 31536 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.371565 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:07.382401 31632 consensus_queue.cc:1243] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:07.365849 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:07.333734 31281 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.340415 31486 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:07.377971 28577 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:07.331982 31505 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.330925 31582 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:12:07.253355 31625 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:12:07.433343 28581 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:07.385712 28727 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:07.386612 28650 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:07.365574 31494 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:12:07.382102 31184 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:12:07.433343 28724 pending_rounds.cc:85] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 4
I20260709 13:12:07.439546 28724 pending_rounds.cc:107] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 3.5
W20260709 13:12:07.382074 31568 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.917s	user 0.010s	sys 0.001s
I20260709 13:12:07.403226 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.403661 28655 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:07.405129 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:07.369580 31627 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.385474 28580 raft_consensus.cc:606] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.406163 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:07.394106 31577 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.383208 31585 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.413611 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:07.372272 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:07.424320 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 167988us
W20260709 13:12:07.424732 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 174467us
I20260709 13:12:07.402132 31369 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.425629 31420 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:12:07.432682 31486 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:07.436923 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:07.438665 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 76021.3us
I20260709 13:12:07.440747 28722 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.462248 28650 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:07.463050 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 49568us
I20260709 13:12:07.439822 28724 raft_consensus.cc:2889] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:07.444329 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:07.370316 31638 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.940s	user 0.021s	sys 0.003s
I20260709 13:12:07.398187 31654 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:12:07.436399 31662 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:12:07.482115 28656 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:07.482709 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.483843 28721 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:12:07.460855 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 88639.7us
I20260709 13:12:07.427831 31618 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.465407 28727 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:12:07.465607 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:07.452448 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:07.438881 31582 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.436132 31665 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:07.438344 31281 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.435421 31505 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.488325 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.449520 31627 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.502637 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.503049 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:07.501982 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:07.504618 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.501609 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.506992 28728 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:07.461916 31134 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.510747 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.467861 31629 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.442265 31568 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:07.544317 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.542219 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:07.543000 28730 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:07.473970 31681 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.503548 31486 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:07.551928 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 86384.2us
I20260709 13:12:07.516304 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.503744 31638 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:07.500936 31665 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:07.551131 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48148.5us
I20260709 13:12:07.554188 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1626) took 1064 ms. Trace:
I20260709 13:12:07.555706 28727 raft_consensus.cc:2410] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:07.551424 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:07.556695 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.556838 28650 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:07.487617 31626 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.469972 31585 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.566133 28722 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:07.500222 31558 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.515167 31281 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:07.507861 31680 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:07.554715 28726 rpcz_store.cc:276] 0709 13:12:06.489443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.516679 (+ 27236us) service_pool.cc:224] Handling call
0709 13:12:06.527353 (+ 10674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:06.662517 (+135164us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:07.395255 (+732738us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.546025 (+150770us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.553723 (+  7698us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:07.553773 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:07.553823 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.553898 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.554132 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7431,"prepare.queue_time_us":246017,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":36409,"spinlock_wait_cycles":8576,"thread_start_us":689687,"threads_started":2}
I20260709 13:12:07.548511 31608 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.583868 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.552428 31618 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:07.575446 31281 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:07.590951 31671 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:12:07.591013 31281 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.592484 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 860) took 1194 ms. Trace:
I20260709 13:12:07.587808 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.596119 28728 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:07.511021 31613 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:12:07.598248 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.592880 28725 rpcz_store.cc:276] 0709 13:12:06.397928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.398086 (+   158us) service_pool.cc:224] Handling call
0709 13:12:06.436757 (+ 38671us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:06.464810 (+ 28053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.464861 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:06.485298 (+ 20437us) log.cc:844] Serialized 52 byte log entry
0709 13:12:07.365510 (+880212us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:07.365556 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.365628 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.592250 (+226622us) raft_consensus.cc:1685] finished
0709 13:12:07.592274 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.592428 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":571,"raft.queue_time_us":8422,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":13468,"thread_start_us":841956,"threads_started":1,"wal-append.queue_time_us":843060}
I20260709 13:12:07.598938 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.599514 29260 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.601049 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:07.574848 31525 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.565474 31679 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:07.604310 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.575630 31680 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:07.613026 28578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 711) took 1468 ms (client timeout 1895 ms). Trace:
I20260709 13:12:07.586185 31681 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.610221 29254 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:07.611569 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.594470 31618 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.565791 31638 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:07.621565 31669 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:12:07.622141 31663 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:12:07.623365 31638 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:07.613584 28578 rpcz_store.cc:269] 0709 13:12:06.144211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.153642 (+  9431us) service_pool.cc:224] Handling call
0709 13:12:07.612828 (+1459186us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b54001f8954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:07.612945 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196848384}
I20260709 13:12:07.615197 31680 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.608984 31536 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:07.609094 31661 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:12:07.609283 31665 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.621227 31618 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:07.621593 31653 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.113s	user 0.002s	sys 0.011s
I20260709 13:12:07.605636 31688 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:12:07.616155 31477 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.103s	user 0.007s	sys 0.007s
I20260709 13:12:07.640944 31477 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.643023 31668 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.643299 31477 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.643621 31668 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.644343 31585 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.625638 31681 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.646855 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1262) took 1271 ms. Trace:
I20260709 13:12:07.605998 31685 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:12:07.647379 29256 rpcz_store.cc:276] 0709 13:12:06.375343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.393042 (+ 17699us) service_pool.cc:224] Handling call
0709 13:12:06.400377 (+  7335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.400737 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.400755 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.401188 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.544965 (+143777us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:06.545031 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.545117 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.646580 (+1101463us) raft_consensus.cc:1685] finished
0709 13:12:07.646601 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.646775 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":374,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":44771,"thread_start_us":86761,"threads_started":1,"wal-append.queue_time_us":877826}
I20260709 13:12:07.648909 31685 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:07.649391 31685 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:07.650257 31685 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.651957 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:07.652544 31568 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.623430 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 937) took 1297 ms. Trace:
I20260709 13:12:07.653973 29255 rpcz_store.cc:276] 0709 13:12:06.326256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.390091 (+ 63835us) service_pool.cc:224] Handling call
0709 13:12:06.390403 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.444737 (+ 54334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.444774 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.451885 (+  7111us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.787724 (+335839us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:06.787782 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.787881 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.623186 (+835305us) raft_consensus.cc:1685] finished
0709 13:12:07.623209 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.623350 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3364,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":34165,"thread_start_us":335390,"threads_started":1,"wal-append.queue_time_us":979591}
I20260709 13:12:07.618283 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.630520 29252 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:07.626623 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.617201 31679 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:07.660127 31679 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.660836 31668 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.658859 31674 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:07.662204 31674 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:07.663215 31674 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.664680 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2237) took 1102 ms. Trace:
I20260709 13:12:07.665139 28655 rpcz_store.cc:276] 0709 13:12:06.562684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.562908 (+   224us) service_pool.cc:224] Handling call
0709 13:12:07.664455 (+1101547us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540006fed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:07.664580 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342434048}
I20260709 13:12:07.666030 28578 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:12:07.666340 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:07.669122 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.672381 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:07.630991 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.677380 28650 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:07.587682 31582 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:12:07.683930 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2246) took 1112 ms. Trace:
I20260709 13:12:07.684369 28650 rpcz_store.cc:276] 0709 13:12:06.636246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.610712 (+974466us) service_pool.cc:224] Handling call
0709 13:12:07.683871 (+ 73159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:07.634871 29254 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:07.679081 29260 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:07.680639 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:07.690399 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 93285.2us
I20260709 13:12:07.691383 28578 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:07.692605 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.693239 29256 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.694697 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.696177 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:07.679776 31560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.022s	sys 0.039s
I20260709 13:12:07.664935 31674 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:07.697932 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:07.716559 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.701611 28651 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:07.702947 29258 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:07.687976 31668 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:07.750736 28722 raft_consensus.cc:2368] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7.
W20260709 13:12:07.712810 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 446783us
I20260709 13:12:07.752360 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:07.704473 31560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.022s	sys 0.039s
I20260709 13:12:07.759997 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.768699 28650 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:07.761049 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 160074us
I20260709 13:12:07.762319 29256 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:07.670433 31618 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.763805 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.766633 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:07.770082 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 77880.7us
I20260709 13:12:07.771672 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:07.772644 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:07.759191 31568 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:07.768268 31689 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:12:07.776232 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:07.779150 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.782606 29254 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:07.779870 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.764218 31668 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:07.781567 31568 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.786973 31668 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.788300 31568 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:07.789198 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.784538 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.754319 31564 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:12:07.759527 31627 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:07.776785 31477 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:07.796800 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.784893 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.769591 31629 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:07.801424 28725 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:07.777302 31613 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:07.802199 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.805392 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:07.803362 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:07.782191 31505 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:07.806479 29259 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:07.806595 28727 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:07.807080 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.805730 29256 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:07.808657 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.803802 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.811339 28730 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 3.
I20260709 13:12:07.812565 28728 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:07.812743 31477 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:07.813791 31627 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:07.814255 31618 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.813946 31477 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.815670 31681 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.816854 31688 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:07.818408 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.819733 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:07.821296 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:07.821810 31681 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:07.822504 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:07.822269 31349 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.823129 28726 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.823293 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:07.824105 28730 raft_consensus.cc:2410] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:07.826119 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:07.827826 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.831759 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:07.834208 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:07.834501 29259 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:07.834808 28578 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.837563 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:07.838066 28580 raft_consensus.cc:606] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.838346 28580 raft_consensus.cc:614] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:07.838987 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:07.840204 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 59353.6us
I20260709 13:12:07.842257 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.843977 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.844638 29258 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:07.845314 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:07.822515 31681 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:07.848732 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 72449.9us
I20260709 13:12:07.851711 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.854916 28578 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:07.855523 28574 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.856226 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:07.856271 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.844990 31349 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.859220 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:07.859392 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:07.849125 31618 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:07.846812 31688 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:07.860749 28578 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.860918 28572 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.836967 31281 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.861974 31686 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:07.861974 31693 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:07.825440 31680 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.849354 31681 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:07.842852 31568 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.873680 28726 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:07.850591 31585 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:12:07.890282 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.893790 31680 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:07.893966 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.893356 31688 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.894614 28648 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:07.895123 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2239) took 1331 ms. Trace:
I20260709 13:12:07.895666 31281 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.896797 29258 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: [4.7-7.9]
I20260709 13:12:07.878516 31369 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.898015 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2276) took 1602 ms. Trace:
I20260709 13:12:07.898453 28581 rpcz_store.cc:276] 0709 13:12:06.295435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.373169 (+ 77734us) service_pool.cc:224] Handling call
0709 13:12:07.897783 (+1524614us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003511d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:07.897954 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404547968}
I20260709 13:12:07.899585 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:07.899896 31369 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:07.900197 28581 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.901475 28649 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:07.902401 28575 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:07.902647 31657 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.342s	user 0.009s	sys 0.012s
I20260709 13:12:07.901377 31585 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:07.903277 31585 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:07.904136 31585 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:07.874639 31505 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.904945 29252 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:07.905356 31585 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.905310 31505 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:07.906087 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2272) took 1755 ms. Trace:
I20260709 13:12:07.906492 28579 rpcz_store.cc:276] 0709 13:12:06.150347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.150484 (+   137us) service_pool.cc:224] Handling call
0709 13:12:06.244189 (+ 93705us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:06.244599 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.244633 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:06.245290 (+   657us) log.cc:844] Serialized 52 byte log entry
0709 13:12:06.477206 (+231916us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:07.322566 (+845360us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.324772 (+  2206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.324914 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.902059 (+577145us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:07.905790 (+  3731us) raft_consensus.cc:1685] finished
0709 13:12:07.905890 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.906031 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1325,"prepare.queue_time_us":853264,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2070,"raft.queue_time_us":59769,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":21013,"spinlock_wait_cycles":257906048,"thread_start_us":1014935,"threads_started":2,"wal-append.queue_time_us":296944}
I20260709 13:12:07.907933 31505 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:07.895437 28648 rpcz_store.cc:276] 0709 13:12:06.563349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.564984 (+  1635us) service_pool.cc:224] Handling call
0709 13:12:07.893799 (+1328815us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:07.895067 (+  1268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11156352}
I20260709 13:12:07.910472 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.911433 28648 raft_consensus.cc:2368] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:12:07.902534 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.911918 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:07.912305 28654 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:07.912693 29259 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:07.912935 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2233) took 1351 ms. Trace:
I20260709 13:12:07.914712 28655 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:07.870935 31625 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:07.916858 28620 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:07.913416 28654 rpcz_store.cc:276] 0709 13:12:06.561293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.567322 (+  6029us) service_pool.cc:224] Handling call
0709 13:12:07.902376 (+1335054us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:07.912850 (+ 10474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10461440}
I20260709 13:12:07.917796 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.921231 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 871) took 1455 ms. Trace:
I20260709 13:12:07.922348 28648 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 3: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:07.922086 28724 rpcz_store.cc:276] 0709 13:12:06.466222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.486354 (+ 20132us) service_pool.cc:224] Handling call
0709 13:12:06.499471 (+ 13117us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:07.503137 (+1003666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.503172 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:07.510689 (+  7517us) log.cc:844] Serialized 52 byte log entry
0709 13:12:07.613060 (+102371us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:07.613103 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.914434 (+301331us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400127fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:07.914504 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.914552 (+    48us) raft_consensus.cc:1685] finished
0709 13:12:07.914569 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.921160 (+  6591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31408,"raft.queue_time_us":14038,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7750,"spinlock_wait_cycles":2138045184,"thread_start_us":47118,"threads_started":1,"wal-append.queue_time_us":141489}
I20260709 13:12:07.878839 31681 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.925266 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.926062 28648 raft_consensus.cc:2368] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5.
I20260709 13:12:07.890026 31571 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:07.929075 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.931167 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:07.921209 31577 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:12:07.914233 31693 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:07.934959 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:07.932025 28648 raft_consensus.cc:2376] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5. Re-sending same reply.
I20260709 13:12:07.921418 31686 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.937420 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.937920 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:07.941637 28578 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:07.943953 28654 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:07.945434 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:07.951485 31672 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:07.944556 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:07.951987 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:07.952895 31672 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.954990 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:07.955778 31642 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.948094 31618 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.958936 31349 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:07.966734 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.966485 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:07.968529 28648 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.978389 31678 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:12:07.960116 31693 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:07.966420 31625 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:07.934048 31369 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:07.936590 31571 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:07.995287 28620 leader_election.cc:400] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7.
I20260709 13:12:07.995716 28620 leader_election.cc:403] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:07.995584 28572 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:07.996948 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.004202 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.006562 28648 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:07.961373 31679 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.983659 31625 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:08.008883 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:08.008108 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.010046 28648 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:08.010532 28581 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:08.012266 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.007323 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:08.013188 28648 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:08.008421 31679 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:07.973963 31618 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:08.013512 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 162436us
I20260709 13:12:07.942456 31627 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:12:08.018787 28726 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:08.019213 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:08.021638 28730 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:12:08.016637 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.022624 31700 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:08.024577 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:08.026330 28726 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.027318 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:08.029961 28724 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.027565 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:08.031116 28728 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:08.008980 31559 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:08.008766 31369 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:08.040666 31369 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.045248 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.047802 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.011442 31638 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.049230 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.050069 28647 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:12:08.013883 31679 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:08.075539 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.076464 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.029714 31568 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:08.086164 28576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2273) took 1918 ms. Trace:
I20260709 13:12:08.076144 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:08.050683 28647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2235) took 1488 ms (client timeout 1553 ms). Trace:
I20260709 13:12:08.045969 31618 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:08.092410 28647 rpcz_store.cc:269] 0709 13:12:06.562048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.567592 (+  5544us) service_pool.cc:224] Handling call
0709 13:12:08.048630 (+1481038us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:08.050621 (+  1991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12716160}
I20260709 13:12:08.050683 31700 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:12:08.089485 28654 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:08.054009 31559 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:08.092962 28724 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:08.049257 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.102324 28648 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:08.092252 28576 rpcz_store.cc:276] 0709 13:12:06.167939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.357329 (+189390us) service_pool.cc:224] Handling call
0709 13:12:08.085963 (+1728634us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54001aa754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:08.086106 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080336256}
I20260709 13:12:08.095677 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.100283 28726 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
W20260709 13:12:08.104717 28573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2267) took 2082 ms (client timeout 2168 ms). Trace:
I20260709 13:12:08.085961 31568 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:08.106724 28573 rpcz_store.cc:269] 0709 13:12:06.022405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.025311 (+  2906us) service_pool.cc:224] Handling call
0709 13:12:08.104509 (+2079198us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54003525d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:08.104625 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399721728}
I20260709 13:12:08.088546 31628 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:08.086995 31688 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:08.141443 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 285210us
I20260709 13:12:08.079001 31477 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:12:08.099661 31529 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:08.101344 31686 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7.
I20260709 13:12:08.145249 31627 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.153156 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:08.082158 31558 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.148165 31568 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.169283 31134 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:08.170163 31134 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:08.171227 31666 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:08.145469 31559 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:08.082706 31571 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.176601 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.147915 31628 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:08.185355 28648 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:08.186437 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.187201 28648 raft_consensus.cc:2368] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4.
I20260709 13:12:08.188078 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.188265 31613 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:08.085438 31625 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.196377 31625 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:08.201360 31703 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:12:08.201823 31628 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.171295 31134 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.188781 28648 raft_consensus.cc:2368] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5.
W20260709 13:12:08.178510 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.238075 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:08.239204 28576 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:08.242614 28574 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:08.243110 31369 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.244364 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:08.175909 31529 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:08.204777 31709 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:12:08.248253 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 113634us
I20260709 13:12:08.151230 31692 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:12:08.248785 28573 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:08.203354 31628 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.250372 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.250901 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:08.256110 28648 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:08.252138 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.253469 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:08.256400 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.179852 31688 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.257575 31698 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.258111 31698 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.260324 31710 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:12:08.261870 31705 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:12:08.250658 31477 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:12:08.270074 31558 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:08.270674 31558 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:08.271041 31681 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.271528 31629 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:08.271945 31629 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:08.271641 31558 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.272758 31629 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.272985 31679 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.274112 28727 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:08.274303 31703 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:12:08.275378 28572 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
W20260709 13:12:08.277128 28655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2243) took 1706 ms (client timeout 2164 ms). Trace:
W20260709 13:12:08.277541 28655 rpcz_store.cc:269] 0709 13:12:06.570989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.666123 (+1095134us) service_pool.cc:224] Handling call
0709 13:12:07.897088 (+230965us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b540023e7a8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbf3924 00007f4a2cddc227 00007f4a2cddbab8 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6
0709 13:12:08.276915 (+379827us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b540023e954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:08.277065 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47964672}
I20260709 13:12:08.278591 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.279287 28655 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:08.280136 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.280750 31559 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.282374 31679 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:08.284574 28649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2242) took 1713 ms (client timeout 1903 ms). Trace:
I20260709 13:12:08.261312 31529 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:08.298295 28577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2274) took 2037 ms (client timeout 2200 ms). Trace:
I20260709 13:12:08.299271 28574 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:08.289647 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:08.243677 31369 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.301805 28579 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:08.285041 28649 rpcz_store.cc:269] 0709 13:12:06.570683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.397781 (+827098us) service_pool.cc:224] Handling call
0709 13:12:08.284374 (+886593us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b540006e0d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:08.284516 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060304256}
I20260709 13:12:08.293282 31679 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:08.294145 29260 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:08.295215 31685 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.297304 31710 consensus_queue.cc:1243] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:08.285912 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:08.297230 28656 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2245) took 1725 ms (client timeout 1564 ms). Trace:
I20260709 13:12:08.287276 28695 leader_election.cc:400] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
I20260709 13:12:08.310525 28695 leader_election.cc:403] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:12:08.298717 28577 rpcz_store.cc:269] 0709 13:12:06.261415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.277963 (+ 16548us) service_pool.cc:224] Handling call
0709 13:12:08.298129 (+2020166us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003534d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:08.298244 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2363933568}
I20260709 13:12:08.302781 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.311455 28649 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:12:08.312374 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.313059 28649 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:08.306125 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:08.313596 28726 pending_rounds.cc:85] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 6
W20260709 13:12:08.310452 28656 rpcz_store.cc:269] 0709 13:12:06.571597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.572664 (+  1067us) service_pool.cc:224] Handling call
0709 13:12:08.297061 (+1724397us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540001d1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:08.297162 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565918464}
I20260709 13:12:08.313910 28726 pending_rounds.cc:107] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:12:08.314881 28726 raft_consensus.cc:2889] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.310734 28655 raft_consensus.cc:2368] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5.
I20260709 13:12:08.313895 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.274220 31629 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.316469 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.317975 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.318615 28648 raft_consensus.cc:2368] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:12:08.301476 31688 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.318964 31585 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:08.188823 31613 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.329684 28650 raft_consensus.cc:2410] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:08.319404 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.352092 28648 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:12:08.352458 28695 leader_election.cc:336] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.735s (SENT)
I20260709 13:12:08.331753 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.353061 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.353507 28654 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:08.324618 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:08.354416 28652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2238) took 1791 ms (client timeout 1737 ms). Trace:
I20260709 13:12:08.346009 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.359061 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.321312 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.307729 31672 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.323689 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.361716 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:08.366341 28653 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:08.354914 28652 rpcz_store.cc:269] 0709 13:12:06.563027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.564788 (+  1761us) service_pool.cc:224] Handling call
0709 13:12:08.324466 (+1759678us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:08.354322 (+ 29856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10296576}
I20260709 13:12:08.367430 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.368559 28654 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:08.369091 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:08.369164 28653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2241) took 1805 ms (client timeout 2112 ms). Trace:
I20260709 13:12:08.370203 28656 raft_consensus.cc:2368] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4.
W20260709 13:12:08.370311 28653 rpcz_store.cc:269] 0709 13:12:06.564040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.569114 (+  5074us) service_pool.cc:224] Handling call
0709 13:12:08.323526 (+1754412us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:08.368981 (+ 45455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12604160}
I20260709 13:12:08.371929 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.372694 28653 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:08.373747 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.374390 28653 raft_consensus.cc:2376] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5. Re-sending same reply.
I20260709 13:12:08.375433 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.376152 28653 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:08.377086 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.377955 28653 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:08.379390 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 62035.9us
I20260709 13:12:08.381362 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.383867 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:08.384766 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49570.2us
I20260709 13:12:08.386045 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.386698 28652 raft_consensus.cc:2376] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5. Re-sending same reply.
I20260709 13:12:08.387413 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 864) took 1953 ms. Trace:
I20260709 13:12:08.383285 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.319437 31585 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.324651 31680 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:08.334677 31369 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:08.389267 28653 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:08.328279 31679 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
I20260709 13:12:08.388614 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:08.396225 28575 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:08.387765 28729 rpcz_store.cc:276] 0709 13:12:06.434140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.447146 (+ 13006us) service_pool.cc:224] Handling call
0709 13:12:06.467436 (+ 20290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.394103 (+926667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.387231 (+993128us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54002d9454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:08.387365 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129744768}
W20260709 13:12:08.391505 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 297532us
I20260709 13:12:08.322202 31683 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:08.370165 31685 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:08.396725 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2240) took 1833 ms. Trace:
I20260709 13:12:08.320654 31688 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:08.330425 31681 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:08.406356 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.394289 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.368276 31486 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.400615 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:08.408674 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56241.9us
I20260709 13:12:08.403390 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:08.409354 28695 leader_election.cc:336] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.971s (SENT)
I20260709 13:12:08.409970 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:08.410842 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.404870 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:08.410948 28695 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.992s (SENT)
I20260709 13:12:08.412048 29224 leader_election.cc:400] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:12:08.412078 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.405570 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.323192 31665 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:08.407269 28656 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:08.414743 28649 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:08.401175 28651 rpcz_store.cc:276] 0709 13:12:06.563650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.564768 (+  1118us) service_pool.cc:224] Handling call
0709 13:12:07.641707 (+1076939us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:12:07.641904 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.755017 (+113113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.396543 (+641526us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b540006d6d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:08.396679 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139397632}
I20260709 13:12:08.394778 31513 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:08.415287 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:08.413069 28653 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:08.412477 29224 leader_election.cc:403] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:08.419210 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2256) took 1101 ms. Trace:
I20260709 13:12:08.419348 28654 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:08.419773 28649 rpcz_store.cc:276] 0709 13:12:07.318360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.391396 (+1073036us) service_pool.cc:224] Handling call
0709 13:12:08.419151 (+ 27755us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.393196 31585 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:08.405260 31712 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:12:08.417196 28695 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.994s (SENT)
I20260709 13:12:08.422041 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.423303 28729 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:08.393584 31680 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:08.319644 31637 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:12:08.400761 31683 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:08.448587 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.414932 31693 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:08.426192 28653 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:08.426600 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.429888 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.449472 28651 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:08.417214 31688 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:08.420135 31679 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:08.421638 31369 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:08.425836 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.416664 31632 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:08.452168 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.453115 31688 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:08.453576 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.470600 28652 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:08.471216 28649 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:08.450361 29224 leader_election.cc:400] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5.
I20260709 13:12:08.460387 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.463563 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.472956 28651 raft_consensus.cc:2410] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:08.477505 31683 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.478287 31513 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:08.479193 31683 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.429687 31672 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:08.481289 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 65641.2us
W20260709 13:12:08.484149 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.416962 31486 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.486893 28729 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:12:08.494624 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 44405.8us
I20260709 13:12:08.496405 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.497185 31722 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:08.483282 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:08.497759 31722 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:08.498265 31722 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.498534 31679 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:08.499068 31679 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:08.499922 31679 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.501148 31696 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:12:08.494210 31632 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:08.503507 31632 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.507248 28695 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:08.497798 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.473814 31369 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.511365 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.500662 31698 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:08.514165 29224 leader_election.cc:400] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4.
I20260709 13:12:08.516103 29224 leader_election.cc:403] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:12:08.487155 31694 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:08.514784 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.515071 31536 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:08.519552 31693 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4.
I20260709 13:12:08.517761 31691 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:08.520965 31691 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:08.515483 31715 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.525832 31688 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.475118 31568 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.518121 31694 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:08.529405 31568 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:08.530596 28647 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:08.522059 31691 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.530493 31694 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.532100 31691 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.532423 31694 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.534929 31486 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:08.536064 31723 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:12:08.515671 31369 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.541460 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:08.542541 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:08.593894 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 51432.6us
I20260709 13:12:08.544006 29258 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:08.544440 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:08.544680 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:08.505478 31672 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.548187 28727 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:08.549253 28728 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:08.550907 31627 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.551934 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:08.598842 28656 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.558156 31680 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:08.562460 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48480.1us
I20260709 13:12:08.562891 31683 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:08.560943 31715 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:08.562919 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 48236.7us
I20260709 13:12:08.565827 28580 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:12:08.565737 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:08.567198 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:08.567473 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:08.567731 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:08.616272 28722 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:08.568162 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:08.569072 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:08.570551 28696 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.579447 31559 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.580119 31568 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.581281 31536 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:08.581451 31628 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:08.582204 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 70885.4us
I20260709 13:12:08.592885 29260 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:08.602799 29224 leader_election.cc:400] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5.
I20260709 13:12:08.624313 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.612890 28656 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:08.614722 28580 pending_rounds.cc:85] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 8
I20260709 13:12:08.617039 28721 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:08.616853 28729 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:08.599870 31486 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:08.630352 28580 pending_rounds.cc:107] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:12:08.624960 31568 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.630728 28580 raft_consensus.cc:2889] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.630414 31560 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:08.631263 31560 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:08.631637 31560 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.631850 31585 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.633066 28655 raft_consensus.cc:2368] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7.
I20260709 13:12:08.634027 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:08.634704 28656 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:08.635270 28730 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:08.635490 28656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:12:08.636143 28656 raft_consensus.cc:606] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.636467 28656 raft_consensus.cc:614] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:08.637969 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:08.620586 28723 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:08.638352 31585 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:08.621309 31529 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:08.599395 31629 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:08.639559 31629 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.640085 28656 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:08.641624 31629 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:08.621830 31559 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.643726 31559 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:08.649294 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1789) took 1091 ms. Trace:
I20260709 13:12:08.649725 28656 rpcz_store.cc:276] 0709 13:12:07.557877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.639477 (+1081600us) service_pool.cc:224] Handling call
0709 13:12:08.639791 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.640468 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.649224 (+  8756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.650671 28654 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:08.650781 28656 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:08.651360 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1790) took 1093 ms. Trace:
I20260709 13:12:08.651746 28654 rpcz_store.cc:276] 0709 13:12:07.558207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.650209 (+1092002us) service_pool.cc:224] Handling call
0709 13:12:08.650510 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.651141 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.651306 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.652403 28648 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:08.652998 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1792) took 1094 ms. Trace:
I20260709 13:12:08.653172 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1793) took 1094 ms. Trace:
I20260709 13:12:08.653371 28648 rpcz_store.cc:276] 0709 13:12:07.558737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.651886 (+1093149us) service_pool.cc:224] Handling call
0709 13:12:08.652174 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.652771 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.652951 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.653512 28654 rpcz_store.cc:276] 0709 13:12:07.558940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.652423 (+1093483us) service_pool.cc:224] Handling call
0709 13:12:08.652673 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.652865 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.652888 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:08.652938 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:08.652971 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.653038 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.653127 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.655037 28654 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:08.660907 28654 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:08.629740 31536 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.662217 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:08.663009 29259 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:08.663583 28651 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:08.665655 29258 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:08.667457 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:08.668983 31420 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:08.669502 31420 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:08.670372 31420 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.673445 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:08.619251 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48754us
I20260709 13:12:08.624498 29224 leader_election.cc:403] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:12:08.609652 31680 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.622351 31722 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.675268 31628 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:08.676662 31722 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:08.676859 28650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 691) took 1188 ms (client timeout 1555 ms). Trace:
W20260709 13:12:08.677384 28650 rpcz_store.cc:269] 0709 13:12:07.488675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.808386 (+319711us) service_pool.cc:224] Handling call
0709 13:12:08.645787 (+837401us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b540022b854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:08.645917 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195286400}
I20260709 13:12:08.681358 31713 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:08.681794 31713 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.682139 31713 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.683519 31665 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.684135 31665 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:08.685763 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.686539 28653 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:08.686913 31562 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:08.623515 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.689155 31692 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:08.689543 31692 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:08.690099 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:08.690342 31692 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.691349 31692 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.691499 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:08.692093 28580 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.630569 31486 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.693848 31486 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.695283 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:08.695627 31724 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:12:08.697259 31672 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:08.700287 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:08.700572 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:08.701769 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.701855 31529 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:08.703615 31613 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:08.704049 31529 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:08.632895 31568 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:08.704694 31529 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.706609 31529 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.622792 31627 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.708647 31627 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.716341 31722 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5.
W20260709 13:12:08.721683 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54281.1us
W20260709 13:12:08.731014 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 128372us
I20260709 13:12:08.731848 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:08.732532 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46868us
I20260709 13:12:08.735145 31704 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:08.625875 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:08.737242 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 111471us
I20260709 13:12:08.738497 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.745127 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.737461 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:08.747845 29259 raft_consensus.cc:2410] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:08.651360 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1791) took 1092 ms. Trace:
I20260709 13:12:08.751396 28656 rpcz_store.cc:276] 0709 13:12:07.558499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.650403 (+1091904us) service_pool.cc:224] Handling call
0709 13:12:08.650606 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.651152 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.651306 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.758451 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.802947 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.803316 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1795) took 1244 ms. Trace:
I20260709 13:12:08.803854 28653 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:08.803781 28655 rpcz_store.cc:276] 0709 13:12:07.559365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.316198 (+756833us) service_pool.cc:224] Handling call
0709 13:12:08.803148 (+486950us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540027e054. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:08.803265 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609406848}
I20260709 13:12:08.760211 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:08.805743 28722 raft_consensus.cc:2393] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:12:08.809844 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 78084.8us
W20260709 13:12:08.816378 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.773590 31677 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:08.822310 31558 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:08.822891 31558 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:08.824086 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.822952 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.824477 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:08.825424 28572 raft_consensus.cc:606] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.825986 28572 raft_consensus.cc:614] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:08.828023 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.830895 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.760176 31559 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.774307 31672 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.833948 28729 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:08.790117 31715 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.789777 31683 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.806700 31665 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:08.741952 31562 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:12:08.846979 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.808370 31679 raft_consensus.cc:2764] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:12:08.867260 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 110446us
I20260709 13:12:08.871527 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.752056 31349 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:12:08.825835 31677 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:08.762957 31564 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:12:08.829537 31558 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.820604 31722 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:12:08.873456 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:08.867647 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 110730us
I20260709 13:12:08.802671 31582 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:12:08.851328 31635 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:08.833099 31513 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:12:08.869843 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59193.6us
I20260709 13:12:08.851647 31642 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.861136 31688 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.890309 31711 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
W20260709 13:12:08.891330 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.891512 31562 consensus_queue.cc:1243] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:08.813530 31625 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:12:08.913213 29224 leader_election.cc:400] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5.
I20260709 13:12:08.872453 31627 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:08.880033 31677 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:08.883193 31134 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:08.913021 31726 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:12:08.934757 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:08.885448 31698 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:12:08.870311 31683 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:08.940745 29254 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:12:08.941212 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:08.941772 29255 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.888372 31585 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:12:08.893782 31679 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:08.930375 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 56984.6us
I20260709 13:12:08.922650 29224 leader_election.cc:403] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:08.935335 29256 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:08.947611 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:08.941972 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 57024.1us
I20260709 13:12:08.924676 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:08.949683 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:08.951583 28546 leader_election.cc:400] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7.
I20260709 13:12:08.951905 28546 leader_election.cc:403] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:08.952162 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:08.958060 29257 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:08.936528 31666 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.959206 29254 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:12:08.963461 29254 pending_rounds.cc:85] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 5
I20260709 13:12:08.963718 29254 pending_rounds.cc:107] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:12:08.963897 29254 raft_consensus.cc:2889] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.963929 29260 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:12:08.964354 29260 pending_rounds.cc:85] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 5
I20260709 13:12:08.964615 29260 pending_rounds.cc:107] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:12:08.964846 29260 raft_consensus.cc:2889] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.961799 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:08.926975 31525 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:12:08.969767 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:08.970527 29260 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:08.958086 31369 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:09.005450 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.975993 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63071.4us
I20260709 13:12:08.999040 29255 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:08.960888 31629 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:08.978637 31727 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:08.949417 31562 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:12:08.961707 31679 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:08.960098 31678 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.978154 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:08.960830 31737 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:08.946943 31681 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:12:09.055054 29224 leader_election.cc:400] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
I20260709 13:12:08.979354 31691 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5.
I20260709 13:12:09.001996 31637 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.018246 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:09.034423 31718 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:09.085951 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.097108 29224 leader_election.cc:403] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.065299 31629 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.086622 28580 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:09.101668 31568 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.974180 31735 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:12:09.070922 31577 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.039215 31486 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.125718 28652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:32978
I20260709 13:12:09.137928 28652 raft_consensus.cc:606] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.138276 28652 raft_consensus.cc:614] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:09.099440 31637 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.102564 31565 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7.
I20260709 13:12:09.102878 31629 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.099411 31718 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:09.059894 31477 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:09.134877 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 156796us
W20260709 13:12:09.143044 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 88201.8us
I20260709 13:12:09.143805 29224 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.144042 28622 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:09.128535 31582 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7.
W20260709 13:12:09.135376 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 182104us
W20260709 13:12:09.133051 31728 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:12:09.124738 31737 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.096009 31560 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.151721 29256 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:09.139842 31637 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.123129 29253 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
W20260709 13:12:09.145334 31729 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.272s	user 0.004s	sys 0.003s
I20260709 13:12:09.160562 29224 leader_election.cc:400] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4.
I20260709 13:12:09.161432 29224 leader_election.cc:403] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.141783 31577 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:09.162792 31731 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 13:12:09.163695 31736 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:12:09.163632 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:09.164434 28724 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 2.
W20260709 13:12:09.165402 31742 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:12:09.145910 31718 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.167200 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1794) took 1608 ms. Trace:
I20260709 13:12:09.167549 28648 rpcz_store.cc:276] 0709 13:12:07.559149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.654258 (+1095109us) service_pool.cc:224] Handling call
0709 13:12:08.654586 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.654908 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.654934 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.742406 (+ 87472us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.922076 (+179670us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:08.922123 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.922190 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.166971 (+244781us) raft_consensus.cc:1685] finished
0709 13:12:09.166991 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.167137 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5227,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":97935,"threads_started":1,"wal-append.queue_time_us":198623}
I20260709 13:12:09.148654 31559 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.169669 31577 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.169445 31559 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.170390 31486 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:09.171859 31637 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.151100 31477 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.151114 31745 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:12:09.175802 31637 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.175707 31559 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:09.176446 31738 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:12:09.176920 31749 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:12:09.198597 28654 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:12:09.152968 31568 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:09.177278 31748 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.186909 31560 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.201849 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:09.184866 31477 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.204694 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:09.210819 29260 raft_consensus.cc:2410] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:12:09.208801 29255 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.192339 31681 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:09.223973 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63582.9us
I20260709 13:12:09.240913 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.253469 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:09.258090 29255 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
W20260709 13:12:09.258665 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 411780us
I20260709 13:12:09.213315 31568 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:09.259431 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:09.262540 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:09.260142 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:09.263808 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:09.216367 31683 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.157086 31737 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.243153 31582 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4.
I20260709 13:12:09.155107 31679 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.274093 31568 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.275000 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:09.275683 28723 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:09.268649 31627 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:09.272161 31680 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:09.282511 31529 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.007s
I20260709 13:12:09.267083 31558 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.283041 31529 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.261808 31710 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:09.265713 31477 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:09.286057 31477 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:09.287071 31477 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.252403 31681 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.207957 31748 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.288766 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:09.289079 31665 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:09.289572 31665 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:09.290710 31681 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:09.290482 31665 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.290894 31748 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:09.291898 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:09.292312 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.293203 31722 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.293620 31722 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:09.293704 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.294147 31722 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.295599 31715 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:09.295735 31693 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:09.264377 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:09.264899 31369 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:09.284688 31558 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:09.303611 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.300130 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:09.304975 28654 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:09.306347 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.303050 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:09.309887 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:09.310411 28649 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.266319 31691 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.309230 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:09.315654 28652 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:09.319973 28723 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:09.320474 28721 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:12:09.322047 28724 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:09.313582 31637 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:09.324452 28648 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:12:09.324817 28648 pending_rounds.cc:85] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 5
I20260709 13:12:09.324909 31737 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.325114 28648 pending_rounds.cc:107] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:12:09.307494 31683 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:09.325382 28648 raft_consensus.cc:2889] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:09.326385 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.326972 31665 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.327284 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:09.327845 28655 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:09.332042 31692 consensus_meta.cc:287] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.004s
I20260709 13:12:09.277110 31628 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:12:09.311347 31559 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:12:09.333215 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.316630 29253 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:09.265626 31744 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:12:09.337262 28649 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:09.339968 31629 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.341581 31635 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:09.342226 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:09.346529 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:09.347276 28650 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:09.348218 31688 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:09.372021 31713 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.002s
I20260709 13:12:09.375164 31713 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.375924 31677 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.372001 31718 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.377624 31713 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.362821 31688 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.378520 31677 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:09.378605 31688 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.373775 31637 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:09.373620 31681 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.380707 31681 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.381076 31688 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:09.379110 31718 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:09.382802 31722 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.374256 31683 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:12:09.389308 31529 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.381206 31681 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.439836 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:09.440940 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:09.440867 31718 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:09.442075 31677 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:09.442468 31722 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:09.442608 31677 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:09.442946 31635 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:09.443490 31635 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:09.443966 31635 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.447495 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:09.448407 28728 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:09.443743 31677 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.478987 28722 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:09.480808 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:09.481125 31558 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.481528 28729 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.481637 31558 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.477797 31744 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:12:09.483844 31558 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.501317 28655 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
W20260709 13:12:09.504088 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 210471us
I20260709 13:12:09.504467 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:09.505661 31750 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:09.506352 31750 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:09.507285 31750 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.508674 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:09.509532 28655 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
W20260709 13:12:09.514325 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.522569 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:09.523824 28647 raft_consensus.cc:2410] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:09.526285 31562 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.526845 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:09.527196 31753 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:09.527650 31753 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:09.528692 31753 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.529681 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:09.530679 28648 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:09.535270 31635 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.537423 31629 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:09.538612 31627 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:09.526883 31562 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.542374 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:09.545485 28729 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:09.568027 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:09.569113 28647 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:09.554694 31349 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.572577 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:09.567202 31677 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.598089 28647 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:09.584885 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.605981 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:09.609723 31635 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.613847 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:09.619392 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:09.620309 29257 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:09.643749 31748 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.577528 31349 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.645124 31713 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:09.649659 28580 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:09.654960 31562 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.656569 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:09.628173 31678 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:09.657347 29257 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:09.657401 31678 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.657998 31678 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:09.658387 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:09.659005 28725 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:09.662362 28622 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:09.664467 28647 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:09.669701 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:09.607131 31677 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.677727 31686 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.678320 31686 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.680521 31638 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:09.682540 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:09.681732 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:09.685420 29258 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.680641 31686 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:09.692466 28580 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:12:09.694883 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:09.696803 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:09.698606 29255 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:09.698486 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:09.699069 29255 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:09.699244 28574 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:09.683542 31349 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.699810 29255 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.707785 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:09.708629 28577 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:09.708565 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:09.710026 28576 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:09.665589 31748 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.711843 31681 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.713778 31748 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.715160 31681 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.706670 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:09.707234 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:09.718353 29258 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:09.707950 29255 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.687695 31638 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:09.711233 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.709430 28579 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:09.706463 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:09.708256 31678 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.732594 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:09.733834 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:09.734524 28579 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.735147 31568 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:09.736029 31568 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:09.737949 31559 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:09.738359 31559 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:09.739101 31559 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:09.740173 31559 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.741384 31686 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:09.741755 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:09.743018 31769 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:12:09.743451 31349 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:09.745218 28579 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:09.751824 29255 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:09.720320 31638 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.725220 31369 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:12:09.754994 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.755560 31678 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:09.751191 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:09.757822 29253 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:12:09.757948 28544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.033s	sys 0.024s
W20260709 13:12:09.758473 28544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.033s	sys 0.024s
I20260709 13:12:09.759914 31768 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.760437 31768 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:09.762591 31768 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:09.748359 31349 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.765341 31349 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:09.759923 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.785745 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.788887 29253 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:09.802275 31585 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:09.821355 31748 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.822130 31748 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:09.869649 31773 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:12:10.014657 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.062888 31638 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:10.090669 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.079052 31638 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.095882 31678 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.111479 31564 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.112319 31564 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.115708 31564 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.106532 31536 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:10.135659 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:10.588732 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:10.589212 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.158375 31629 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.159754 31559 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:10.177547 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.795486 31349 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.279639 31638 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:10.343091 31740 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:10.282197 31513 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:10.613410 31513 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.610155 31629 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.616444 31513 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:10.320194 31585 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:10.304057 31642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.009s
W20260709 13:12:10.572005 28579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.011s	sys 0.013s
W20260709 13:12:10.621133 28579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.011s	sys 0.013s
I20260709 13:12:10.580242 31748 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:10.581432 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 785592us
I20260709 13:12:10.616449 31629 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:10.205078 31678 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:10.621057 31642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.006s	sys 0.010s
I20260709 13:12:10.611308 31638 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.611377 31559 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.609884 31536 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.620028 31740 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.622170 31585 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.637338 31786 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.647218 31786 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.648533 31585 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:10.640021 31678 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:10.648655 29256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 963) took 1687 ms (client timeout 1585 ms). Trace:
W20260709 13:12:10.652871 29256 rpcz_store.cc:269] 0709 13:12:08.961393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.961570 (+   177us) service_pool.cc:224] Handling call
0709 13:12:10.648379 (+1686809us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400596354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:10.648531 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426207488}
I20260709 13:12:10.644994 31349 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:10.662308 31740 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.651854 31786 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.662379 31559 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.657888 31638 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.662981 31536 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.662807 31349 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:10.664011 31349 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.666147 31349 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:10.668691 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:10.656049 31585 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.658200 31787 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.670184 31789 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.670492 31740 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.673538 31558 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.672233 31536 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:10.672916 31791 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.672637 31790 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.674892 31789 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.669996 31585 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.677974 31558 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.677563 31740 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.683676 31741 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:10.684104 31741 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:10.684593 31740 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.684629 31558 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.684897 31741 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.686221 31741 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.686729 31585 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:10.679804 31536 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.673235 31787 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.690028 31536 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:10.680466 31790 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.679872 31791 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.711592 31791 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:10.724121 31787 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.746057 31789 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.746342 31694 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:10.746894 31694 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:10.748169 31790 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.747944 31694 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.749504 31694 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.810197 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:10.810489 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:10.810386 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:10.811220 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:10.811772 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:10.812426 28577 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:10.813891 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:10.814529 28574 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:10.825387 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:10.826134 28580 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.835453 28580 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:10.845031 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:10.846810 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:10.848358 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1006) took 1420 ms. Trace:
I20260709 13:12:10.851217 31748 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:10.851879 31748 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:10.854883 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:10.859643 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.33274e+06us
I20260709 13:12:10.861864 31797 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.862604 31797 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:10.864563 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.865445 31797 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.866233 31797 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.866680 31797 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.867110 31797 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.870379 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:10.871655 28655 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:10.872359 31798 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:10.872907 31798 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:10.873843 31798 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.874629 31748 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.848788 29259 rpcz_store.cc:276] 0709 13:12:09.428208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.428399 (+   191us) service_pool.cc:224] Handling call
0709 13:12:09.428799 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.429112 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:09.479575 (+ 50463us) log.cc:844] Serialized 14 byte log entry
0709 13:12:09.490035 (+ 10460us) log.cc:844] Serialized 14 byte log entry
0709 13:12:10.847801 (+1357766us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b1800397000. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:12:10.847984 (+   183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:10.848038 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:10.848087 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.848155 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.848294 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":433,"prepare.queue_time_us":56112,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":1368561,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":2902,"spinlock_wait_cycles":3091328}
I20260709 13:12:10.879560 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:10.886508 31753 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.888278 31797 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:10.889914 31420 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:12:10.897927 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1809) took 2334 ms. Trace:
I20260709 13:12:10.898239 31797 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.898345 28653 rpcz_store.cc:276] 0709 13:12:08.563760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.687375 (+123615us) service_pool.cc:224] Handling call
0709 13:12:08.803685 (+116310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.815946 (+ 12261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.897729 (+2081783us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54003a93d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:10.897869 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266837760}
I20260709 13:12:10.899394 31797 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.899865 31797 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.891903 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:10.898315 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:10.903052 28655 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.903314 31790 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:10.903610 31642 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:10.892537 31796 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:10.905934 31796 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.907675 31797 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:10.908071 31796 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:10.908293 31797 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:10.903707 31790 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.909086 31790 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.909394 31797 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:10.909776 31797 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:10.910036 28655 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:10.910593 31797 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.911953 31797 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.913798 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:10.927634 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:10.932253 29260 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:10.934482 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:10.935676 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:10.936254 29260 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:10.943888 28648 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:12:10.944379 28648 pending_rounds.cc:85] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 3
I20260709 13:12:10.944597 28648 pending_rounds.cc:107] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:12:10.944820 28648 raft_consensus.cc:2889] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:10.950157 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:10.951303 28651 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:10.956411 31797 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:10.957437 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:10.976102 31793 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:10.961229 31792 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.978674 31792 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.976684 31793 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:10.981844 31793 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.982512 29256 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:10.983664 31787 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.984221 31787 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:10.986533 31787 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:10.968587 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:10.987109 31787 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.987324 28722 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.987663 31787 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:10.973464 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:10.996315 31792 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.003631 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:11.009130 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:10.922881 31748 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:11.025027 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:11.042706 28652 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:12:11.016649 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.045460 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:11.063624 28729 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:12:11.059981 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50982us
I20260709 13:12:11.095726 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:11.054343 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:11.097529 28656 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:11.080892 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.090962 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:11.104559 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.105297 28580 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:11.105561 28729 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:11.106853 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.107062 28722 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:11.107744 28729 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:11.082996 31791 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.117609 28652 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:11.040042 31750 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:11.114916 31638 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:11.119746 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.108649 31349 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:11.104220 31786 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:12:11.126287 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:11.075057 31718 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:11.181092 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 100239us
I20260709 13:12:11.189903 28579 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:11.173792 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:11.078172 31792 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.066576 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:11.202212 28648 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.127758 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.182404 28656 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:11.204376 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:11.205801 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:11.207026 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:11.183018 28729 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:11.164311 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:11.187475 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 57600.5us
I20260709 13:12:11.187738 28654 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:11.064896 31748 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:11.078289 31740 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:11.078255 31789 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.122052 31791 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.039974 31642 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.042078 31536 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:11.177269 28621 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.668s (SENT) [suppressed 47 similar messages]
I20260709 13:12:11.211001 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.065578 31796 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:11.263542 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.257403 31740 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.264539 28729 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:11.258734 28649 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:11.265800 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.266903 28729 raft_consensus.cc:2410] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:11.263049 31796 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.267876 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:11.268607 28729 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:11.255585 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:11.187548 31787 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.200984 31741 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.269873 28652 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
W20260709 13:12:11.270355 28547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.139s	user 0.016s	sys 0.023s
I20260709 13:12:11.213140 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.271833 28722 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:11.273111 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.275876 28648 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
W20260709 13:12:11.254122 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 130520us
W20260709 13:12:11.288992 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 98299.4us
I20260709 13:12:11.289302 28652 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:11.289121 28648 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:11.188100 31638 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.186722 31750 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:11.285049 28547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.154s	user 0.017s	sys 0.023s
W20260709 13:12:11.298549 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 2.1675e+06us
I20260709 13:12:11.297817 28648 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:11.209286 31718 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.269737 31793 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:11.299849 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 171896us
I20260709 13:12:11.266301 31740 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.299602 31748 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.306793 28648 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:11.316668 28722 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:11.310235 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.305747 31812 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:12:11.310088 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:11.319032 28728 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:11.307767 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.320276 28728 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:11.320853 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.321959 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.323741 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:11.262079 31789 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:11.332015 28547 connection.cc:256] RPC call timeout handler was delayed by -1.1670846230001644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 13:12:11.332502 28547 connection.cc:256] RPC call timeout handler was delayed by -1.1616846230001556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 13:12:11.333848 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.334491 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.334955 28580 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:11.335137 28577 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:11.336187 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:11.336941 28576 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:11.337604 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:11.337709 31816 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.338481 31816 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.339056 31816 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.340219 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.340981 28573 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:11.341579 31823 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:11.342028 31823 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:11.342358 31823 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.343564 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.345775 28581 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:11.346724 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.347262 28581 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:11.348012 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.324767 28727 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:11.299577 31477 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.348531 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.349188 31477 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:11.349606 31477 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.348822 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.350579 28573 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:12:11.353941 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.358719 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.349576 28578 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:11.348042 28547 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:11.361851 28729 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:11.363883 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.263305 31536 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.364639 28580 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:11.365361 28576 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 7: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:11.284688 31741 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.369714 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:11.370961 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 60965.7us
I20260709 13:12:11.311281 31796 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.373750 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:11.374094 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.336112 31740 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:11.273142 31642 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.376784 28656 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 4: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:11.375486 28581 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:11.376084 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.383957 28578 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
W20260709 13:12:11.379274 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 123809us
I20260709 13:12:11.381349 28577 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:11.358343 31798 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.336000 31786 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:11.385730 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:11.386077 31786 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.385718 31798 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.387388 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.387851 31786 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:11.299026 31790 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.388600 31798 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.312541 31793 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.374621 31797 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.378554 31796 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.380928 31704 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:11.379779 31740 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.393146 31525 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.382012 31809 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:11.396274 31807 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:12:11.398211 31536 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:11.401535 31810 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:12:11.374236 31812 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:12:11.374300 31815 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:12:11.384733 31349 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:11.393433 31790 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:11.444684 31813 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:11.414527 28651 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
W20260709 13:12:11.478080 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 106431us
I20260709 13:12:11.479269 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:11.419061 31525 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:11.389099 31798 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:12:11.446252 31806 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:12:11.420231 31740 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:11.489133 31536 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:11.490182 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:11.484965 31814 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:12:11.486681 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 309453us
I20260709 13:12:11.494594 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:11.481343 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.482705 31786 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.491425 28725 raft_consensus.cc:2410] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:11.413725 31796 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.477398 31642 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.480370 31525 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:11.490132 31802 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:12:11.498800 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.484419 31820 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:12:11.453524 31809 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.503181 31798 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:11.406978 31797 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.503820 31349 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.567531 31718 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:11.504812 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.485522 31818 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.504994 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.506436 31678 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:11.499073 31799 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:11.500284 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.420529 31704 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.515120 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2287) took 2067 ms. Trace:
I20260709 13:12:11.515081 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:11.611094 28730 rpcz_store.cc:276] 0709 13:12:09.447311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.449348 (+  2037us) service_pool.cc:224] Handling call
0709 13:12:09.449789 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:09.479120 (+ 29331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.479161 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:10.960755 (+1481594us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b2c00116bf8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:12:10.967307 (+  6552us) log.cc:844] Serialized 26 byte log entry
0709 13:12:11.065386 (+ 98079us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:11.065440 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.065536 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:11.511627 (+446091us) raft_consensus.cc:1685] finished
0709 13:12:11.511677 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.515028 (+  3351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25126,"raft.queue_time_us":29272,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3284,"spinlock_wait_cycles":12492544,"thread_start_us":97666,"threads_started":1,"wal-append.queue_time_us":142933}
I20260709 13:12:11.563314 31638 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:11.564268 31789 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:11.566634 31809 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.509327 31815 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.499614 31791 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:11.560096 31821 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:12:11.654799 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 139787us
I20260709 13:12:11.522539 31798 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.535218 31642 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.638196 31678 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:11.680465 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:11.680675 31678 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.681310 28721 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:11.679443 31560 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:11.684033 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:11.659124 31815 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.657621 31789 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.702816 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.654053 31750 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:11.660099 31718 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:11.579128 31816 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.663501 31798 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:11.654577 31799 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:11.712564 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 216011us
I20260709 13:12:11.664520 31642 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:11.678083 31638 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:11.714259 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 219723us
I20260709 13:12:11.709504 31793 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.727816 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:11.727777 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:11.709977 31815 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.661113 31823 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.715346 31536 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:11.736260 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.673668 31791 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:12:11.689419 31558 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:12:11.611275 31818 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.737601 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.726694 31642 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.738289 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:11.736966 28576 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:11.789307 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.709375 31809 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:12:11.726341 31718 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:11.786823 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:11.884814 28575 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.791684 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:11.793030 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.715018 31789 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:11.814779 28695 leader_election.cc:336] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 2.200s (SENT)
I20260709 13:12:11.881954 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.882164 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.882961 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.889344 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:11.883388 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:11.890329 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 75539.2us
I20260709 13:12:11.890493 28580 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
W20260709 13:12:11.775230 28602 debug-util.cc:398] Leaking SignalData structure 0x7b080017c500 after lost signal to thread 27435
I20260709 13:12:11.886338 28574 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 3.
I20260709 13:12:11.891219 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:11.740247 31834 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.786770 31536 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:11.902633 31704 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:11.902570 31718 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.903496 31818 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.887142 31790 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.898113 31750 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:11.899763 31836 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:11.900415 31797 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.731361 31638 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.932142 31786 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.933073 31786 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.933167 31638 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.933805 31638 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:11.934309 31638 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:11.935369 31638 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.903702 31789 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:11.937345 31789 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.937804 31789 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.939961 31789 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:11.896036 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:11.941324 28581 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:11.904354 31558 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:11.942438 31789 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.942983 31789 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.930658 31823 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:11.930980 31349 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:11.955402 31789 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:11.957472 31477 consensus_meta.cc:287] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.003s
I20260709 13:12:11.957127 31786 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.957962 31477 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.959527 31786 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:11.962015 31792 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:11.962721 31792 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.926788 31790 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.968219 31790 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:11.950958 28575 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:11.926947 31836 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.960135 31477 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:12.007830 31349 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:12.011300 31836 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.025790 31349 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.037650 31536 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:11.904783 31834 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.040941 31834 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:12.042299 31525 consensus_meta.cc:287] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 13:12:12.042881 31525 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:11.955677 31740 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.038225 31836 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.061996 28577 raft_consensus.cc:2410] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:11.893810 31799 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:12.078518 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 359145us
I20260709 13:12:12.095587 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1814) took 2581 ms. Trace:
I20260709 13:12:12.096232 28649 rpcz_store.cc:276] 0709 13:12:09.513983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.514101 (+   118us) service_pool.cc:224] Handling call
0709 13:12:09.514606 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.265530 (+1750924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.095195 (+829665us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54003d4fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:12.095502 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4010194304}
I20260709 13:12:12.099423 31677 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.071569 31816 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:12.175822 31790 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.129817 31642 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.255519 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1657) took 1350 ms. Trace:
W20260709 13:12:12.257334 28602 debug-util.cc:398] Leaking SignalData structure 0x7b08001df040 after lost signal to thread 28513
W20260709 13:12:12.257401 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 366239us
W20260709 13:12:12.259989 28602 debug-util.cc:398] Leaking SignalData structure 0x7b0800132d00 after lost signal to thread 28527
I20260709 13:12:12.260310 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:12.260550 28602 debug-util.cc:398] Leaking SignalData structure 0x7b0800346660 after lost signal to thread 28533
W20260709 13:12:12.260591 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 522366us
W20260709 13:12:12.261934 28602 debug-util.cc:398] Leaking SignalData structure 0x7b080036ac40 after lost signal to thread 28605
I20260709 13:12:12.259809 28723 rpcz_store.cc:276] 0709 13:12:10.905034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.254270 (+1349236us) service_pool.cc:224] Handling call
0709 13:12:12.254780 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.255035 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.255080 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:12.255138 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:12.255193 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.255270 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.255439 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:12.263235 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.265906 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.266144 28647 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:12.266554 28649 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:12.266700 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.267616 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.268252 28654 raft_consensus.cc:2368] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:12:12.206498 31525 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.271539 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:12.269296 31677 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:12.275542 31815 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.001s
I20260709 13:12:12.275975 31815 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.272837 31677 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.277693 31677 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.278128 31815 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:12.281507 31792 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.282860 28652 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:12.284467 31798 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.000s
I20260709 13:12:12.284955 31798 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.287812 31798 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.277390 31844 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.304033 28656 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:12.290037 31642 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:12.292542 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:12.268321 31790 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.320531 31349 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.323141 31740 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.326807 31349 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.297734 31627 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:12:12.329021 31790 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.293285 31815 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:12.304391 31844 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.330862 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:12.331691 29252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1294) took 1400 ms (client timeout 1570 ms). Trace:
W20260709 13:12:12.332038 29252 rpcz_store.cc:269] 0709 13:12:10.931587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.330562 (+1398975us) service_pool.cc:224] Handling call
0709 13:12:12.331638 (+  1076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:12.332518 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.329630 31851 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:12.333244 28721 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:12.333356 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.333441 31851 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:12.334293 28723 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:12.335156 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.335424 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.334204 31851 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.335956 31349 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.335958 28730 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:12.338054 31836 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.338116 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:12.339154 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.339742 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:12.339874 28725 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:12.340278 28727 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:12.340312 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:12.340926 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:12.341231 28728 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:12.342041 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:12.342773 28729 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:12.343452 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.343554 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.344072 28579 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:12.344308 28575 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:12.344413 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.336747 31677 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.344993 28581 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.345041 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.345922 29258 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:12.346294 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.346715 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.346863 28574 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:12.339082 28724 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.346256 29258 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:12.354452 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:12.355448 28695 leader_election.cc:400] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:12:12.355918 28695 leader_election.cc:403] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:12.361959 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.362741 28730 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:12.365077 28724 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:12.353101 29258 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.366991 29258 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:12.368752 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:12.297935 31792 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:12.361974 31815 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:12:12.377151 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.379325 28648 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:12:12.384756 28581 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:12.384963 28574 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:12.387199 28726 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:12.388598 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 894) took 1376 ms. Trace:
I20260709 13:12:12.389252 28726 rpcz_store.cc:276] 0709 13:12:11.012038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.370220 (+1358182us) service_pool.cc:224] Handling call
0709 13:12:12.386941 (+ 16721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.387775 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.388215 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:12.395042 29258 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:12.396375 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1292) took 1465 ms. Trace:
I20260709 13:12:12.398303 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1283) took 2720 ms. Trace:
I20260709 13:12:12.398613 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2291) took 1392 ms. Trace:
I20260709 13:12:12.396888 29258 rpcz_store.cc:276] 0709 13:12:10.930788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.345512 (+1414724us) service_pool.cc:224] Handling call
0709 13:12:12.345785 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.395647 (+ 49862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.396282 (+   635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:12.399261 28727 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:12.373453 31349 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:12.399144 29257 rpcz_store.cc:276] 0709 13:12:09.677838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.689990 (+ 12152us) service_pool.cc:224] Handling call
0709 13:12:09.693916 (+  3926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.694197 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:09.699709 (+  5512us) log.cc:844] Serialized 14 byte log entry
0709 13:12:12.397946 (+2698237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:12.398002 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:12.398057 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.398123 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.398247 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2651772,"prepare.queue_time_us":4977,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":46005,"threads_started":1}
I20260709 13:12:12.386334 31638 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:12.406958 28653 rpcz_store.cc:276] 0709 13:12:11.006535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.006652 (+   117us) service_pool.cc:224] Handling call
0709 13:12:11.006997 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:11.020032 (+ 13035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.020065 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:11.020675 (+   610us) log.cc:844] Serialized 52 byte log entry
0709 13:12:11.080349 (+ 59674us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:11.118926 (+ 38577us) log.cc:844] Serialized 14 byte log entry
0709 13:12:11.119306 (+   380us) log.cc:844] Serialized 14 byte log entry
0709 13:12:12.324995 (+1205689us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b180015d960. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:12:12.370824 (+ 45829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.370892 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:12.398307 (+ 27415us) raft_consensus.cc:1685] finished
0709 13:12:12.398348 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.398536 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39333,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":347403,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":4053,"spinlock_wait_cycles":18629760,"thread_start_us":96927,"threads_started":2,"wal-append.queue_time_us":113047}
I20260709 13:12:12.410255 31349 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:12.415092 31638 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:12.427006 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 50041.3us
I20260709 13:12:12.425916 31134 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:12.437247 31837 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.437803 31741 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.437918 31837 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.440317 31837 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.441887 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:12.441888 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.443339 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:12.446743 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.448452 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.449278 28574 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:12.451457 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.454666 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.456717 28579 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:12.457259 28579 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:12.460278 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.421365 31349 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.466670 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.428996 31134 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.458222 28579 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.469290 28579 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.468657 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.470707 28575 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:12.426311 31638 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.445856 31834 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.485735 28579 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:12:12.486692 28579 pending_rounds.cc:85] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 6
I20260709 13:12:12.488050 28579 pending_rounds.cc:107] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:12:12.488325 28579 raft_consensus.cc:2889] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:12.468209 31852 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:12.496246 31134 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.508523 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.530864 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.531559 28575 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:12.546578 28575 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:12.490864 31852 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:12.510994 31815 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 3. Current term is 4.
I20260709 13:12:12.556077 31852 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:12.567469 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.565987 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.570775 28574 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:12.581466 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.582531 28575 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:12.581504 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:12.587631 28647 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 7: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:12.591069 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:12.600723 28575 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:12:12.603953 31864 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:12:12.592150 28647 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 7: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:12.610247 31677 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.626648 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.642674 31825 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:12.643443 31825 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:12.651224 31825 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.655454 31834 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:12.656102 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.656666 31865 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:12:12.657618 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.658737 28654 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:12.659112 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:12.659766 28576 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.667577 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.670831 28621 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:12.673069 28647 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:12.676797 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:12.683177 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:12.684140 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:12.685075 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:12.686851 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.691215 31525 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:12.691072 31837 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:12:12.695338 28621 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:12.688542 31860 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.687852 31834 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:12.699292 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:12.691695 31823 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:12.692308 31825 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.696007 31798 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.692757 31525 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.702776 31843 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:12.697595 31818 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:12:12.711884 31843 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.724352 31843 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.725127 31796 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:12.700523 31559 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:12.701987 31823 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.702503 31834 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.711339 31525 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.726198 31564 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:12:12.702849 31792 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:12:12.732759 31799 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:12.733188 31799 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:12.717374 31134 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:12:12.734061 31799 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.735605 31799 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.699944 31845 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:12.747479 28654 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:12.747198 31564 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:12.750065 28577 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:12.749431 31564 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:12.711982 31798 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.730556 31823 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:12.749426 31870 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:12:12.766887 28580 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:12:12.760072 31874 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:12:12.769876 31494 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:12.770332 31494 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:12.770581 28602 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb8c0 after lost signal to thread 28680
W20260709 13:12:12.770917 28602 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbb00 after lost signal to thread 28681
W20260709 13:12:12.771991 28602 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1700 after lost signal to thread 28754
W20260709 13:12:12.772281 28602 debug-util.cc:398] Leaking SignalData structure 0x7b0800352a00 after lost signal to thread 28755
I20260709 13:12:12.753551 31792 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:12.773576 31792 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.776099 31792 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:12.780949 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.764137 31851 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.802927 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:12.786868 31836 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:12:12.812144 28654 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:12:12.851248 28654 pending_rounds.cc:85] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 2
I20260709 13:12:12.851553 28654 pending_rounds.cc:107] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:12:12.851866 28654 raft_consensus.cc:2889] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:12.813040 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:12.811957 28648 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:12.839824 28724 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:12.850443 28576 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:12.857998 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:12.778776 31564 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.742853 31834 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.804839 31559 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:12.863958 31876 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:12.806281 31134 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:12:12.911648 31564 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:12.917037 31876 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:12.917507 31559 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:12.918109 31876 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:12.847517 31852 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:12.980919 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 121696us
I20260709 13:12:12.981797 28652 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:13.022359 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2290) took 1948 ms. Trace:
W20260709 13:12:13.026986 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.022950 28722 rpcz_store.cc:276] 0709 13:12:11.074316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.322209 (+247893us) service_pool.cc:224] Handling call
0709 13:12:11.322992 (+   783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.371048 (+ 48056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.371080 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:11.371506 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:12:12.763825 (+1392319us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b1800416380. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1
0709 13:12:12.763981 (+   156us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:12.923842 (+159861us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.016155 (+ 92313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.016325 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.016389 (+    64us) raft_consensus.cc:1685] finished
0709 13:12:13.022002 (+  5613us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.022280 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47697,"prepare.queue_time_us":133063,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":126936,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":187,"spinlock_wait_cycles":16594816,"thread_start_us":317889,"threads_started":3,"wal-append.queue_time_us":100453,"wal-append.run_cpu_time_us":2020,"wal-append.run_wall_time_us":1002041}
W20260709 13:12:13.040731 28602 debug-util.cc:398] Leaking SignalData structure 0x7b08003edc80 after lost signal to thread 29286
W20260709 13:12:13.041184 28602 debug-util.cc:398] Leaking SignalData structure 0x7b08003624c0 after lost signal to thread 29287
I20260709 13:12:13.018762 31824 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:13.064375 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.027752 31638 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.005s
I20260709 13:12:13.012621 31797 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 13:12:13.070602 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 239860us
W20260709 13:12:13.046311 31349 consensus_meta.cc:287] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.572s	user 0.013s	sys 0.000s
I20260709 13:12:13.073608 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1010) took 3321 ms. Trace:
I20260709 13:12:13.074008 29255 rpcz_store.cc:276] 0709 13:12:09.752714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.752892 (+   178us) service_pool.cc:224] Handling call
0709 13:12:09.787352 (+ 34460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.787624 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:10.053191 (+265567us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.073224 (+3020033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:13.073274 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:13.073328 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.073419 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.073552 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2924270,"prepare.queue_time_us":267095,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":95216,"threads_started":1}
I20260709 13:12:13.033258 31741 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:12:13.084985 31823 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.041778 31525 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.088364 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:13.097779 31852 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:13.086812 31843 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:13.099361 28728 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:12:13.099826 28728 pending_rounds.cc:85] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 5
I20260709 13:12:13.100033 28728 pending_rounds.cc:107] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:12:13.100261 28728 raft_consensus.cc:2889] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:13.101361 31843 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.074466 31349 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:13.107501 31349 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.110507 31632 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.111132 31632 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.111930 31722 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:13.075188 31851 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:13.113173 31758 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:13.113734 31758 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.115880 31758 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:13.116439 31758 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:13.117112 31812 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.117668 31812 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.119699 29255 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:13.120607 31894 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.121143 31894 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.121610 31525 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:13.122843 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.123171 31894 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.123752 29258 raft_consensus.cc:2410] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:13.124944 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.125762 29252 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:13.126307 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.119614 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:13.127257 29257 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.128791 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.130640 29251 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:13.112447 31722 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.129588 29258 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:13.133232 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.126137 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:13.073191 31638 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.128517 31758 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:13.168646 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.166869 28728 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:13.169940 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 83864.9us
I20260709 13:12:13.170966 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:13.172830 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:13.169301 29256 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:13.175849 28653 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:13.176329 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.176021 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:13.167100 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.167382 31823 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:13.167596 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 2.28789e+06us
I20260709 13:12:13.185935 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.167735 31851 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.168320 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:13.176978 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.177136 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.164881 29257 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:13.178452 29255 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:13.193907 28728 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:13.186188 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.187045 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.188223 28651 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:13.194499 29258 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:13.195308 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:13.178483 28727 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:13.178623 28576 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:13.193270 29256 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
I20260709 13:12:13.198737 28728 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:13.200356 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.200485 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.204959 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.206140 28724 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:13.207522 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:13.208247 28576 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.214151 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:13.220659 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.221933 28721 raft_consensus.cc:2410] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:12:13.219492 28576 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:13.175382 31710 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.225785 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.231650 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:13.227480 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.232600 28652 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:13.232681 28728 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:13.178175 31843 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.177857 31693 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.185524 31852 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.231727 29256 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:13.241504 29256 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:13.198618 31559 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:13.228411 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.234719 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:13.231323 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:13.185286 31688 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:13.235903 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:13.238361 28729 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:13.223668 31823 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:13.290763 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.229411 31860 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:13.235620 31824 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.247248 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.246973 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:13.248821 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 242844us
I20260709 13:12:13.262822 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.318791 28728 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:13.318990 29256 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 4.
W20260709 13:12:13.319248 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 145475us
I20260709 13:12:13.319964 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:13.320665 29256 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.239527 31691 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:13.246898 28647 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:13.230378 31815 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:13.290233 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.311587 29258 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:13.312542 28573 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:13.230578 31861 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.334120 31861 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.336376 31861 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.336810 31691 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.244727 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.226562 31632 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.239727 31692 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.168856 31494 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:13.317451 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 131585us
I20260709 13:12:13.343503 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1298) took 2410 ms. Trace:
I20260709 13:12:13.248095 31894 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.203605 31851 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.249289 31559 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.300078 31825 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:13.324280 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 77108.5us
I20260709 13:12:13.321239 31820 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.244318 31862 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:13.247843 31613 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:12:13.321410 31823 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:13.329104 28477 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 3, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:13.247030 31812 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:13.236699 31877 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:12:13.240809 31710 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.321023 31905 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:13.337918 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.337955 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:13.339051 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:13.340472 31861 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:13.341396 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:13.444319 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 102988us
W20260709 13:12:13.445590 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 106640us
I20260709 13:12:13.351161 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:13.446841 28573 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:13.352612 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.343902 29260 rpcz_store.cc:276] 0709 13:12:10.932958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.936883 (+  3925us) service_pool.cc:224] Handling call
0709 13:12:10.937206 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:10.937418 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:11.210674 (+273256us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.342991 (+2132317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:13.343078 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:13.343125 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.343333 (+   208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.343452 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1837345,"prepare.queue_time_us":398393,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":1966959,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5608,"thread_start_us":567462,"threads_started":3,"wal-append.queue_time_us":172539,"wal-append.run_cpu_time_us":2428,"wal-append.run_wall_time_us":1291292}
I20260709 13:12:13.367201 28574 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:13.376619 29256 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:13.300061 31876 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:12:13.379043 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.178102 31758 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.382261 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.467078 28728 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 3.
I20260709 13:12:13.325832 31815 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.387828 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.469529 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:13.429407 31895 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:12:13.327569 31860 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:13.244405 31693 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.393446 28721 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.395612 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:13.399947 28578 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:13.343242 31711 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:13.385856 31825 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:13.408795 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 68535.8us
I20260709 13:12:13.382525 31559 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:13.395567 31866 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:13.416369 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:13.368925 31692 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.418366 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:13.377871 31694 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:12:13.380787 31894 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.443033 29258 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:13.349730 28576 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.451627 28722 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:13.390007 28577 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:12:13.467852 31638 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:13.426635 31691 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:13.395809 31862 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.423949 31632 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:12:13.648510 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.518249 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:13.540580 29257 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:13.665547 28727 raft_consensus.cc:2393] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:13.666944 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.615401 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:13.648126 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.669528 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.647068 31906 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:12:13.671191 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.677716 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:13.678063 28574 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:12:13.679307 28545 leader_election.cc:336] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.612s (SENT)
I20260709 13:12:13.681594 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:13.671566 31844 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:13.672951 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.546264 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:13.609251 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 230256us
I20260709 13:12:13.668159 28728 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:13.488157 29252 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:13.674476 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:13.709146 29258 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:13.675155 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.675863 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.679443 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:13.680711 28725 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:13.681793 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:13.685281 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.658936 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.657343 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:13.709745 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.712142 28653 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:13.671823 31711 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.556823 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1300) took 2481 ms. Trace:
I20260709 13:12:13.586838 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:13.675660 31494 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.724905 29256 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:13.690793 31748 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:13.706559 31349 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:13.730652 31692 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.487102 31860 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:13.733153 31758 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.540459 31722 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:13.733831 31861 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:13.487401 31823 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:13.707357 31838 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:13.735183 31838 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:13.735599 31838 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.737481 29251 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:13.466959 31799 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:13.740724 28572 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 7: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:13.692021 29225 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:46396 dropped due to backpressure: service queue is full with 50 items
W20260709 13:12:13.720530 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 111813us
I20260709 13:12:13.710978 29260 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:13.709776 28578 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:13.724821 29259 rpcz_store.cc:276] 0709 13:12:11.075643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.077130 (+  1487us) service_pool.cc:224] Handling call
0709 13:12:11.077582 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:13.240450 (+2162868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:13.240492 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:13.240964 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:12:13.399597 (+158633us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:13.399638 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.399711 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.556578 (+156867us) raft_consensus.cc:1685] finished
0709 13:12:13.556605 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.556749 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2096543,"raft.queue_time_us":2170150,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":11248,"thread_start_us":144697,"threads_started":2,"wal-append.queue_time_us":162889}
I20260709 13:12:13.473639 31815 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.723912 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:13.724203 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:13.734259 31861 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:13.756959 29253 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.020s	sys 0.027s
W20260709 13:12:13.705708 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.754665 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:13.738153 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 58958.4us
I20260709 13:12:13.758951 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:13.759471 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.743299 31844 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:13.760622 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.470412 31613 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:13.756242 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:13.741204 29255 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:13.487141 31851 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:13.686920 31825 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.739136 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:13.722669 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.578238 31693 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:13.749936 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 163212us
I20260709 13:12:13.742635 31559 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:13.763796 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.727679 29222 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:46376 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1031)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 993)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 998)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1030)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1036)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 994)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1034)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1028)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1037)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1026)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1310)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1033)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1313)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 986)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 987)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 991)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1314)
I20260709 13:12:13.761091 31748 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.761358 31812 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:13.767747 31613 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.467213 31820 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:13.639278 31905 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:12:13.771374 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.745755 31799 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.772665 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.822009 28577 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:13.822458 28729 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:13.776672 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:12:13.766939 29253 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.020s	sys 0.027s
W20260709 13:12:13.823671 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47119.4us
I20260709 13:12:13.823930 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1291) took 2894 ms. Trace:
W20260709 13:12:13.785301 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.452219 31834 consensus_meta.cc:287] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.001s
I20260709 13:12:13.788430 28726 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:12:13.784364 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 45306.7us
I20260709 13:12:13.773062 31758 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.772801 31722 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:13.767885 31844 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:13.789450 31877 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:13.830736 28648 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:12:13.797135 31787 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:13.794597 31851 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:13.797487 31741 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:13.877209 31741 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.877717 31741 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.879074 31559 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.839715 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:13.837546 31638 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:13.819082 31710 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:13.890127 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 50176us
I20260709 13:12:13.890494 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.891139 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:13.799206 31812 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:13.829236 31582 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:13.840443 31758 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.871886 31894 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.839653 31877 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:13.873095 31691 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:13.873531 31862 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:13.876478 31823 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:13.821992 31613 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.787472 31908 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:13.883908 28728 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.824290 29253 rpcz_store.cc:276] 0709 13:12:10.929328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.929456 (+   128us) service_pool.cc:224] Handling call
0709 13:12:10.929767 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:10.929992 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:11.210607 (+280615us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.823577 (+2612970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:13.823636 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:13.823687 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.823769 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.823881 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1872988,"prepare.queue_time_us":380563,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":22538,"raft.queue_time_us":1998901,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9010,"thread_start_us":1019824,"threads_started":3,"wal-append.queue_time_us":166524,"wal-append.run_cpu_time_us":2294,"wal-append.run_wall_time_us":1122104}
I20260709 13:12:13.867031 29222 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:46376 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 993)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 998)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1030)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1317)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1036)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 994)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1034)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1028)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1037)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1026)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1310)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1033)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1313)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 986)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 987)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 991)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1314)
I20260709 13:12:13.837754 31844 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.829941 31799 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.895488 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.904078 31894 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.872682 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:13.898160 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 139265us
I20260709 13:12:13.916109 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.916486 28577 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:13.916908 29253 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:13.899288 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1007) took 4401 ms. Trace:
I20260709 13:12:13.917812 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.919209 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:13.917958 29254 rpcz_store.cc:276] 0709 13:12:09.495862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.496042 (+   180us) service_pool.cc:224] Handling call
0709 13:12:09.496561 (+   519us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:12.399013 (+2902452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.399043 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:12:12.409403 (+ 10360us) log.cc:844] Serialized 78 byte log entry
0709 13:12:12.464344 (+ 54941us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:13.691163 (+1226819us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b18003ba9a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a2b80e3c7 00007f4a27e209a7 00007f4a27e300bf
0709 13:12:13.706743 (+ 15580us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.889517 (+182774us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.889750 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.889848 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.897159 (+  7311us) raft_consensus.cc:1685] finished
0709 13:12:13.897187 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.897386 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2975941,"prepare.queue_time_us":135705,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":105,"raft.queue_time_us":3693345,"raft.run_cpu_time_us":6898,"raft.run_wall_time_us":45891,"spinlock_wait_cycles":15491072,"thread_start_us":324706,"threads_started":4,"wal-append.queue_time_us":143336,"wal-append.run_cpu_time_us":2858,"wal-append.run_wall_time_us":1101390}
I20260709 13:12:13.920419 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.801023 31852 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:12:13.899904 28726 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.845481 31851 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.921917 31851 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.837188 31694 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:12:13.889223 31787 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:13.926142 31741 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.837373 31834 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:13.899183 31582 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.926994 28577 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:13.895974 31906 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:13.916653 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:13.928211 31906 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.888365 31638 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:13.928726 31906 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.928822 31638 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:13.902158 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 145970us
I20260709 13:12:13.917825 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:13.930145 29253 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.930421 31894 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:13.926043 31787 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.896273 31812 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.932942 31741 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:13.934028 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.935570 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.936734 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.937561 29254 raft_consensus.cc:2410] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:13.938386 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.939034 29254 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:13.939990 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.940595 29254 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:13.941505 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.942255 29254 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:13.943826 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:13.944144 31851 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:13.944520 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:13.945878 31901 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:13.946305 31901 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.946478 31851 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:13.946699 31901 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:13.947681 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44004.2us
I20260709 13:12:13.948020 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:13.949718 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:13.950762 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:13.975093 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.976073 29259 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:13.902267 31824 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:13.902595 31877 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.977300 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.988787 29259 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:13.980104 28654 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:13.981884 28653 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: [3.6-6.8]
I20260709 13:12:13.836671 31861 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.986056 28650 raft_consensus.cc:1217] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:12:13.962013 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:12:14.016755 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 125706us
I20260709 13:12:13.991930 31820 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.005038 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:13.948783 31908 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:14.073690 31908 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.974571 31536 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:13.983500 31876 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:13.914013 31823 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.938838 31638 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:13.901865 31680 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:12:14.090909 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:14.091409 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 141269us
I20260709 13:12:14.067548 28650 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:14.017886 29253 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:14.068588 29224 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:14.068702 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.094449 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:14.095093 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:13.985554 29254 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:14.095741 28649 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:14.095976 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.096299 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.096645 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.097064 29254 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:14.097877 28652 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.975080 31851 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:14.075963 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2450) took 1329 ms. Trace:
I20260709 13:12:13.983258 31741 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:12:14.025913 31927 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:14.097767 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:14.106597 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.098834 28580 rpcz_store.cc:276] 0709 13:12:12.746235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.746713 (+   478us) service_pool.cc:224] Handling call
0709 13:12:12.746954 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.767360 (+ 20406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.075694 (+1308334us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b54000eb5d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:14.075903 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39921920}
I20260709 13:12:14.114741 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.115813 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.076483 31834 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.123062 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.126116 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.135042 28647 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:14.135891 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.143352 28650 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:14.144335 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.144522 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.146359 29259 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.149853 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.151412 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.099993 31861 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:14.157431 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 206705us
I20260709 13:12:14.158471 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:14.158728 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 239170us
I20260709 13:12:14.108058 31851 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.103343 31536 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:14.160072 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.174242 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.084461 31876 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.176913 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1846) took 1521 ms. Trace:
I20260709 13:12:14.171613 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:14.182991 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.183166 29254 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:14.148949 31525 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.182211 28656 rpcz_store.cc:276] 0709 13:12:12.655193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.661603 (+  6410us) service_pool.cc:224] Handling call
0709 13:12:14.174111 (+1512508us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:14.176821 (+  2710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15757696}
I20260709 13:12:14.135265 31927 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:14.169893 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:14.161103 31851 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.185312 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:14.191360 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 98500.8us
I20260709 13:12:14.197372 28654 raft_consensus.cc:2410] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:14.198107 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.173769 31926 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:14.198695 28580 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.201124 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.193774 29254 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:14.159157 31838 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.204788 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.206146 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.206667 28577 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:14.206997 29254 raft_consensus.cc:2376] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9. Re-sending same reply.
I20260709 13:12:14.208329 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.217559 31941 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:14.200415 31758 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:14.269451 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:14.270372 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:14.271140 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:14.202684 31525 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:12:14.272948 31638 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.274278 31838 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.278514 31876 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:14.280694 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.219589 31925 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 13:12:14.283412 28622 leader_election.cc:336] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 1.680s (SENT)
I20260709 13:12:14.285295 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:14.302258 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:14.302440 28577 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:14.290282 28580 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:14.289609 29254 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:14.303889 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.294291 28725 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:14.294921 28729 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.296056 28723 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:14.304777 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:14.286295 31922 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260709 13:12:14.297477 31825 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
W20260709 13:12:14.297643 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 89878.8us
I20260709 13:12:14.295051 31928 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.311933 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.284813 31812 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.314123 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.315027 28580 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:14.315904 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.316303 29254 raft_consensus.cc:2376] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5. Re-sending same reply.
I20260709 13:12:14.317366 28577 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:14.291221 31536 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:14.321676 31937 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:12:14.306041 31876 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:14.316879 31931 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260709 13:12:14.330322 28729 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:14.330439 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.306479 31942 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:14.313731 31823 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.341625 31799 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.358680 31945 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:14.366897 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:14.368075 29259 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:14.369019 28580 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:14.368760 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:14.345672 31923 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:12:14.373116 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1307) took 1069 ms. Trace:
I20260709 13:12:14.314073 31825 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.371002 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.379561 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1028) took 1046 ms. Trace:
I20260709 13:12:14.374682 29254 rpcz_store.cc:276] 0709 13:12:13.306569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.352735 (+1046166us) service_pool.cc:224] Handling call
0709 13:12:14.373057 (+ 20322us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:14.365660 31815 consensus_meta.cc:287] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.013s
W20260709 13:12:14.371645 31938 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.177s	user 0.002s	sys 0.000s
I20260709 13:12:14.407163 31837 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:14.407665 31837 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:14.408529 31837 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.409435 31694 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:14.409796 31837 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:14.410172 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 457982us
I20260709 13:12:14.410277 31904 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:14.411278 31904 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:14.411616 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.411759 31904 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.415505 31758 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:14.407146 31844 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:14.417514 31936 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:12:14.418184 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 349630us
I20260709 13:12:14.418344 31844 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.314910 31928 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.377918 31935 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.419335 31935 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.421363 31949 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:14.421792 31949 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.422123 31949 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.424716 31862 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:14.401058 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 83717.9us
I20260709 13:12:14.416095 31758 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.372367 31942 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:14.425477 31798 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.430600 31692 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:14.431070 31692 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:14.420071 31894 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:14.432473 31894 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.432073 31692 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.432826 31894 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.442893 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.443359 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.442471 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.448937 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:14.399672 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.452235 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 981) took 1043 ms. Trace:
I20260709 13:12:14.310423 31927 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.427673 31942 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.454818 31851 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.456719 28727 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:14.452629 29254 rpcz_store.cc:276] 0709 13:12:13.408371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.381152 (+972781us) service_pool.cc:224] Handling call
0709 13:12:14.452098 (+ 70946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.459499 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.380302 29259 rpcz_store.cc:276] 0709 13:12:13.333197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.369278 (+1036081us) service_pool.cc:224] Handling call
0709 13:12:14.379487 (+ 10209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.460516 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 982) took 1049 ms. Trace:
I20260709 13:12:14.461261 29254 rpcz_store.cc:276] 0709 13:12:13.411670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.457692 (+1046022us) service_pool.cc:224] Handling call
0709 13:12:14.460442 (+  2750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.461913 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.426644 31908 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.469488 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:14.471256 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.472139 28649 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:14.370249 31941 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:12:14.474669 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.433248 31823 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.474174 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:14.485347 31934 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:12:14.491627 31935 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.470541 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.493224 31928 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.493575 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.494421 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 980) took 1092 ms. Trace:
I20260709 13:12:14.494848 29254 rpcz_store.cc:276] 0709 13:12:13.402110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.493317 (+1091207us) service_pool.cc:224] Handling call
0709 13:12:14.494360 (+  1043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.495738 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:14.496254 31799 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:14.497402 31906 consensus_meta.cc:287] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.568s	user 0.014s	sys 0.003s
I20260709 13:12:14.496855 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.480608 31812 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:14.456626 31613 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.481595 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1303) took 1191 ms. Trace:
I20260709 13:12:14.481683 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1032) took 1147 ms. Trace:
I20260709 13:12:14.409837 31694 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:14.482600 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1037) took 1146 ms. Trace:
I20260709 13:12:14.503719 29257 rpcz_store.cc:276] 0709 13:12:13.289751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.289880 (+   129us) service_pool.cc:224] Handling call
0709 13:12:14.481417 (+1191537us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400242cd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.481534 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496361856}
I20260709 13:12:14.504220 29259 rpcz_store.cc:276] 0709 13:12:13.335902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.474370 (+1138468us) service_pool.cc:224] Handling call
0709 13:12:14.482537 (+  8167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.503808 29256 rpcz_store.cc:276] 0709 13:12:13.334500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.469269 (+134769us) service_pool.cc:224] Handling call
0709 13:12:14.481544 (+1012275us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400610154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.481631 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585475328}
I20260709 13:12:14.500872 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:14.478212 31758 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.482867 31917 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:14.458412 31815 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.477985 31691 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.424237 31877 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.488305 31692 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.506497 31926 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:14.488493 31823 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.517261 31862 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.531807 31815 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.504040 31906 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.535049 31906 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.517881 31934 consensus_queue.cc:1243] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:14.542412 31904 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:14.544646 31901 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.005s
I20260709 13:12:14.545101 31901 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.545495 31926 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.547504 31901 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.550092 31894 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.550379 31949 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:14.476524 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 167249us
I20260709 13:12:14.593356 28724 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:14.596740 28730 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:14.599545 29260 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
W20260709 13:12:14.599915 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 99013.2us
W20260709 13:12:14.602016 28622 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 1.749s (SENT)
I20260709 13:12:14.602718 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:14.603745 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1310) took 1280 ms. Trace:
I20260709 13:12:14.607122 29256 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:14.607625 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:14.607949 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1026) took 1303 ms. Trace:
I20260709 13:12:14.608738 28729 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:14.611652 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:14.612514 28729 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.612586 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:14.608448 29256 rpcz_store.cc:276] 0709 13:12:13.304250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.605268 (+1301018us) service_pool.cc:224] Handling call
0709 13:12:14.606129 (+   861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.607643 (+  1514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.607860 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.623960 29256 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:14.630092 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:14.630621 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1033) took 1295 ms. Trace:
I20260709 13:12:14.625808 31559 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.626291 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:14.635876 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:14.628430 29253 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:14.604485 29254 rpcz_store.cc:276] 0709 13:12:13.323497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.601831 (+1278334us) service_pool.cc:224] Handling call
0709 13:12:14.602465 (+   634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.602977 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.603008 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:14.603067 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:14.603142 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.603258 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.603433 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.639539 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 967) took 1292 ms. Trace:
I20260709 13:12:14.640014 29254 rpcz_store.cc:276] 0709 13:12:13.346760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.638049 (+1291289us) service_pool.cc:224] Handling call
0709 13:12:14.638652 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.639080 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.639112 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:14.639189 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:14.639251 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.639316 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.639461 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.631373 28730 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:12:14.641414 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.628000 31613 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.641961 31525 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.642787 31613 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.643007 31525 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.631122 29256 rpcz_store.cc:276] 0709 13:12:13.334776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.622758 (+1287982us) service_pool.cc:224] Handling call
0709 13:12:14.623355 (+   597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.630270 (+  6915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.630537 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.645131 31680 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:14.646363 29256 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:14.646286 31680 consensus_queue.cc:1243] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:14.647490 31680 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:14.648003 31710 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.648015 31680 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:14.649112 31680 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.650941 31711 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.652276 31799 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.652467 31694 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.653221 31799 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.653095 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 969) took 1305 ms. Trace:
I20260709 13:12:14.656075 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:14.654826 29256 rpcz_store.cc:276] 0709 13:12:13.347374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.645456 (+1298082us) service_pool.cc:224] Handling call
0709 13:12:14.645935 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.652750 (+  6815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.653033 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.661271 31823 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.663371 31825 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.665649 31711 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:14.666316 31711 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:14.666863 31711 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.667423 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 731) took 1297 ms. Trace:
I20260709 13:12:14.668180 28572 rpcz_store.cc:276] 0709 13:12:13.370099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.370301 (+   202us) service_pool.cc:224] Handling call
0709 13:12:14.666777 (+1296476us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b54000eddd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.667114 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172407040}
I20260709 13:12:14.670046 31694 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.688184 28575 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:14.688561 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:14.688259 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2432) took 2235 ms. Trace:
I20260709 13:12:14.704169 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 733) took 1315 ms. Trace:
I20260709 13:12:14.708401 28575 rpcz_store.cc:276] 0709 13:12:13.387971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.452058 (+ 64087us) service_pool.cc:224] Handling call
0709 13:12:14.673760 (+1221702us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:12:14.687714 (+ 13954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.702331 (+ 14617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.703199 (+   868us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16621824}
I20260709 13:12:14.712218 31940 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:14.713238 31940 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.716455 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1863) took 1111 ms. Trace:
I20260709 13:12:14.716979 28648 rpcz_store.cc:276] 0709 13:12:13.605299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.605515 (+   216us) service_pool.cc:224] Handling call
0709 13:12:13.605937 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:13.838225 (+232288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.715759 (+877534us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540027e554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:14.716209 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516261120}
I20260709 13:12:14.725248 31956 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.725888 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 1669) took 1507 ms. Trace:
I20260709 13:12:14.726032 31956 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.726329 28724 rpcz_store.cc:276] 0709 13:12:13.219454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.219610 (+   156us) service_pool.cc:224] Handling call
0709 13:12:14.725635 (+1506025us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000a6ed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.725806 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2883705088}
W20260709 13:12:14.680531 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 311588us
I20260709 13:12:14.687664 31525 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:14.732273 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 96684.6us
I20260709 13:12:14.733407 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1302) took 1443 ms. Trace:
I20260709 13:12:14.733840 29255 rpcz_store.cc:276] 0709 13:12:13.289399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.289564 (+   165us) service_pool.cc:224] Handling call
0709 13:12:13.317365 (+ 27801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.768947 (+451582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.732844 (+963897us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54006a0254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:14.733205 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973941120}
I20260709 13:12:14.687081 31894 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:14.737875 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 142565us
I20260709 13:12:14.740954 28729 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
W20260709 13:12:14.744297 28547 leader_election.cc:336] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 1.530s (SENT)
I20260709 13:12:14.746310 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:14.747340 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:14.748632 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1304) took 1458 ms. Trace:
I20260709 13:12:14.749269 29251 rpcz_store.cc:276] 0709 13:12:13.290085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.290473 (+   388us) service_pool.cc:224] Handling call
0709 13:12:14.748058 (+1457585us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54005b2a54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.748375 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994709760}
I20260709 13:12:14.750797 31799 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.751122 28722 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:14.751761 31799 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.754474 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1036) took 1418 ms. Trace:
I20260709 13:12:14.755148 29253 rpcz_store.cc:276] 0709 13:12:13.335612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.151129 (+815517us) service_pool.cc:224] Handling call
0709 13:12:14.754065 (+602936us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54006aa754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.754346 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093189888}
I20260709 13:12:14.756696 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.742547 28725 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.762763 29253 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:14.747399 29258 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:14.765163 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.702404 28581 rpcz_store.cc:276] 0709 13:12:12.453208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.453490 (+   282us) service_pool.cc:224] Handling call
0709 13:12:12.468823 (+ 15333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.488079 (+ 19256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:12.561646 (+ 73567us) log.cc:844] Serialized 14 byte log entry
0709 13:12:13.961025 (+1399379us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18003a24c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a
0709 13:12:13.961225 (+   200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:13.961276 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:13.961328 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.687727 (+726399us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54001a9d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:14.687795 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.688069 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":129922,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":129745,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":36927,"spinlock_wait_cycles":68731392,"thread_start_us":163787,"threads_started":2,"wal-append.queue_time_us":131222,"wal-append.run_cpu_time_us":1973,"wal-append.run_wall_time_us":1076785}
I20260709 13:12:14.766186 28648 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:14.740900 31956 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:14.768432 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 986) took 1212 ms. Trace:
I20260709 13:12:14.768908 29253 rpcz_store.cc:276] 0709 13:12:13.552383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.756461 (+1204078us) service_pool.cc:224] Handling call
0709 13:12:14.759384 (+  2923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.763889 (+  4505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.764601 (+   712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.770093 31818 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:12:14.770213 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:14.775409 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:14.768692 29258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1031) took 1430 ms (client timeout 1749 ms). Trace:
W20260709 13:12:14.781206 29258 rpcz_store.cc:269] 0709 13:12:13.334172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.745485 (+1411313us) service_pool.cc:224] Handling call
0709 13:12:14.764592 (+ 19107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.774865 31692 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:14.789433 28622 leader_election.cc:336] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 2.028s (SENT)
W20260709 13:12:14.792097 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.793133 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:14.802430 31894 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:14.799475 31692 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:14.812434 31934 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:14.813300 28654 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.812879 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.817880 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1305) took 1477 ms. Trace:
I20260709 13:12:14.805532 31894 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.826805 28578 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.829429 28575 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:14.830961 31900 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 1.488s	user 0.005s	sys 0.001s
I20260709 13:12:14.832342 31934 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.827395 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:14.835346 31852 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:14.835995 31852 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:14.827929 28572 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:14.826877 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.837764 31934 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.838078 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:13.741158 29225 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:46396 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 993)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 966)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1312)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 998)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1030)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1036)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 994)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1311)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1034)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1307)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1028)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1037)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1026)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1310)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1033)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 977)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1313)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 986)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 987)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 991)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1314)
W20260709 13:12:14.844326 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.819818 29259 rpcz_store.cc:276] 0709 13:12:13.290408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.507894 (+1217486us) service_pool.cc:224] Handling call
0709 13:12:14.595612 (+ 87718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.596742 (+  1130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.596776 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:14.597961 (+  1185us) log.cc:844] Serialized 26 byte log entry
0709 13:12:14.737623 (+139662us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:14.737687 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.737801 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.767515 (+ 29714us) raft_consensus.cc:1685] finished
0709 13:12:14.767537 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.767675 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45780,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":263,"thread_start_us":138955,"threads_started":1,"wal-append.queue_time_us":160386}
I20260709 13:12:14.850733 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 968) took 1503 ms. Trace:
I20260709 13:12:14.851322 29254 rpcz_store.cc:276] 0709 13:12:13.347066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.644283 (+1297217us) service_pool.cc:224] Handling call
0709 13:12:14.644752 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.849518 (+204766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.849556 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:14.849625 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:14.849662 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.850422 (+   760us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54005f0fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:14.850473 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.850637 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469670784}
I20260709 13:12:14.853808 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:14.854854 28729 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:14.855592 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.858511 31692 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.859323 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 977) took 1509 ms. Trace:
I20260709 13:12:14.860263 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:14.861219 28573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 736) took 1443 ms (client timeout 1665 ms). Trace:
W20260709 13:12:14.861596 28573 rpcz_store.cc:269] 0709 13:12:13.434175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.467714 (+ 33539us) service_pool.cc:224] Handling call
0709 13:12:14.859927 (+1392213us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:14.861163 (+  1236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30382336}
I20260709 13:12:14.864183 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:14.865774 31693 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:14.825915 31940 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.866420 31693 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:14.866997 31693 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.840982 31894 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.859848 29255 rpcz_store.cc:276] 0709 13:12:13.350075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.734882 (+1384807us) service_pool.cc:224] Handling call
0709 13:12:14.735396 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.736005 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.736032 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:14.762289 (+ 26257us) log.cc:844] Serialized 26 byte log entry
0709 13:12:14.804476 (+ 42187us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:14.804537 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.804642 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.859100 (+ 54458us) raft_consensus.cc:1685] finished
0709 13:12:14.859120 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.859267 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":24850,"threads_started":1,"wal-append.queue_time_us":49644}
I20260709 13:12:14.871747 29254 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:14.873164 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1314) took 1146 ms. Trace:
I20260709 13:12:14.875128 31949 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.875933 29253 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:14.876573 31711 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.877940 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:14.878919 28575 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:14.877463 31852 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.879349 31877 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:14.879101 31816 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:14.880445 31929 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:14.882658 28651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2320) took 2502 ms (client timeout 1877 ms). Trace:
I20260709 13:12:14.877475 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:14.884994 31945 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:14.884670 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:14.885854 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1022) took 1693 ms. Trace:
I20260709 13:12:14.876811 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 987) took 1299 ms. Trace:
I20260709 13:12:14.888856 28573 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:14.889396 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 904) took 1178 ms. Trace:
I20260709 13:12:14.890473 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:14.890780 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.904212 29252 rpcz_store.cc:276] 0709 13:12:13.192042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.192186 (+   144us) service_pool.cc:224] Handling call
0709 13:12:14.885460 (+1693274us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540002ba54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.885656 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660118400}
W20260709 13:12:14.900161 28651 rpcz_store.cc:269] 0709 13:12:12.379944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.441635 (+ 61691us) service_pool.cc:224] Handling call
0709 13:12:14.882153 (+2440518us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540027d654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.882396 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713384832}
I20260709 13:12:14.873684 29254 rpcz_store.cc:276] 0709 13:12:13.726513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.870043 (+1143530us) service_pool.cc:224] Handling call
0709 13:12:14.870625 (+   582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.872549 (+  1924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.873037 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.904299 29253 rpcz_store.cc:276] 0709 13:12:13.577578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.776059 (+1198481us) service_pool.cc:224] Handling call
0709 13:12:14.804420 (+ 28361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.876472 (+ 72052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.876739 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.909524 31816 consensus_queue.cc:1243] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:12:14.910545 28578 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:14.905192 28722 rpcz_store.cc:276] 0709 13:12:13.711194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.739112 (+ 27918us) service_pool.cc:224] Handling call
0709 13:12:14.739457 (+1000345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.751748 (+ 12291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.889159 (+137411us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54000a6ed0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:14.889310 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247723904}
I20260709 13:12:14.855960 31680 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.914333 31582 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.914873 31929 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.915562 29251 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:14.915820 31613 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.916435 31715 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:14.915599 29224 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:14.918509 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.929942 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:14.931608 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.931691 31918 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:14.932735 28577 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.933220 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 970) took 1585 ms. Trace:
I20260709 13:12:14.933043 31945 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.936549 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.937282 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:14.938413 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:14.933655 29256 rpcz_store.cc:276] 0709 13:12:13.347620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.657451 (+1309831us) service_pool.cc:224] Handling call
0709 13:12:14.671317 (+ 13866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.705405 (+ 34088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.705442 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:14.707257 (+  1815us) log.cc:844] Serialized 26 byte log entry
0709 13:12:14.767798 (+ 60541us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:14.767838 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.767916 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.932941 (+165025us) raft_consensus.cc:1685] finished
0709 13:12:14.932966 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.933150 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4538,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":213,"thread_start_us":56514,"threads_started":1,"wal-append.queue_time_us":87668}
I20260709 13:12:14.927469 31715 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:14.944604 28573 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:14.934894 31582 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.948348 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.948559 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:14.949043 28579 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.950685 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:14.951740 31956 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:14.952205 31956 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:14.952071 31926 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:14.952611 31956 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:14.952837 31926 consensus_queue.cc:1243] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:12:14.955282 31815 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:14.955761 31815 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:14.956554 28580 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.956936 31815 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:14.958513 31815 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.961297 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:14.962522 28621 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:14.963750 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:14.972394 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:14.974444 28576 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:14.975325 31715 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:14.983325 31912 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:14.993696 31912 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.994313 31912 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.994714 31680 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.998546 31908 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:15.000088 31933 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.801s	user 0.000s	sys 0.002s
I20260709 13:12:15.003568 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1313) took 1553 ms. Trace:
I20260709 13:12:15.004086 29251 rpcz_store.cc:276] 0709 13:12:13.450495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.750695 (+1300200us) service_pool.cc:224] Handling call
0709 13:12:14.751306 (+   611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.928804 (+177498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.003212 (+ 74408us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54006428d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:15.003454 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371475712}
W20260709 13:12:15.005344 31924 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.963s	user 0.007s	sys 0.000s
I20260709 13:12:14.985867 28655 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:14.980644 31711 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.987649 31836 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:15.010059 31824 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:15.010562 31836 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:15.010725 31824 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:15.011205 31929 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:14.966568 31693 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.011646 31836 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:15.013379 31693 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:15.014163 29260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 988) took 1436 ms (client timeout 1529 ms). Trace:
W20260709 13:12:15.014786 29260 rpcz_store.cc:269] 0709 13:12:13.577919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.411353 (+833434us) service_pool.cc:224] Handling call
0709 13:12:15.013919 (+602566us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54005f0354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:15.014088 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429313280}
W20260709 13:12:15.017287 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 94143.9us
I20260709 13:12:15.017638 31943 raft_consensus.cc:2764] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:15.018337 28696 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:15.018671 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:14.980123 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:15.020615 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 48483.6us
I20260709 13:12:15.024648 28577 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:15.025282 28725 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:15.030632 28580 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:14.978587 31715 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.041836 28725 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:15.042742 29223 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:15.042845 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:15.046506 28651 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:15.046639 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 76781.6us
I20260709 13:12:15.043793 28729 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.048213 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:15.051334 31758 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:15.051784 31758 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.042930 28578 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.052783 31758 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.056340 31758 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.057091 31680 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:14.969681 31918 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:12:15.060655 28579 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:15.063701 28654 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:15.036443 31894 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:15.037171 31926 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:15.067641 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 87621.1us
I20260709 13:12:15.068648 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:15.067260 28729 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:15.070184 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:15.071827 28725 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.068431 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:15.085423 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:15.140277 28575 pending_rounds.cc:85] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 2
I20260709 13:12:15.101613 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 991) took 1522 ms. Trace:
I20260709 13:12:15.091697 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:15.080621 28727 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:15.079646 28728 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:15.152459 28578 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:15.184437 29258 rpcz_store.cc:276] 0709 13:12:13.578863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.787619 (+1208756us) service_pool.cc:224] Handling call
0709 13:12:14.817808 (+ 30189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.080570 (+262762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.080623 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:15.080659 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:15.080711 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.101250 (+ 20539us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54005b1dd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:15.101325 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.101521 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603577728}
W20260709 13:12:15.110412 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62329us
W20260709 13:12:15.190125 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.190582 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:15.104470 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:15.082933 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:15.089958 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:15.184312 28575 pending_rounds.cc:107] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:12:15.106349 31967 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260709 13:12:15.202046 28575 raft_consensus.cc:2889] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:15.106972 31823 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:15.074088 31694 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:15.073927 31692 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:12:15.087667 31851 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:15.091944 31929 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:15.069547 31945 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:15.132171 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:15.213806 28573 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:15.106475 31816 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.075270 31903 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:15.074730 31582 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:15.084796 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:15.092276 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:15.092911 31711 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:15.232750 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.110247 31930 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.951s	user 0.001s	sys 0.003s
I20260709 13:12:15.074574 31953 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:15.073186 31693 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 13:12:15.105209 31908 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:15.092813 31824 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:15.256862 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 53690.1us
I20260709 13:12:15.098171 28477 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.242688 28730 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:15.255600 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 52942.5us
I20260709 13:12:15.131459 31940 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
W20260709 13:12:15.275840 28479 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 388) took 12065 ms (client timeout 15000 ms). Trace:
I20260709 13:12:15.275972 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:15.242091 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:15.218065 31918 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:15.283450 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.285117 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:15.287765 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 183543us
I20260709 13:12:15.241797 31692 consensus_queue.cc:1243] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:15.285341 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:15.281436 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:15.282090 31613 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.241758 31953 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.294031 31876 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:15.290977 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 199333us
I20260709 13:12:15.239375 31582 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.294143 31953 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.237671 31903 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.282280 31799 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:15.310348 28477 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:15.311782 31799 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:15.312206 31799 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:15.313189 31799 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.314788 31799 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.277189 31823 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.316900 31748 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.289907 31711 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.318888 31823 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:15.324533 31710 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:15.284552 31956 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:15.329514 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:15.330895 31956 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:15.295300 31694 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.294071 31934 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:15.259403 31691 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:12:15.333963 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:15.334844 28723 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.237893 31912 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:15.341727 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 62140.4us
I20260709 13:12:15.312794 28477 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 6 to 8, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 8 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.348421 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:15.355427 28655 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 7. Ops: []
I20260709 13:12:15.374953 31494 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:15.375456 31494 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:15.375851 31494 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.377460 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:15.378664 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:15.380048 31582 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.379797 28477 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 6, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 6 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.381965 31525 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:15.382692 28477 catalog_manager.cc:5697] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:15.386693 28477 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.389350 28477 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:15.391426 28477 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 5, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:15.392048 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.393980 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.395731 29252 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:15.397230 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.392794 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.400015 29251 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.401804 28579 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:15.405284 31836 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.405985 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.406993 31903 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.408017 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.363219 31748 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:12:15.408671 29259 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:15.409775 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.410923 29256 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:15.412703 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.413698 29252 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.413542 31711 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.300693 31816 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:15.419301 31816 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:15.420737 31824 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:15.422318 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.423439 29255 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:15.425336 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 132098us
I20260709 13:12:15.427368 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:15.348649 31691 consensus_queue.cc:1243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:15.407068 29257 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:15.408612 31903 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.438323 28652 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
W20260709 13:12:15.451123 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 88807.2us
I20260709 13:12:15.325451 31908 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.351114 31710 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.340586 31694 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:15.473408 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 111849us
W20260709 13:12:15.479161 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 239899us
I20260709 13:12:15.464130 28725 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
W20260709 13:12:15.467151 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 124469us
I20260709 13:12:15.461995 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:15.332832 31918 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.490417 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.485829 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:15.499683 28726 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:15.503258 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:15.509485 28727 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:12:15.504860 29251 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:15.459663 31824 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.510059 28727 pending_rounds.cc:85] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 3
I20260709 13:12:15.521302 28727 pending_rounds.cc:107] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:12:15.521713 28727 raft_consensus.cc:2889] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:15.515885 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 162092us
I20260709 13:12:15.516541 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:15.515955 29253 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:15.523990 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54044us
I20260709 13:12:15.524683 28728 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
W20260709 13:12:15.281313 28479 rpcz_store.cc:269] 0709 13:12:03.126242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.126440 (+   198us) service_pool.cc:224] Handling call
0709 13:12:15.113584 (+11987144us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:06.279762 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:06.280762 (+  1000us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:06.280848 (+    86us) write_op.cc:435] Acquired schema lock
0709 13:12:06.280876 (+    28us) tablet.cc:662] Decoding operations
0709 13:12:06.282378 (+  1502us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:06.282474 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:06.282512 (+    38us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:12:06.413839 (+131327us) tablet.cc:701] Row locks acquired
0709 13:12:06.413901 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:12:06.414094 (+   193us) write_op.cc:270] Start()
0709 13:12:06.414243 (+   149us) write_op.cc:276] Timestamp: P: 1783602726414022 usec, L: 0
0709 13:12:06.414264 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:12:06.426086 (+ 11822us) log.cc:844] Serialized 4724 byte log entry
0709 13:12:07.670137 (+1244051us) op_driver.cc:464] REPLICATION: finished
0709 13:12:07.870919 (+200782us) write_op.cc:301] APPLY: starting
0709 13:12:07.871021 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:07.892468 (+ 21447us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:07.892587 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:07.909649 (+ 17062us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:07.909938 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:12:07.909992 (+    54us) write_op.cc:312] APPLY: finished
0709 13:12:07.910309 (+   317us) log.cc:844] Serialized 89 byte log entry
0709 13:12:07.927630 (+ 17321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:07.936958 (+  9328us) write_op.cc:454] Released schema lock
0709 13:12:07.942478 (+  5520us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:07.981869 (+ 39391us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:07.981902 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61040,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":187442,"apply.run_cpu_time_us":4191,"apply.run_wall_time_us":123051,"num_ops":12,"prepare.queue_time_us":194067,"prepare.run_cpu_time_us":29902,"prepare.run_wall_time_us":215721,"raft.queue_time_us":209910,"raft.run_cpu_time_us":36277,"raft.run_wall_time_us":166145,"replication_time_us":1255712,"thread_start_us":537013,"threads_started":4,"wal-append.queue_time_us":286476,"wal-append.run_cpu_time_us":84027,"wal-append.run_wall_time_us":2211862}]]}
I20260709 13:12:15.516269 31956 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:15.530026 31694 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:15.532298 31694 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:15.470420 31816 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:12:15.533033 31694 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.535379 31582 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.536932 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:15.537472 29259 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:15.539197 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:15.539331 28723 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:15.514186 29256 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:15.534067 31694 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.558719 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.560051 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:15.486291 31836 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:12:15.564420 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.567764 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.568879 29259 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:15.570971 31913 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:15.578130 31918 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:15.578528 31929 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:15.578977 31929 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:15.579983 31929 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:15.555958 31691 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:15.585276 31975 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:12:15.586088 31906 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:15.591603 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 68102.2us
I20260709 13:12:15.553416 31825 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.554530 31912 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:15.513948 31852 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:12:15.600710 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 269081us
W20260709 13:12:15.599665 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.601321 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:15.562362 29253 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
W20260709 13:12:15.611454 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 45405.7us
I20260709 13:12:15.629355 28725 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:15.557833 31940 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:15.640127 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 211108us
I20260709 13:12:15.568847 31908 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:15.589025 31913 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:15.653168 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.586711 31906 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.562292 31877 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:12:15.611624 31918 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:15.672320 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.654000 31680 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.633831 31940 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:15.587317 31823 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
W20260709 13:12:15.678580 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 124748us
I20260709 13:12:15.678603 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:15.717072 29259 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:15.640214 31836 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:12:15.719640 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 45135.4us
I20260709 13:12:15.639428 31876 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:12:15.721653 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:15.722932 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 167463us
I20260709 13:12:15.686658 31929 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.724709 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.725965 29253 raft_consensus.cc:2410] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:12:15.726089 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53223.8us
W20260709 13:12:15.740361 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.647284 31710 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.751348 29252 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:15.756337 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:15.757261 31945 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:15.758553 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:15.759271 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:15.767936 31918 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:15.768618 31913 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.716753 31825 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:15.769941 31984 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:15.771704 31680 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:15.772648 28696 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:15.779871 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:15.742456 31971 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260709 13:12:15.742209 31758 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.006s
I20260709 13:12:15.731575 31824 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:15.783219 29255 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:15.783528 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:15.784411 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 60160.8us
I20260709 13:12:15.786885 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.794696 29252 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 4.
I20260709 13:12:15.788214 31984 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:15.797389 31984 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:15.799095 29258 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:12:15.800626 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 262344us
I20260709 13:12:15.804733 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:15.805544 28655 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:15.808854 31984 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.823294 29251 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:12:15.824249 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.791671 31945 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:15.823743 29251 pending_rounds.cc:85] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 5
I20260709 13:12:15.834192 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:15.833132 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.835357 29255 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:15.809867 31691 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:15.834606 29251 pending_rounds.cc:107] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:12:15.840485 29251 raft_consensus.cc:2889] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:15.841437 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:15.838568 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.842886 29258 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.827171 31956 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.844950 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:15.845239 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.848616 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.849363 31918 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:15.850694 31956 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.851508 31956 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:15.853746 31945 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.855674 31956 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:15.859431 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.860188 29253 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.849411 29252 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:15.865547 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.876462 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.785655 31906 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.877471 29255 raft_consensus.cc:2410] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:15.878327 31692 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.882949 28649 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:15.884126 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:15.884692 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:15.838212 31691 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.885322 29259 raft_consensus.cc:2376] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7. Re-sending same reply.
I20260709 13:12:15.885385 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.886235 29252 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:15.886049 31691 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.887615 31691 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:15.888748 31494 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
I20260709 13:12:15.889700 31816 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:15.890386 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:15.885475 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:15.891394 28648 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:15.897029 28730 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.000s
I20260709 13:12:15.897979 28730 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:15.905818 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:15.908841 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:15.911734 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:15.912546 28723 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
W20260709 13:12:15.913703 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 87444.1us
I20260709 13:12:15.914990 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:15.916514 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:15.918133 28656 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:15.918098 31691 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:15.919507 31691 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:15.919967 31691 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.921689 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.922807 29255 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:15.923983 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.931497 29255 raft_consensus.cc:2410] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:15.886092 31877 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.900132 31816 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:15.921810 31825 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:15.947386 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.956184 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:15.961789 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45331.2us
I20260709 13:12:15.905696 31494 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.963308 29224 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:15.963471 31825 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.963994 31825 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:15.964522 31494 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:15.969094 28578 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:15.969357 31758 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.970148 31711 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.970556 28581 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:15.970638 31711 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.969873 31758 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.975234 31825 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:15.929863 31956 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:15.976748 31711 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:15.976688 31956 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.979372 31956 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:15.975956 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:15.980248 28723 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:15.980958 31940 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.982023 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:15.983389 31680 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:15.983896 31680 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.984347 31680 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.985704 31908 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:15.985565 31816 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:15.986876 31816 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.987283 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.988121 29251 raft_consensus.cc:2410] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:15.989658 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:15.990895 31758 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:15.993022 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:15.993394 31903 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:15.994007 31903 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:15.982292 31940 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.995018 31903 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:15.997215 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47866us
I20260709 13:12:15.998016 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:15.986099 31908 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:16.009382 29258 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:16.013497 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:16.014350 28574 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:16.018354 31906 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.019672 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:16.021162 29251 raft_consensus.cc:2410] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:16.021638 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:16.022559 29255 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:16.026363 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:16.027439 28581 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:16.027861 28575 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:16.033263 28580 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:16.033975 29253 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:16.043910 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:16.049736 28578 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:16.052595 31825 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.053121 31693 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:16.053524 31693 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.053674 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:16.053882 31693 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.055303 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:16.056144 28575 raft_consensus.cc:2368] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
W20260709 13:12:16.057891 28545 leader_election.cc:336] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.743s (SENT)
I20260709 13:12:16.058382 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:16.059930 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:16.061260 31989 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.064582 31693 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.064919 31908 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.066254 31908 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.066648 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:16.068114 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:16.073619 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:16.081229 29254 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:16.082084 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:16.082952 28581 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:16.084295 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 249858us
I20260709 13:12:16.085948 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:16.088258 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:16.036413 31758 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:12:16.089982 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:16.091447 28575 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:16.074141 31693 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:16.101878 29260 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:16.087699 31824 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:16.112495 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:16.133461 28580 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.121841 28575 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:16.137864 28547 leader_election.cc:336] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 1.797s (SENT)
W20260709 13:12:16.145750 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.091085 31758 consensus_queue.cc:1243] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:16.151446 28579 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:12:16.175899 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63856.7us
I20260709 13:12:16.176913 28572 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:12:16.183418 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 410847us
I20260709 13:12:16.101747 31694 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:16.121713 31691 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.188823 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:16.209594 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:16.207926 28545 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.838s (SENT) [suppressed 45 similar messages]
I20260709 13:12:16.183329 31693 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:16.213812 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:16.214180 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 99766.1us
I20260709 13:12:16.187373 31912 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:16.186240 31876 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.220171 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.185665 31694 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.205082 31692 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:16.233227 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 401980us
I20260709 13:12:16.193559 31993 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:16.246151 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 248230us
W20260709 13:12:16.257128 28547 leader_election.cc:336] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 1.926s (SENT)
I20260709 13:12:16.257689 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:16.258889 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:16.260267 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:16.219657 31912 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:16.261214 31816 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:16.262102 31816 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.261967 31912 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.262910 31999 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:16.263357 31999 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:16.263466 31912 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.263762 31999 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.265846 28730 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:16.266433 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 72972us
I20260709 13:12:16.269624 31997 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:16.270128 31997 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:16.270347 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:16.271292 31997 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.273806 31956 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:16.275053 31995 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:16.275321 28580 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
W20260709 13:12:16.275600 31953 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.007s
I20260709 13:12:16.277612 31710 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:16.279239 31824 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.280258 31711 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.281600 31945 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:16.232805 31876 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.283023 31852 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:16.285940 31694 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:16.287072 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:16.287894 31680 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.222370 31693 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:16.291141 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 46068.2us
I20260709 13:12:16.291415 31989 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.262483 31816 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:16.292471 28579 pending_rounds.cc:85] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 5
I20260709 13:12:16.312346 31758 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.276190 31825 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:16.247496 31993 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.318426 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:16.319417 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 59256.1us
I20260709 13:12:16.247699 32000 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.299964 28581 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:16.300266 31995 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.333806 28579 pending_rounds.cc:107] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:12:16.360127 28579 raft_consensus.cc:2889] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:16.261497 28653 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:16.344020 31680 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:16.345942 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:16.331547 31691 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:16.349049 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:16.361588 28580 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.361761 28725 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:16.357285 28547 leader_election.cc:336] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 2.066s (SENT)
I20260709 13:12:16.358592 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:16.320210 31852 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:16.427758 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:16.381397 31995 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:16.302671 31836 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:12:16.299912 31913 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:12:16.303081 31953 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.433655 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:16.336127 31816 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.337090 31997 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:16.447507 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 129164us
W20260709 13:12:16.429705 31998 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:12:16.340312 31993 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:16.450893 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 93661.8us
I20260709 13:12:16.321286 31711 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.434500 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:16.433421 31494 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.475551 28724 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:16.326725 32003 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 13:12:16.477905 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:16.443882 31680 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:16.508560 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 150047us
I20260709 13:12:16.357990 31758 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.514456 32004 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:16.451982 31989 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:12:16.515264 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:12:16.516949 32006 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:12:16.518229 28547 leader_election.cc:336] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541): Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 2.110s (SENT)
I20260709 13:12:16.521426 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:16.489877 31582 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:16.532531 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 324617us
I20260709 13:12:16.544240 28580 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:16.545881 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:16.511575 31525 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.508560 32011 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:16.546303 29224 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:16.520186 32004 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:16.565462 28725 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
W20260709 13:12:16.590302 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 321125us
I20260709 13:12:16.520778 31680 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.555568 31582 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:16.554562 31913 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:16.620062 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 101869us
I20260709 13:12:16.623234 28723 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:16.623673 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.559682 31525 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.611465 31694 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:16.612138 31691 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:16.565665 31852 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.610443 32010 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:16.629469 32011 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:16.631624 32003 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:16.661509 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:16.681649 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.682367 29256 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:16.685695 29253 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:12:16.687292 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:16.687587 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:16.647280 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:16.700228 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 222422us
I20260709 13:12:16.679611 29255 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:12:16.680353 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:16.702332 29257 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:16.702638 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 167808us
I20260709 13:12:16.680029 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:16.704140 29260 raft_consensus.cc:2410] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:12:16.645671 32013 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:12:16.642038 31906 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.002s
I20260709 13:12:16.711977 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:16.682346 32001 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:12:16.632033 31929 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:16.643404 31852 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.719121 29252 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:16.641707 31693 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:16.640930 31691 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:16.676942 31953 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:16.639032 31525 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:16.659341 32003 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:16.673646 31876 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:16.718869 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2325) took 1640 ms. Trace:
I20260709 13:12:16.649178 32010 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:16.745513 28724 rpcz_store.cc:276] 0709 13:12:15.078541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.080942 (+  2401us) service_pool.cc:224] Handling call
0709 13:12:15.084159 (+  3217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:16.488047 (+1403888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.718602 (+230555us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001b7e54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:16.718813 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3199035648}
W20260709 13:12:16.736297 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 214944us
I20260709 13:12:16.737183 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:16.640347 31694 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.660384 31748 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:12:16.742444 31711 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:16.750468 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.742666 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:16.659058 31983 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:12:16.744127 31525 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.772782 31758 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:16.773200 32030 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:12:16.775247 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:16.775909 29260 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:16.781823 29258 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:12:16.783182 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.728572 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:16.753731 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 92355.5us
I20260709 13:12:16.747131 29253 raft_consensus.cc:2368] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:12:16.755491 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:16.756727 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 241580us
I20260709 13:12:16.764186 28728 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:16.764650 28726 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:16.765196 28729 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:16.765326 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:16.788213 28723 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.766052 31691 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.728379 31929 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.767508 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:16.769058 32002 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:16.771181 28581 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:16.765841 28727 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:12:16.793519 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 70167us
I20260709 13:12:16.711583 31816 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.776822 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:16.649729 31582 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.648326 32004 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.797982 28547 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:16.839527 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:16.795349 31912 consensus_meta.cc:287] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.531s	user 0.006s	sys 0.006s
I20260709 13:12:16.751550 32010 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:16.862998 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 75445.7us
I20260709 13:12:16.866997 28729 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:16.870312 29257 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:16.810568 31997 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:16.883307 28728 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:16.810802 31989 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.884591 28654 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:16.783317 31953 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
W20260709 13:12:16.854543 32013 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:16.904001 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:16.906929 29257 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:16.905426 28723 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:16.910985 29257 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:12:16.916261 29257 pending_rounds.cc:85] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 5
I20260709 13:12:16.916781 29257 pending_rounds.cc:107] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:12:16.917243 29257 raft_consensus.cc:2889] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:16.918885 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 72608.7us
I20260709 13:12:16.882256 31956 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:16.921722 29257 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 13:12:16.924047 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49225.3us
I20260709 13:12:16.924288 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1061) took 1065 ms. Trace:
I20260709 13:12:16.859180 32002 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:16.924685 29251 rpcz_store.cc:276] 0709 13:12:15.859398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.022935 (+163537us) service_pool.cc:224] Handling call
0709 13:12:16.023302 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:16.023916 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.023948 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:16.024661 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.214325 (+189664us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:16.219827 (+  5502us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.220039 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.220115 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.924083 (+703968us) raft_consensus.cc:1685] finished
0709 13:12:16.924105 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.924235 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7976,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":4513,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":11582,"thread_start_us":189282,"threads_started":1,"wal-append.queue_time_us":464061}
W20260709 13:12:16.918332 31999 consensus_meta.cc:287] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.002s
I20260709 13:12:16.913791 32004 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:16.930668 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:16.931588 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:16.918815 31824 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:16.902575 31995 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.922955 31758 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.922991 31956 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:16.926661 32051 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:16.948678 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:16.929098 31997 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:16.962988 28723 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:16.907135 31989 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:16.966301 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 180907us
W20260709 13:12:16.956846 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52951.4us
I20260709 13:12:16.932641 31908 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:12:16.975745 28648 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:16.948925 31836 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:12:16.979228 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 51427.3us
I20260709 13:12:16.979470 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:16.980463 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:16.974085 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 108875us
I20260709 13:12:16.985100 32032 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:16.985750 32032 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:16.986723 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:16.987437 28649 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
W20260709 13:12:16.987720 32007 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
I20260709 13:12:16.988174 32032 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:16.989024 32025 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:12:16.989277 32051 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.997831 28650 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:16.991716 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:16.943553 31999 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.060746 28725 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:17.070990 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:16.946163 32038 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:12:16.924139 32003 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:16.967785 31824 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:17.077370 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 98716us
I20260709 13:12:17.098310 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:17.078074 32042 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:12:17.078549 32043 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:12:17.079336 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 99975.6us
I20260709 13:12:17.079815 32052 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:17.080910 31956 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.085121 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.085281 31816 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:16.984071 31525 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:12:17.087569 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1008) took 1325 ms. Trace:
I20260709 13:12:17.106566 29252 rpcz_store.cc:276] 0709 13:12:15.762122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.989395 (+227273us) service_pool.cc:224] Handling call
0709 13:12:17.087350 (+1097955us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b540044edd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:17.087501 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675543424}
I20260709 13:12:17.088241 32035 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:16.967123 31912 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:12:17.090708 31694 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:17.076124 28723 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:12:16.967470 31758 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:17.107323 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 122377us
I20260709 13:12:17.120842 28547 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.120797 29260 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:17.151582 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.096632 32051 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:17.155249 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:17.101581 31929 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:17.107941 32052 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.158943 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.164116 28730 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:17.166190 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.167078 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:17.164693 32026 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:17.168044 28650 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:17.062036 32002 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.164819 32054 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.180503 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.181270 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:17.194159 28725 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.180088 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.187381 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2335) took 1430 ms. Trace:
W20260709 13:12:17.206672 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.196177 28722 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:17.172456 31956 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.165596 32052 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.235916 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:17.240005 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 59602.3us
I20260709 13:12:17.241279 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.185463 32002 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.243220 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.297346 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.194265 32039 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:17.213133 31836 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:17.178073 32026 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:17.139142 31997 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:17.179528 32035 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:17.179287 32051 raft_consensus.cc:2764] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:17.197546 28652 rpcz_store.cc:276] 0709 13:12:15.756897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.758450 (+  1553us) service_pool.cc:224] Handling call
0709 13:12:15.758821 (+   371us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:12:15.759365 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.759394 (+    29us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:12:15.760262 (+   868us) log.cc:844] Serialized 104 byte log entry
0709 13:12:16.049429 (+289167us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:16.318308 (+268879us) log.cc:844] Serialized 14 byte log entry
0709 13:12:17.186678 (+868370us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18002cdca0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287
0709 13:12:17.186826 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.186920 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.186977 (+    57us) raft_consensus.cc:1685] finished
0709 13:12:17.187098 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.187313 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3955,"prepare.queue_time_us":500913,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":65612,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":11694,"spinlock_wait_cycles":2556672,"thread_start_us":786764,"threads_started":3,"wal-append.queue_time_us":388301}
I20260709 13:12:17.319407 28730 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:17.235090 32038 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.242800 32057 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.330619 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 209867us
W20260709 13:12:17.296360 31852 consensus_meta.cc:287] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
W20260709 13:12:17.334805 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 93652.2us
I20260709 13:12:17.337790 29258 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:17.329430 28725 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:17.340296 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.344923 28730 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:17.346202 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.350097 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.351027 28722 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:17.243809 31989 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:17.356298 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.334393 32035 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.189838 32054 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:17.382717 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.386245 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.387591 28722 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:17.343523 32039 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:17.397408 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:17.401866 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 58893.5us
I20260709 13:12:17.395359 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.414976 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:17.415647 28725 raft_consensus.cc:2376] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5. Re-sending same reply.
I20260709 13:12:17.416576 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.417485 28725 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:17.419450 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:17.414048 28722 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:17.422901 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.422859 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.388509 31852 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:17.427561 28730 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:17.430059 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:17.386934 32035 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:17.433749 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51159.5us
I20260709 13:12:17.429622 31525 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:17.401592 31758 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:17.440649 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:17.428900 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.443092 28730 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:17.445876 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:17.430317 31913 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.001s
I20260709 13:12:17.415424 32051 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:17.449283 32062 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:17.449492 32033 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:12:17.360265 32038 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:17.450119 32049 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.352s	user 0.001s	sys 0.001s
W20260709 13:12:17.450989 32044 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:12:17.451593 32053 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:12:17.410226 31999 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:17.456784 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.437959 31525 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:17.448626 32055 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.441154 31824 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:17.421260 32039 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.352253 32057 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.404122 32061 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:17.493316 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 509643us
W20260709 13:12:17.527766 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 71087.1us
I20260709 13:12:17.387528 32037 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:17.511440 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 70931.4us
W20260709 13:12:17.492823 32058 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:12:17.532717 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.453905 31852 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:17.495597 31929 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:17.517158 32004 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.001s
I20260709 13:12:17.490087 32034 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:17.461937 31913 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:17.538348 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.524694 31836 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:17.539629 31758 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:17.543679 32062 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.544283 32057 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:17.528229 32055 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.544703 31986 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:17.595448 31986 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:17.595955 31986 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:17.549849 32041 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:12:17.550338 32038 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:17.509944 32026 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:17.551015 32056 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:12:17.532922 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.524036 31525 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.493592 32032 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:12:17.565042 32037 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:17.586071 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47841.2us
W20260709 13:12:17.570492 31993 consensus_meta.cc:287] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.053s	user 0.011s	sys 0.002s
I20260709 13:12:17.535337 31711 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.601465 28547 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.553350 31929 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:17.635797 32037 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.635206 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:17.640496 28721 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:17.635178 31929 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:17.552680 31999 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:17.570220 32025 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.615360 31693 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:17.619731 29259 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:17.589386 31582 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.625452 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 92668.8us
I20260709 13:12:17.593243 32004 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:17.616659 31710 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:17.596848 32045 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.570259 31816 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:12:17.630565 32026 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.635174 32034 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:17.628314 31903 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:17.646330 31913 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:17.775271 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:17.776248 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:17.776439 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:17.777707 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 159099us
I20260709 13:12:17.778949 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2497) took 1040 ms. Trace:
I20260709 13:12:17.651259 31999 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:17.706501 31693 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.752756 31710 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.782313 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:17.782503 32074 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:17.783039 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 202507us
I20260709 13:12:17.783625 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:17.785036 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:17.779295 28578 rpcz_store.cc:276] 0709 13:12:16.738768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.739043 (+   275us) service_pool.cc:224] Handling call
0709 13:12:16.749586 (+ 10543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:16.843346 (+ 93760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.843391 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:16.885525 (+ 42134us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.955295 (+ 69770us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:16.955417 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.955761 (+   344us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.778719 (+822958us) raft_consensus.cc:1685] finished
0709 13:12:17.778740 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.778882 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81653,"raft.queue_time_us":149452,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":11026,"spinlock_wait_cycles":1485056,"thread_start_us":25414,"threads_started":1,"wal-append.queue_time_us":417007}
W20260709 13:12:17.760157 31956 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 13:12:17.646028 31711 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.642666 31993 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:17.762465 32065 raft_consensus.cc:2764] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:17.804435 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:17.805087 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:17.802538 32063 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:12:17.803424 32071 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:12:17.780237 32073 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.813362 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 169340us
I20260709 13:12:17.805335 28651 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:17.748692 31582 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.747063 31694 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:12:17.810863 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:17.816306 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 159110us
I20260709 13:12:17.754752 31824 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:12:17.751819 32045 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.778409 32054 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:17.792183 31999 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.753271 32025 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.821837 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2495) took 1091 ms. Trace:
I20260709 13:12:17.810535 31956 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.760478 31852 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.824239 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.825521 28695 leader_election.cc:400] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:12:17.831125 28695 leader_election.cc:403] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:12:17.822057 28547 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.828126 28580 rpcz_store.cc:276] 0709 13:12:16.730402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.730545 (+   143us) service_pool.cc:224] Handling call
0709 13:12:16.744708 (+ 14163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:17.060300 (+315592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.060335 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:17.061726 (+  1391us) log.cc:844] Serialized 26 byte log entry
0709 13:12:17.199302 (+137576us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:17.199361 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.199460 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.821607 (+622147us) raft_consensus.cc:1685] finished
0709 13:12:17.821630 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.821766 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48227,"raft.queue_time_us":107207,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":27626,"thread_start_us":335981,"threads_started":2,"wal-append.queue_time_us":496961}
I20260709 13:12:17.784605 31913 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.835139 29224 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:17.761451 32078 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 13:12:17.841790 32002 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:17.842746 32002 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:17.843089 32002 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:17.843916 32002 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.838645 31903 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:17.760066 31836 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.850776 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 761) took 1559 ms. Trace:
I20260709 13:12:17.851182 28579 rpcz_store.cc:276] 0709 13:12:16.291657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.291894 (+   237us) service_pool.cc:224] Handling call
0709 13:12:16.292268 (+   374us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:16.517245 (+224977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.517288 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:12:16.533461 (+ 16173us) log.cc:844] Serialized 78 byte log entry
0709 13:12:16.735830 (+202369us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:16.752288 (+ 16458us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.752734 (+   446us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.784149 (+ 31415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.784218 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.850562 (+1066344us) raft_consensus.cc:1685] finished
0709 13:12:17.850581 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.850722 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76177,"prepare.queue_time_us":162537,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":87,"raft.queue_time_us":196195,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":23551,"spinlock_wait_cycles":20253824,"thread_start_us":128901,"threads_started":1,"wal-append.queue_time_us":727503}
W20260709 13:12:17.854072 32060 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.536s	user 0.001s	sys 0.003s
I20260709 13:12:17.839336 31956 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.836006 32034 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:12:17.821481 32032 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:17.856348 31956 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:17.856972 31995 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:17.862020 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1337) took 1178 ms. Trace:
I20260709 13:12:17.862136 31956 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:17.862466 29258 rpcz_store.cc:276] 0709 13:12:16.683900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.782729 (+ 98829us) service_pool.cc:224] Handling call
0709 13:12:16.782995 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:17.343189 (+560194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.861798 (+518609us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400215f54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:17.861960 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275338112}
I20260709 13:12:17.864355 31824 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:17.864810 31824 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:17.865761 31824 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.867106 31824 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:17.837769 32065 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:17.872288 32002 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.874608 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:17.877846 28726 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:17.880424 31582 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:17.880976 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:17.881608 28730 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:17.821686 32073 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:17.856730 32032 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.821086 32061 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:17.891346 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56321.6us
I20260709 13:12:17.895983 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2339) took 1142 ms. Trace:
I20260709 13:12:17.828054 32054 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:17.896334 28650 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:17.909096 28651 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:17.864441 32039 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:17.913913 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:17.925730 31710 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:17.926338 31710 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.926548 32025 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:17.926956 28650 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:17.926810 31710 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.907545 28724 rpcz_store.cc:276] 0709 13:12:16.754023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.754788 (+   765us) service_pool.cc:224] Handling call
0709 13:12:16.755122 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:16.810107 (+ 54985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:16.810137 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:16.855184 (+ 45047us) log.cc:844] Serialized 26 byte log entry
0709 13:12:17.095454 (+240270us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:17.095510 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:17.095620 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.853417 (+757797us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:17.885241 (+ 31824us) raft_consensus.cc:1685] finished
0709 13:12:17.885274 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.895906 (+ 10632us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33650,"raft.queue_time_us":91857,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":40521,"spinlock_wait_cycles":4277504,"thread_start_us":168823,"threads_started":1,"wal-append.queue_time_us":245458}
I20260709 13:12:17.930053 32061 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:17.932487 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 110464us
I20260709 13:12:17.934552 31693 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:17.934819 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:17.936991 28655 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:17.937356 28730 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:17.939553 28652 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
W20260709 13:12:17.908998 32010 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.026s	user 0.013s	sys 0.000s
I20260709 13:12:17.944952 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:17.947793 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.908524 31582 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:17.931470 32061 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.928815 31710 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:17.965989 31945 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:17.966813 28573 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:12:17.896584 31816 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:12:17.970930 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:17.848848 31525 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:17.967314 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:17.896770 31912 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:12:17.967864 31903 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.973912 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:17.974462 28574 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:17.945400 32054 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:17.975543 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:17.962631 31852 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:17.962568 32032 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:17.979866 28575 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:17.979482 28577 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:17.945748 32036 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:17.983683 28572 raft_consensus.cc:2410] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:17.960044 31582 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:17.958986 32055 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:17.959316 32039 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.978101 28579 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:12:17.919685 31986 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:17.978271 31956 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:17.979066 32083 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:18.003806 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:18.011355 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 67599.9us
I20260709 13:12:17.957248 32010 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.017822 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:18.024611 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:18.025990 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:18.026649 28652 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:18.028000 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.029485 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.029614 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:18.030329 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:17.999616 31582 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.005995 31852 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:18.038443 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:18.040099 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:18.040812 28652 raft_consensus.cc:2376] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6. Re-sending same reply.
I20260709 13:12:18.007282 31956 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:18.043082 28653 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:17.986276 31903 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.039716 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.045382 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:18.038663 31693 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:18.050869 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.054728 28573 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:18.053925 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:18.055509 28652 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:18.065286 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.065640 31525 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.066676 32073 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.066850 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.067812 28573 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:18.069629 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:18.070523 28652 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:17.985801 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:18.071527 28580 raft_consensus.cc:606] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:18.071997 28580 raft_consensus.cc:614] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:18.068730 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.008769 32039 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.074038 28573 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:18.076424 28649 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:18.078222 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.086220 31494 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:18.086671 32094 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:18.086678 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:18.089145 31693 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.089833 31693 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.089217 28652 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:18.046880 31993 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:18.055696 32035 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 13:12:18.092760 28656 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:12:18.091436 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:18.051167 31711 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.054136 32017 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:18.106249 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.020766 32083 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.147727 28581 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:18.149520 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.150210 28573 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:18.090267 31693 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.086745 31494 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:18.158860 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.166610 32039 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.136520 32017 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.169493 32017 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.171402 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:18.176118 31903 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.103497 32078 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:18.182497 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 131076us
I20260709 13:12:18.110147 32045 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.110008 32032 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:18.185887 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:18.143849 31680 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:18.162220 32085 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:12:18.187273 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.193904 28573 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:18.193971 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:18.149050 31710 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.133608 32035 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.136256 32081 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:12:18.210700 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.217455 31494 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.257913 31494 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:18.229516 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.210086 32039 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.261569 32039 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.154352 31711 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:12:18.163370 31852 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.152935 31956 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.251564 31999 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.260840 28573 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:18.268021 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2351) took 1336 ms. Trace:
I20260709 13:12:18.265376 28647 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:18.275656 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:18.301249 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:18.307551 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.308367 29260 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 4: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:18.305212 28653 rpcz_store.cc:276] 0709 13:12:16.931091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.931216 (+   125us) service_pool.cc:224] Handling call
0709 13:12:16.946091 (+ 14875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.046519 (+1100428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.267642 (+221123us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540027db54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:18.267931 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522285440}
I20260709 13:12:18.311988 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:18.312585 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:18.213129 32052 consensus_meta.cc:287] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.889s	user 0.013s	sys 0.000s
I20260709 13:12:18.317483 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.325356 29256 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:18.092525 32054 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.232693 32010 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.348213 29257 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:18.326551 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:18.333702 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 139796us
I20260709 13:12:18.350252 32096 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:12:18.352118 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.336151 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:18.264588 32035 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.336872 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.255155 31680 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.357645 29255 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:18.338035 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:18.275158 32087 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:12:18.343796 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.369210 28573 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:18.343926 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.271595 32083 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:18.265617 32098 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
W20260709 13:12:18.345083 32026 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.001s
W20260709 13:12:18.347595 28696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.001s	sys 0.018s
I20260709 13:12:18.200213 31710 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.264722 32039 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.284519 32002 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.354933 28648 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:18.275658 31986 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.256695 32078 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:18.360015 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.360498 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:18.406200 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 46249.3us
I20260709 13:12:18.290001 31993 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.269327 31913 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.311175 32055 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.310927 31758 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.324509 31940 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:18.371418 28696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.003s	sys 0.019s
I20260709 13:12:18.390707 32083 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:18.438159 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.380911 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:18.438920 28579 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:18.370369 29251 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:18.396553 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.354662 31956 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.376216 31680 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:18.399494 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62557.3us
I20260709 13:12:18.284729 31582 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.406315 29260 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:18.410955 32074 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:18.390131 31710 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.432662 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:18.347968 32052 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.414193 31993 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.411677 32078 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.436189 31999 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.436188 28572 raft_consensus.cc:606] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:18.479607 28572 raft_consensus.cc:614] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:18.438056 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 1.00842e+06us
I20260709 13:12:18.481156 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:18.374483 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:18.369904 32061 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:12:18.338011 31748 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.467541 28575 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.452034 31940 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.455623 31494 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.481171 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.484498 28576 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:18.468568 32074 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.438536 32055 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.466696 32032 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:18.486910 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.451805 31758 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.455660 32083 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.493103 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:18.498150 28578 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:18.488765 31940 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.486435 31748 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.502698 32101 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:12:18.503007 31582 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.496910 31525 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:18.503439 32100 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.499106 32017 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.491689 32074 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.512413 31525 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.517812 31525 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.490602 32093 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:18.509835 31748 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.514581 32017 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:18.513913 31758 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:18.499218 32032 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.497941 31494 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.530876 32078 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.505587 31693 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.542655 31993 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.543285 32055 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.544684 32083 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.545918 31680 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:18.546622 31494 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.547513 32052 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.548470 31525 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.570163 31525 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.572964 31693 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.555982 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.556908 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.557536 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:18.576406 29259 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:18.576632 29258 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.577414 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:18.577962 29259 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.559793 31710 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.580080 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.581112 28577 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:18.576406 29251 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:18.582149 31710 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:18.574040 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 81059.7us
I20260709 13:12:18.583963 28696 leader_election.cc:400] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:12:18.584267 28696 leader_election.cc:403] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.586159 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.574579 32099 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.564123 32074 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:18.575649 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.587075 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.551239 31748 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.587960 28575 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:18.597863 29258 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:18.603205 29254 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:18.622799 28547 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.630993 28575 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:12:18.633664 28579 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:18.634361 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48987.6us
I20260709 13:12:18.603024 32101 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.603549 32099 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:18.625815 32055 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:18.624321 31525 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:18.604460 32078 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5.
I20260709 13:12:18.624666 31494 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.667898 28696 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:18.644449 32099 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.624904 32098 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:12:18.645794 31525 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.641247 32094 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:12:18.652495 31494 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:18.685766 31748 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.661226 32055 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:18.673916 31693 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.643115 32096 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:12:18.694159 31693 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.683398 32078 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:18.683040 31525 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.712054 31940 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.667006 32045 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:12:18.645129 32101 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:18.728595 28545 leader_election.cc:336] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.738s (SENT)
I20260709 13:12:18.765888 31940 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.771478 32101 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:18.779695 28545 leader_election.cc:336] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.774s (SENT)
I20260709 13:12:18.780503 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:18.784428 32054 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:18.739573 29259 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:18.692698 31494 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.801797 32032 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:18.781679 31693 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.772588 31525 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.802881 32055 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.804328 31525 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:18.809304 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 132027us
I20260709 13:12:18.753690 32078 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:18.813042 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:18.813506 29259 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.815763 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:18.816556 28577 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:18.812417 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.818300 31525 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:18.818594 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:18.819720 28577 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:12:18.819007 31525 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:18.842231 31525 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.842550 31945 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:18.843415 31945 consensus_queue.cc:1243] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:18.843981 32094 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:18.844440 32094 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.844841 32094 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.846621 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 732) took 1094 ms. Trace:
I20260709 13:12:18.844944 31693 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.847074 28648 rpcz_store.cc:276] 0709 13:12:17.752546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.753749 (+  1203us) service_pool.cc:224] Handling call
0709 13:12:18.846350 (+1092601us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540006fed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:18.846525 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314199936}
I20260709 13:12:18.847553 31693 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.848836 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 740) took 1025 ms. Trace:
I20260709 13:12:18.849258 28651 rpcz_store.cc:276] 0709 13:12:17.823455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.823596 (+   141us) service_pool.cc:224] Handling call
0709 13:12:17.908593 (+ 84997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:17.909715 (+  1122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.848633 (+938918us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b5400259c50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:18.848779 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175157504}
I20260709 13:12:18.849596 32099 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.850526 31824 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.850723 28654 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:18.850843 31693 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:18.851854 32099 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.854012 29259 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:18.858745 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:18.861877 32054 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:18.862421 32054 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:18.862840 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:18.863279 32054 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.864930 32034 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:18.864984 32094 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.865458 32034 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:18.856721 32098 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:12:18.866633 32034 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.867334 32094 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:18.869386 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.870024 29253 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:18.870363 29251 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:18.841291 32074 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.883015 31956 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:18.884521 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:18.885730 32098 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:18.886483 32098 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:18.886994 32098 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.889462 31494 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.893533 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 739) took 1092 ms. Trace:
I20260709 13:12:18.893949 28656 rpcz_store.cc:276] 0709 13:12:17.800934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.801124 (+   190us) service_pool.cc:224] Handling call
0709 13:12:18.085283 (+284159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.105440 (+ 20157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.893345 (+787905us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540027ea50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:18.893473 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623004928}
I20260709 13:12:18.895372 32081 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.895485 32130 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.895978 32081 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.896186 32130 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.869334 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:18.871255 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.873596 32101 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:18.874130 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:18.876125 29257 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:18.904838 29259 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.906599 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:18.907035 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:18.907341 28729 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.909644 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:18.909884 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:18.910559 28730 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:18.877219 32078 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:18.912422 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:18.913879 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:18.914227 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:18.914638 28725 raft_consensus.cc:2368] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8.
I20260709 13:12:18.915546 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:18.916203 28725 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:18.916496 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:18.917193 28728 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:18.918318 28730 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:18.926353 29259 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:18.936348 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:18.936815 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:18.938405 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:18.939232 28721 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:18.946439 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:18.912747 31956 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.899945 32130 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.959336 28729 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:18.917145 32099 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.898319 32081 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.917728 31494 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:18.905263 32101 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:18.966216 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 154864us
I20260709 13:12:18.904328 32098 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.962554 32094 raft_consensus.cc:2764] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:18.976052 28729 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:18.973757 28545 leader_election.cc:336] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.794s (SENT)
I20260709 13:12:18.978295 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:18.982062 28726 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
W20260709 13:12:18.982609 28545 leader_election.cc:336] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.820s (SENT)
I20260709 13:12:18.963279 32045 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:18.963491 31956 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:18.966753 32099 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:18.992873 28545 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.871s (SENT)
I20260709 13:12:18.994619 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:18.995905 31945 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:18.999847 31945 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.000658 32098 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:18.987388 31494 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:19.002091 28723 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:19.020789 28545 leader_election.cc:400] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8.
I20260709 13:12:19.021278 28545 leader_election.cc:403] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.991901 32002 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:19.022645 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:19.024842 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.024678 32002 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.023553 31983 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.027088 32002 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:19.028192 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.002115 32055 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.034041 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:19.036712 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.037388 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.041339 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:19.043534 32105 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:19.043649 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.044258 28728 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:19.044162 32105 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.047863 32105 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:19.049633 28728 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:19.049736 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.051906 31945 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:19.052609 31989 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:19.058810 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.060163 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:19.062160 31956 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:19.063424 32131 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:19.073246 32099 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:19.039665 31993 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:12:19.073459 31983 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8.
I20260709 13:12:19.033190 32074 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:19.050454 31748 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:19.036819 32040 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:12:19.094280 31748 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.094892 31748 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.094923 32040 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:19.095503 32040 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:19.097363 32099 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:19.097918 32126 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.385s	user 0.008s	sys 0.004s
I20260709 13:12:19.097961 32099 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.100616 32099 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:19.096413 32040 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.102389 32040 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.103117 32101 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.104442 32101 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.107539 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:19.110731 29259 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:19.111344 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:19.115811 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:19.116683 29257 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.120110 29260 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:19.123059 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:19.134176 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.147809 29257 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:19.140901 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:19.153393 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.153483 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:19.154269 28728 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:19.160877 28575 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:19.162431 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:19.152420 31983 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:19.167619 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:19.168888 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.152889 31694 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.170127 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:19.155661 32105 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.170711 32032 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:19.175228 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:19.175493 32122 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:19.177552 32135 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:12:19.180254 32074 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:19.155280 31693 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:19.181749 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.184413 28573 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:19.163872 32065 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:19.153734 32055 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:12:19.155510 31993 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:12:19.169034 31956 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:19.189340 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.191033 31929 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.195710 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:19.181592 31983 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:19.202883 32136 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.205688 32136 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.208604 32136 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:19.209342 28574 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:19.199649 31945 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:19.220916 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 765) took 1194 ms. Trace:
I20260709 13:12:19.221418 28580 rpcz_store.cc:276] 0709 13:12:18.026964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.257941 (+230977us) service_pool.cc:224] Handling call
0709 13:12:18.258420 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.258684 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:18.334933 (+ 76249us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.083674 (+748741us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b1800486f40. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:19.200169 (+116495us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b1800486f40. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a2b80e3c7 00007f4a27e209a7 00007f4a27e300bf 00007f4a27e30038
0709 13:12:19.220046 (+ 19877us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.220447 (+   401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.220505 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:19.220558 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.220678 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.220850 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133367,"prepare.queue_time_us":958547,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":87,"raft.queue_time_us":1313,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5497,"spinlock_wait_cycles":15680256,"thread_start_us":133168,"threads_started":2,"wal-append.queue_time_us":136026}
I20260709 13:12:19.223538 28580 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:19.195190 32122 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:19.200994 32065 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:19.195001 31693 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.226739 31945 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:19.215659 31956 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:19.217850 32039 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:19.240145 31983 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.244494 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:19.252029 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:19.185179 31694 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.246119 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:19.246294 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.185573 32105 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.235873 32122 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.247257 28727 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:19.253043 28724 raft_consensus.cc:2410] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:19.253979 28573 raft_consensus.cc:2410] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:12:19.259516 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.260313 32032 raft_consensus.cc:2764] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:19.260895 32065 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.265323 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.265566 28581 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:12:19.266353 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 91210.9us
I20260709 13:12:19.266474 28580 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:19.268165 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.264605 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:19.270004 31748 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.263422 31691 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:19.262387 31993 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.274174 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.274593 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.250222 32039 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:19.281185 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.277966 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.262553 32122 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.286021 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.298102 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:19.298303 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:19.267648 32032 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:12:19.317266 32153 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:19.270735 31945 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.320349 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:19.352092 28573 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.322005 31956 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.324122 32105 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:19.326457 31694 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:19.312201 31691 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:19.283842 31993 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.338359 31693 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:19.338691 32023 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:19.306118 31953 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:19.349751 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.370790 28577 raft_consensus.cc:2410] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:19.360723 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.367255 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:19.371447 29259 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.378815 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:19.379309 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:19.349093 32040 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:19.381666 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 64396.1us
I20260709 13:12:19.383159 29259 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:19.375502 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:19.385717 29255 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:19.386813 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:19.391211 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.391466 28724 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:19.394759 29260 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:19.396369 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.396637 31748 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:19.397161 32098 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.397535 32052 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:19.397994 32052 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.397729 32098 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.398350 32052 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.400044 32098 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:19.405665 28656 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:19.406579 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2360) took 1517 ms. Trace:
W20260709 13:12:19.406454 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 1.05391e+06us
I20260709 13:12:19.409371 29260 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:19.375847 31953 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:19.418520 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.388710 32004 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:19.422662 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.407070 28650 rpcz_store.cc:276] 0709 13:12:17.889694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.927908 (+ 38214us) service_pool.cc:224] Handling call
0709 13:12:17.928189 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:17.928372 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:18.019604 (+ 91232us) log.cc:844] Serialized 14 byte log entry
0709 13:12:18.143459 (+123855us) log.cc:844] Serialized 14 byte log entry
0709 13:12:18.514337 (+370878us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18001563a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d29522 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:19.189241 (+674904us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b18001563a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d29522 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:19.351983 (+162742us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b18001563a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:12:19.352491 (+   508us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.406268 (+ 53777us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.406313 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:19.406359 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.406422 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.406527 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3447,"prepare.queue_time_us":531639,"prepare.run_cpu_time_us":165,"prepare.run_wall_time_us":30411,"raft.queue_time_us":1217098,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":25883,"spinlock_wait_cycles":23627264,"thread_start_us":226085,"threads_started":3,"wal-append.queue_time_us":179440,"wal-append.run_cpu_time_us":1904,"wal-append.run_wall_time_us":1042980}
I20260709 13:12:19.414518 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:19.400970 32074 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.377152 32023 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:19.419515 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.420300 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:19.412787 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 114811us
I20260709 13:12:19.422595 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.427946 28648 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:19.422719 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:19.416649 28573 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:19.424484 28655 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:19.428289 28649 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:19.428844 28723 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.431594 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:19.428874 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:19.432770 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.435220 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.436053 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.436501 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:19.436896 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.412781 32010 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:19.437805 28725 raft_consensus.cc:2410] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:12:19.438510 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:19.416687 32035 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:19.441563 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.423300 31986 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.462092 31986 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:19.464490 32148 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.204s	user 0.000s	sys 0.002s
I20260709 13:12:19.464771 32035 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.422947 32026 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:19.392814 32040 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.445870 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.474707 28649 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:19.447438 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.477200 28730 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
W20260709 13:12:19.447642 28574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 767) took 1420 ms (client timeout 1540 ms). Trace:
I20260709 13:12:19.448534 31953 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.449456 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.450819 32038 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:19.451921 32070 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.452286 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.538259 28653 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.453126 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.453346 32100 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:19.453714 31852 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:19.454245 31693 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:19.561856 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.440778 32032 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:19.459524 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 45493.1us
I20260709 13:12:19.453142 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:19.464519 31986 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:19.567456 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 114387us
I20260709 13:12:19.441258 28577 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:19.467645 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.468915 28656 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:19.478333 28574 rpcz_store.cc:269] 0709 13:12:18.027502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.029244 (+  1742us) service_pool.cc:224] Handling call
0709 13:12:19.447461 (+1418217us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001a9d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:19.447587 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2711446272}
W20260709 13:12:19.519301 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45625.2us
I20260709 13:12:19.519393 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:19.574028 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.433820 32074 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.524366 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.524518 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1032) took 1217 ms. Trace:
I20260709 13:12:19.581655 29254 rpcz_store.cc:276] 0709 13:12:18.307473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.307589 (+   116us) service_pool.cc:224] Handling call
0709 13:12:19.524300 (+1216711us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001559d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:19.524453 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520908160}
I20260709 13:12:19.440423 32078 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:19.563161 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.605224 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.605916 28650 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:19.454828 31993 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:19.434511 32105 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:12:19.439143 32155 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:19.578650 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.626233 29259 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:19.627329 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.628144 29259 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:19.518247 31983 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.595278 28723 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:19.606110 29255 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:19.580832 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.440407 32004 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.636758 31983 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.638619 32004 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:19.566186 32032 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:19.614086 32139 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:12:19.630472 29259 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:12:19.633488 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.798926 28652 raft_consensus.cc:2376] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6. Re-sending same reply.
I20260709 13:12:19.633817 28656 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 7: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:19.465646 32010 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.634752 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:19.474337 32052 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.635926 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:19.804534 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 168719us
I20260709 13:12:19.805429 28696 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:19.565176 32070 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.576428 31525 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.521737 32026 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.482198 32147 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:12:19.578308 31953 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.585266 32136 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:19.561787 31691 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:12:19.568063 31852 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.567806 32038 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.646836 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.721644 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.792099 32065 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:19.686362 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 218683us
I20260709 13:12:19.836442 28723 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:19.779793 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.785709 28653 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:19.605217 31693 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.697614 29256 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:19.816375 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.818785 28696 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:19.821046 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49014 (request call id 23) took 1544 ms. Trace:
I20260709 13:12:19.619668 28649 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
W20260709 13:12:19.699684 32160 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:12:19.792506 32032 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:19.738103 32150 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:19.828640 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.818919 32100 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:19.838521 29260 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:19.845713 28652 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.626762 32078 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.829478 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.853844 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.860116 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:19.699159 31993 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.834256 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.792107 31929 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:19.779927 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.840691 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.840071 28572 rpcz_store.cc:276] 0709 13:12:18.273422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.275497 (+  2075us) service_pool.cc:224] Handling call
0709 13:12:19.817232 (+1541735us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540031e554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e10853 00007f4a2cdde60a 00007f4a263647d4 00007f4a26364762 00007f4a26364691 00007f4a2636460c 00007f4a263638c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:19.817370 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298190208}
I20260709 13:12:19.844732 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.827912 32094 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:19.821514 32034 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.850616 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.872272 28650 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
W20260709 13:12:19.827075 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 237643us
I20260709 13:12:19.874475 28649 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.872608 28653 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:19.879914 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.872184 28656 raft_consensus.cc:2376] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7. Re-sending same reply.
I20260709 13:12:19.888259 29251 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:19.890472 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.852263 32136 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.849363 32153 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:19.721791 32039 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.863446 32093 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:19.857719 32036 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:19.909873 28650 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:19.827137 31525 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:19.876794 32122 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.001s
I20260709 13:12:19.871441 31983 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:19.847710 31693 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.885836 32105 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:19.849849 32065 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.915549 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.957111 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:19.961565 28653 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.964071 28655 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
W20260709 13:12:19.965437 28477 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 275) took 16783 ms (client timeout 15000 ms). Trace:
I20260709 13:12:19.966524 29252 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:19.969632 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.970695 28654 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:19.971709 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.977558 28649 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
W20260709 13:12:19.935895 32142 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:12:19.923666 32093 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.930006 28652 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:19.987413 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:19.918686 32035 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:19.992025 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:19.887964 31929 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:19.996138 28655 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:19.942530 32040 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:20.001471 29259 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:19.942469 32074 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:19.948482 32036 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:19.892488 31993 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.006484 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.009930 28653 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
W20260709 13:12:20.008004 28728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.030s	sys 0.082s
I20260709 13:12:20.013365 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:20.013675 28728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.030s	sys 0.082s
I20260709 13:12:19.919776 32136 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:19.996616 32093 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.918521 32153 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:19.965859 28477 rpcz_store.cc:269] 0709 13:12:03.181769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.182026 (+   257us) service_pool.cc:224] Handling call
0709 13:12:19.965319 (+16783293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:15.778934 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:15.797288 (+ 18354us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:15.797342 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:12:15.797365 (+    23us) tablet.cc:662] Decoding operations
0709 13:12:15.798479 (+  1114us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:15.809833 (+ 11354us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:15.816180 (+  6347us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:12:15.857804 (+ 41624us) tablet.cc:701] Row locks acquired
0709 13:12:15.857869 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:12:15.858130 (+   261us) write_op.cc:270] Start()
0709 13:12:15.858319 (+   189us) write_op.cc:276] Timestamp: P: 1783602735858038 usec, L: 0
0709 13:12:15.858348 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:12:15.890338 (+ 31990us) log.cc:844] Serialized 3574 byte log entry
0709 13:12:16.743512 (+853174us) op_driver.cc:464] REPLICATION: finished
0709 13:12:17.389171 (+645659us) write_op.cc:301] APPLY: starting
0709 13:12:17.412775 (+ 23604us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:17.509704 (+ 96929us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:17.518562 (+  8858us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:17.807523 (+288961us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:17.931257 (+123734us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:12:17.931346 (+    89us) write_op.cc:312] APPLY: finished
0709 13:12:17.931804 (+   458us) log.cc:844] Serialized 71 byte log entry
0709 13:12:18.081766 (+149962us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:18.102599 (+ 20833us) write_op.cc:454] Released schema lock
0709 13:12:18.146181 (+ 43582us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:18.172906 (+ 26725us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:18.172937 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4088806,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":577011,"apply.run_cpu_time_us":28213,"apply.run_wall_time_us":823226,"num_ops":9,"prepare.queue_time_us":283978,"prepare.run_cpu_time_us":26119,"prepare.run_wall_time_us":457625,"raft.queue_time_us":385936,"raft.run_cpu_time_us":29196,"raft.run_wall_time_us":164174,"replication_time_us":884982,"thread_start_us":1004145,"threads_started":5,"wal-append.queue_time_us":661558,"wal-append.run_cpu_time_us":57409,"wal-append.run_wall_time_us":2490437}]]}
I20260709 13:12:19.936120 32122 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.032603 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:20.014853 32052 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:20.041432 32036 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:20.011806 32039 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.062915 28647 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:20.027210 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:19.982218 32105 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.062562 29223 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:20.076941 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49829.1us
I20260709 13:12:20.077404 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:20.087524 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:20.082592 28647 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:20.088481 28622 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:20.088780 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 270078us
I20260709 13:12:20.021703 32040 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:12:20.093195 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:20.094110 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 459418us
I20260709 13:12:20.095532 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:20.099905 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:20.078709 31877 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.103853 28647 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:20.034631 32003 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:12:20.087795 32010 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.106950 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:20.098743 32023 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:20.100016 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.083691 32070 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:20.095110 31986 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:20.094086 32154 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:20.101796 32147 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.301614 31986 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:20.341771 32170 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 13:12:20.102201 31852 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.093632 32025 raft_consensus.cc:2764] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:12:20.215878 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.303100 32154 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:20.142963 32094 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.229712 32100 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:20.230329 31693 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:20.230621 32168 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:20.235349 31525 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:20.241513 32162 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
I20260709 13:12:20.098366 32151 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:12:20.243872 32038 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:20.246654 32105 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:20.252035 32055 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:20.258738 31748 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:20.106031 32099 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:20.268981 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:20.390327 28653 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:20.269726 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.273524 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.274555 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.275627 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.276597 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.393781 28654 raft_consensus.cc:2410] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:20.103165 32101 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:20.378589 32154 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.277534 32023 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.277881 31929 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.278227 32065 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.078907 31983 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:12:20.281363 32153 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:20.282713 31993 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.143811 32078 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:20.283951 32122 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:20.286070 32150 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:20.288914 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.297686 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:20.422098 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:20.298719 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.106407 31711 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:20.299937 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.147193 32136 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:20.218336 32026 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.341671 32040 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.379657 32003 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.373627 31986 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.377372 32100 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.113616 32098 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.164s
W20260709 13:12:20.420393 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 303848us
W20260709 13:12:20.426741 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 333568us
W20260709 13:12:20.428324 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 130730us
I20260709 13:12:20.428471 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:20.428738 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 335928us
W20260709 13:12:20.430218 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 446346us
I20260709 13:12:20.381945 32094 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:20.394815 32099 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.464277 32099 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.465663 32094 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:20.467075 29255 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:20.377535 32176 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:20.477958 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:20.456873 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:20.478799 29260 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:20.398536 32101 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.452055 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:20.457363 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.460522 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:20.461159 32065 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:20.468798 28575 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:12:20.470388 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:20.488823 28577 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.471304 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:20.476171 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.490023 28576 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:20.490165 28578 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:20.427855 32150 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.480188 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 790) took 1044 ms. Trace:
I20260709 13:12:20.490581 28573 rpcz_store.cc:276] 0709 13:12:19.435843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.435974 (+   131us) service_pool.cc:224] Handling call
0709 13:12:19.436257 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.436679 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.436707 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.440900 (+  4193us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.995251 (+554351us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:19.995309 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.995563 (+   254us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.479923 (+484360us) raft_consensus.cc:1685] finished
0709 13:12:20.479951 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.480119 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2858,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":38614,"thread_start_us":411379,"threads_started":1,"wal-append.queue_time_us":601490}
I20260709 13:12:20.436133 32038 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.392536 32055 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.398442 31748 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.485762 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.487382 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.502780 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.485728 31945 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.504678 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:20.507496 32036 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:20.503717 28575 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:20.507936 31945 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:20.493284 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 137842us
I20260709 13:12:20.509021 28575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:20.499691 32004 raft_consensus.cc:2764] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:20.493810 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:20.510306 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:20.449792 32100 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.511915 32105 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:20.512447 32105 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.494552 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:20.484717 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 178598us
W20260709 13:12:20.475957 32162 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:20.517670 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.518586 28579 raft_consensus.cc:2410] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:20.509770 28575 raft_consensus.cc:606] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:20.494707 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:20.482132 32094 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.519186 28575 raft_consensus.cc:614] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:20.520082 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 68117.2us
I20260709 13:12:20.458330 32136 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:12:20.520927 28581 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:20.522115 29256 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:12:20.486850 31693 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:20.448858 32003 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:20.446478 32040 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.489656 32101 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.512928 32105 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.502403 31824 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:20.542213 28577 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:20.477257 32093 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.553408 32093 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.550916 28575 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:12:20.557818 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 63327.2us
I20260709 13:12:20.557817 32182 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:20.560557 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:20.562160 32038 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:20.562649 32038 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:20.563482 32038 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:20.580217 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.582631 28577 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:20.585548 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.593052 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.596490 28650 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:20.548481 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:20.596647 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 752) took 1148 ms. Trace:
I20260709 13:12:20.527508 31852 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:12:20.611300 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62918.6us
I20260709 13:12:20.617095 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:20.620512 28579 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:12:20.620728 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:20.621325 28579 pending_rounds.cc:85] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 2
I20260709 13:12:20.621842 28579 pending_rounds.cc:107] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:12:20.598734 28651 rpcz_store.cc:276] 0709 13:12:19.447969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.449960 (+  1991us) service_pool.cc:224] Handling call
0709 13:12:19.450343 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:19.450770 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.450801 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:19.451401 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 13:12:19.603688 (+152287us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:19.748202 (+144514us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.748531 (+   329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.748636 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.596412 (+847776us) raft_consensus.cc:1685] finished
0709 13:12:20.596434 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.596588 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172,"prepare.queue_time_us":138081,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":3091,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":176,"thread_start_us":151835,"threads_started":1,"wal-append.queue_time_us":422445}
I20260709 13:12:20.623883 28579 raft_consensus.cc:2889] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:20.625129 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 104564us
I20260709 13:12:20.629205 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:20.630352 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:20.631043 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:20.630947 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:20.638756 29224 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:20.594872 31693 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:20.601747 31824 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:20.640661 32186 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:20.662214 32186 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:20.663132 32186 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:20.626917 31953 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.794s	user 0.011s	sys 0.002s
I20260709 13:12:20.643103 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:20.677371 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 46865.7us
I20260709 13:12:20.640837 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:20.678716 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.680296 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:20.676337 28651 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:20.624565 32153 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.683662 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:20.660729 32034 consensus_meta.cc:287] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.002s
I20260709 13:12:20.524595 32094 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:20.693922 28577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:20.719378 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:20.719893 28577 raft_consensus.cc:606] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:20.720031 28721 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
W20260709 13:12:20.642293 32039 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
W20260709 13:12:20.649901 32032 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.791s	user 0.000s	sys 0.011s
I20260709 13:12:20.524658 32178 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:20.717051 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:20.741591 28725 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.674620 32176 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:20.744232 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:20.744992 28647 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.745455 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.668983 28575 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:20.746214 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.718945 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:20.747124 28654 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:20.748005 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:20.692595 31691 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:20.670708 32151 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.716367 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:20.740304 28726 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:12:20.769454 28726 pending_rounds.cc:85] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 9
I20260709 13:12:20.769389 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:20.769913 28726 pending_rounds.cc:107] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:12:20.770295 28726 raft_consensus.cc:2889] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:20.650942 31945 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:20.670075 32183 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:20.655619 31824 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:20.650188 32040 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.641048 31852 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:20.746233 28650 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:20.635617 32175 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:12:20.766546 28651 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:20.790189 28651 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:20.767664 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:20.770114 29258 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
W20260709 13:12:20.646346 32184 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:12:20.648919 32099 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.773102 28656 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:20.768714 32153 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.775939 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.772312 32098 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:20.737093 32147 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:20.773792 32136 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:20.689215 31913 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:12:20.786417 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 256822us
I20260709 13:12:20.719322 31953 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:12:20.743702 32176 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:20.773451 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.835304 28653 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:20.771914 31711 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.741394 32178 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.806151 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.838351 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:20.809180 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:20.813359 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.821040 28725 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:20.749379 32032 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.833791 28656 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:20.842281 28656 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:20.801751 28651 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.843312 28647 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:20.800592 32040 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:20.851294 28656 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.828989 32039 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:20.838894 32176 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.865144 28651 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.866089 28656 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.866789 29254 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:20.841746 32178 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.856595 32153 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:20.887877 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56580us
W20260709 13:12:20.890261 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 122682us
W20260709 13:12:20.891517 32196 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:12:20.891929 32094 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:20.892200 32187 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:12:20.863158 32040 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:20.828858 32098 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.880621 31711 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:20.895320 32171 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.666s	user 0.000s	sys 0.012s
W20260709 13:12:20.943199 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.802495 31693 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.914116 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:20.876706 31691 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:20.881064 32036 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.835407 32136 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.933313 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:20.931337 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:20.932869 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:20.904322 29224 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:20.938946 28656 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:20.939244 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:20.940353 31711 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:20.892980 32190 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:12:20.865326 32199 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:20.893577 32194 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:12:20.947551 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:20.880179 32039 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.985422 32039 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.993549 32099 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:20.885918 31852 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.995039 32032 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:20.996768 32040 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:20.997879 31986 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:12:20.998093 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:20.998353 31986 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:20.999257 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.000525 31986 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.001187 28649 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:21.004547 28724 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:12:21.005410 31691 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.007143 28724 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:21.008381 29257 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:20.957602 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:21.009496 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 52001.9us
W20260709 13:12:20.965451 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61195.7us
I20260709 13:12:20.944581 32052 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:21.011240 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:20.913105 31525 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:12:21.014632 28696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.004s
W20260709 13:12:21.015094 28696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.009s	sys 0.004s
I20260709 13:12:20.982765 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:21.015475 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 538491us
I20260709 13:12:21.016031 28727 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:21.017294 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.012120 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.976249 28722 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:21.018343 28727 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:21.018519 28577 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
W20260709 13:12:21.019358 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.024430 28575 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:21.017661 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:21.030490 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.031160 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.031538 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.031189 28647 raft_consensus.cc:2376] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7. Re-sending same reply.
I20260709 13:12:21.032505 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.032841 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.033162 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.033596 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.034000 28647 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:21.034121 28656 raft_consensus.cc:2376] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7. Re-sending same reply.
W20260709 13:12:21.035084 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.033074 28655 raft_consensus.cc:2376] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9. Re-sending same reply.
I20260709 13:12:21.040045 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:20.948338 31993 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:12:20.961750 32174 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:21.042317 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:21.042723 28727 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:12:21.057850 28727 pending_rounds.cc:85] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 6
I20260709 13:12:21.058081 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.058153 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.043329 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.058840 28648 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:21.059511 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.060405 28577 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:21.058161 28727 pending_rounds.cc:107] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:12:21.061407 28727 raft_consensus.cc:2889] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:21.061805 29252 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.048004 28651 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:21.051254 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.063813 28650 raft_consensus.cc:2376] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9. Re-sending same reply.
I20260709 13:12:21.051429 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.064586 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.064769 28573 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:21.065351 32147 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:21.063457 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1728) took 1682 ms. Trace:
I20260709 13:12:21.008790 32207 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:21.072243 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:20.955687 32036 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.075914 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.041550 32040 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:21.079413 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.089617 28648 raft_consensus.cc:2376] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7. Re-sending same reply.
I20260709 13:12:21.094784 28572 raft_consensus.cc:2410] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:21.038450 32208 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.067787 28728 rpcz_store.cc:276] 0709 13:12:19.380833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.380961 (+   128us) service_pool.cc:224] Handling call
0709 13:12:19.391227 (+ 10266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.391552 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.391581 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.401224 (+  9643us) log.cc:844] Serialized 26 byte log entry
0709 13:12:20.014743 (+613519us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:20.014783 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.015564 (+   781us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.894596 (+879032us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:21.052323 (+157727us) raft_consensus.cc:1685] finished
0709 13:12:21.052347 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:21.063407 (+ 11060us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5639,"raft.queue_time_us":1916,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4901,"spinlock_wait_cycles":131345664,"thread_start_us":609108,"threads_started":1,"wal-append.queue_time_us":700550}
I20260709 13:12:21.050529 32183 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:21.059666 32174 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.050666 32191 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:21.068779 31956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.012s
I20260709 13:12:21.037227 32052 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.015125 32199 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.074010 32192 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:21.099429 32154 consensus_meta.cc:287] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.004s
I20260709 13:12:21.122390 29252 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:21.119391 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.061144 32039 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:12:21.095429 32040 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:21.104199 32203 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:12:21.123392 28727 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:21.124571 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:21.125281 28696 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:21.107297 31956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.005s	sys 0.012s
I20260709 13:12:21.144654 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.107306 32174 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.121485 32207 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:21.135951 32040 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.125717 32202 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:21.156349 32150 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 13:12:21.150514 32151 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.106804 32215 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:12:21.162256 32207 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.175729 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:21.176854 32101 consensus_meta.cc:287] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.002s
I20260709 13:12:21.115854 32191 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.135435 32154 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.167623 31711 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.136425 32192 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.171657 32209 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:21.193447 32204 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:12:21.194025 32199 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:21.200515 32023 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.000s
I20260709 13:12:21.184242 32207 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:21.211385 28695 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 2.022s (SENT) [suppressed 37 similar messages]
I20260709 13:12:21.211954 32039 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.222556 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.223176 28723 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:12:21.217520 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 199886us
I20260709 13:12:21.124030 32147 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.186511 32098 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.226339 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.223855 28573 raft_consensus.cc:2410] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:12:21.236225 28650 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:21.173166 32150 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.172855 32202 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.200886 32176 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.289115 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.289376 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.289844 28654 raft_consensus.cc:2368] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7.
I20260709 13:12:21.290544 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.292369 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.293452 28655 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:21.294102 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.295737 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.296483 28656 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.298566 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:21.298781 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.299670 28579 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:21.301786 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.188727 32101 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.287698 29260 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:21.242839 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.264823 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.303216 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:21.308145 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.309208 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.310141 28647 raft_consensus.cc:2410] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:21.310307 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.311667 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.312309 28654 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:21.314996 28650 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 5: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:21.317178 28654 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.309449 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.286687 31993 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.321615 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.191484 32178 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.326547 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:21.264329 32224 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:12:21.283612 32100 consensus_meta.cc:287] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.772s	user 0.008s	sys 0.003s
W20260709 13:12:21.264349 32218 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:21.344565 31983 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:21.333226 32065 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.345232 31983 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:21.346033 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.346274 31983 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.347009 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:21.347218 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.348574 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.225265 32209 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:21.334033 32225 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:12:21.329712 28546 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.287829 32154 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.263756 32211 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:21.288597 32052 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.340924 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.341421 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:21.358040 28653 raft_consensus.cc:2368] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7.
I20260709 13:12:21.280884 32191 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:21.343243 32202 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.343314 32101 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.343837 31993 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.349303 28725 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:21.238698 32197 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.351948 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.261994 32098 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.353089 29252 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.336519 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 959) took 2221 ms. Trace:
I20260709 13:12:21.354151 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.259748 32136 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.366140 28726 rpcz_store.cc:276] 0709 13:12:19.115356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.115559 (+   203us) service_pool.cc:224] Handling call
0709 13:12:19.117906 (+  2347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:20.778083 (+1660177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.336191 (+558108us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54002d8554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:21.336423 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3729968000}
I20260709 13:12:21.338001 28656 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:21.354739 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.359958 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.187196 32183 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.356369 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:21.326092 32074 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:21.359391 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:21.239235 32039 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.331032 32036 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.364459 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.464264 28654 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:21.368602 28647 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:21.465041 28655 raft_consensus.cc:2410] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:21.370177 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.465833 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.361208 32229 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:12:21.403299 32177 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:21.465947 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 95831us
I20260709 13:12:21.466975 28654 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:21.468922 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:21.398655 32209 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.349905 31525 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:21.361760 32211 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.368669 32098 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.353498 32100 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.382917 32074 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:21.413090 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:21.369634 32105 consensus_meta.cc:287] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.005s
I20260709 13:12:21.368516 32197 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.371255 28573 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:21.453510 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:21.358314 32023 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:21.492062 32023 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.492571 32100 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.362178 32003 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:21.479955 32220 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 13:12:21.511416 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:21.365916 32174 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.513737 28575 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 7: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:21.514210 32174 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.460438 32093 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:21.515765 32093 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:21.459908 32207 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.465838 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.465942 32198 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.372167 32052 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.370518 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.361434 31824 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:12:21.459954 32039 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.488209 32074 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.488903 32200 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:21.489398 32229 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:21.542248 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.542699 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.543519 28652 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:21.489869 31748 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.489959 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.490669 32098 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.491387 29259 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:12:21.463227 32040 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.458148 31993 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.493324 29258 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:21.495819 28730 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:21.479449 32177 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:21.497202 32105 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.498570 32176 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.492524 32023 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:21.503358 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:21.565295 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62023us
I20260709 13:12:21.508337 32178 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.509946 32150 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.514307 32055 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.590679 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.523233 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:21.461421 32228 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:21.527691 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:21.592839 28656 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.478313 32036 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:12:21.546269 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:21.557178 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.598477 28723 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:21.560410 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:21.558254 32177 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.602083 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.562983 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.563933 28729 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.541635 32200 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:21.614751 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.545256 32229 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:21.516743 32093 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.555686 31824 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.554046 28647 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:21.593528 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.594866 28727 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:21.595393 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.622134 28728 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:21.596105 29256 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:21.538026 32174 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:12:21.623538 32174 consensus_queue.cc:1243] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:21.624034 32174 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:21.624382 32174 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:21.555866 32003 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:21.560945 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:21.605176 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59023.8us
I20260709 13:12:21.625608 32003 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.627775 28695 leader_election.cc:400] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7.
I20260709 13:12:21.628410 32174 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.606110 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.629905 32174 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:21.630205 31525 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:21.616267 29224 leader_election.cc:336] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.540s (SENT)
I20260709 13:12:21.613329 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:21.633328 28722 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.633366 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.628834 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:21.635301 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 74393.4us
I20260709 13:12:21.637766 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.638445 28573 raft_consensus.cc:2368] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7.
I20260709 13:12:21.638484 28577 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.648905 28652 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:21.636938 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.592756 32122 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:21.650669 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:21.662949 28729 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:21.653148 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:21.644214 32003 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.653754 28722 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:21.590847 32154 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:21.599241 32228 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:21.657774 32207 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.657531 32200 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.619738 32178 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:21.616199 32055 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:21.612483 32177 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.659018 32105 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.652217 31748 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:12:21.660017 32192 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.709673 28656 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:21.669618 32100 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:21.672600 32228 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.668008 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.674068 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:21.675763 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.722750 28572 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:21.619371 32176 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.671330 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.644023 32229 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.706008 32200 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.753886 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.755543 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.621086 32211 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.698071 32003 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:21.707733 32245 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:12:21.733497 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65591.1us
I20260709 13:12:21.678927 32199 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:21.671663 32093 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.661767 31824 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.675099 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:21.778805 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 103752us
I20260709 13:12:21.780387 31824 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:21.739065 32040 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.740141 32237 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:21.781592 32237 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:21.782493 32237 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.783628 32237 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.703706 32055 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.785246 32175 raft_consensus.cc:2764] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:12:21.785609 32055 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.741906 32186 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:21.742488 32239 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:12:21.749176 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:21.677840 32122 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:21.762042 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.771298 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:21.771426 32248 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.802562 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:21.777304 32098 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:21.790378 28695 leader_election.cc:400] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7.
W20260709 13:12:21.806874 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44934.1us
I20260709 13:12:21.807915 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:21.676934 32154 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.813275 32055 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.814697 32154 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.804349 28729 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.816184 32055 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:21.715626 32249 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
W20260709 13:12:21.669732 32101 consensus_queue.cc:1175] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d64d870625d6461b89b1fb75cd2e26e0" responder_term: 7 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: [6.6-6.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:21.818819 32176 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.819496 32176 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.808146 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:21.821483 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:21.821991 32192 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:21.822283 28722 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.822615 32192 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:21.823601 32192 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.826328 32098 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:21.826921 32098 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:21.827987 32023 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:21.830768 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.812495 32208 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:21.761022 32105 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:21.827940 32098 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.838472 28574 raft_consensus.cc:2410] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:12:21.765460 32207 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.835704 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:21.836126 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:21.841511 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:21.836495 28729 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:12:21.837675 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 201426us
I20260709 13:12:21.849258 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:21.853650 28722 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
W20260709 13:12:21.860721 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.831013 32003 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.835079 32248 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:21.878770 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.880436 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 796) took 1424 ms. Trace:
I20260709 13:12:21.880975 28581 rpcz_store.cc:276] 0709 13:12:20.455757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.456433 (+   676us) service_pool.cc:224] Handling call
0709 13:12:21.880216 (+1423783us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b54000ed8d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:21.880364 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41118592}
I20260709 13:12:21.844249 32208 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:21.863032 32136 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:21.934322 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1076) took 1387 ms. Trace:
I20260709 13:12:21.839365 32244 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:12:21.840094 32182 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:12:21.938503 29254 rpcz_store.cc:276] 0709 13:12:20.546625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.546779 (+   154us) service_pool.cc:224] Handling call
0709 13:12:21.934059 (+1387280us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400750154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:21.934235 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567774464}
I20260709 13:12:21.874969 32098 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:21.878937 32189 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:21.932710 32003 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:21.935171 32248 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:21.954979 32189 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:21.961717 32003 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:22.024173 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.057672 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:22.069866 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:22.072294 32211 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.072950 32211 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.081465 32150 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.082226 32150 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.050868 32038 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:22.084666 32038 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:22.085727 32038 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.068836 32154 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.088817 32032 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:22.089484 32032 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:22.089969 32032 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:22.072595 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:21.937763 32122 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:21.973595 32248 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:22.066494 32003 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.974654 32254 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:22.088109 32154 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.151873 32176 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:22.151597 32189 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.153443 32248 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.159618 32150 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:22.113260 32208 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:22.171106 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 321915us
I20260709 13:12:22.149122 32254 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.189177 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:22.190305 28621 leader_election.cc:400] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7.
I20260709 13:12:22.190934 28621 leader_election.cc:403] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:22.191764 32251 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7.
W20260709 13:12:22.188895 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 342389us
I20260709 13:12:22.192745 32251 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:22.200047 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:22.209483 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 190412us
I20260709 13:12:22.220938 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1071) took 1530 ms. Trace:
I20260709 13:12:22.223441 29252 rpcz_store.cc:276] 0709 13:12:20.690781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.150190 (+459409us) service_pool.cc:224] Handling call
0709 13:12:21.150499 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:21.365835 (+215336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.220552 (+854717us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54005f0354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:22.220851 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465423232}
I20260709 13:12:22.195115 32175 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.195483 32254 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:22.233445 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.188740 32182 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:12:22.213707 32256 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:22.262049 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.226676 32215 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:22.230144 32186 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:22.290853 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.288456 32237 consensus_meta.cc:287] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.006s
I20260709 13:12:22.244856 32175 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.326810 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:22.333959 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:22.279776 32207 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:12:22.291301 32215 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.295341 32186 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.358662 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:22.361136 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:22.363535 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:22.364419 28723 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:22.350783 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 155922us
I20260709 13:12:22.332780 31929 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:22.335546 32074 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:22.280892 32256 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.374157 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:22.375125 32251 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:22.375699 32251 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.375862 32256 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:22.376241 32251 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:22.323376 32259 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:22.378598 31929 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.381302 32259 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.382017 32259 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.385637 31929 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:22.386242 32074 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.387928 32074 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.384934 32259 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:22.395802 28723 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:22.396761 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:22.397063 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:22.397773 28722 raft_consensus.cc:2410] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:22.399276 28727 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:22.419760 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:22.396031 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:22.421342 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:22.393402 32256 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.426563 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.426970 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:22.429448 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:22.429737 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:22.427999 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 228024us
I20260709 13:12:22.430137 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.438072 28651 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:22.438270 28652 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
W20260709 13:12:22.445852 32260 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:12:22.446018 28726 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:12:22.446134 32266 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:12:22.421911 32251 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:22.447130 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:22.447912 28726 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:22.448813 32251 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:22.454210 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.457130 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:22.458009 28651 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:22.458424 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:22.459649 32150 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.460260 32150 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.462994 32150 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:22.463183 32268 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:22.463785 32150 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.464519 32150 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.467648 32150 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:22.469440 32258 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:22.469859 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:22.491065 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1083) took 1771 ms. Trace:
I20260709 13:12:22.491516 29258 rpcz_store.cc:276] 0709 13:12:20.719388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.195485 (+476097us) service_pool.cc:224] Handling call
0709 13:12:21.493120 (+297635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:21.555937 (+ 62817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.490842 (+934905us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54005690d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:22.491003 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683775232}
I20260709 13:12:22.494674 32211 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:22.499042 32197 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:22.506667 32023 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:22.512066 32175 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:22.512952 28581 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.470023 32258 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:22.514204 32258 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:22.514912 32189 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:22.515599 32258 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:22.539613 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:22.540520 29252 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:22.541265 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:22.542735 29257 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:22.543968 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:22.544631 29256 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:22.545615 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:22.527319 28475 catalog_manager.cc:5697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.546247 29260 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
W20260709 13:12:22.546967 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.547107 28475 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 6 to 7, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 7 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:22.548197 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2361) took 1618 ms. Trace:
I20260709 13:12:22.548604 28730 rpcz_store.cc:276] 0709 13:12:20.929868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.930023 (+   155us) service_pool.cc:224] Handling call
0709 13:12:20.930368 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:21.556284 (+625916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.547955 (+991671us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54000d57d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:22.548141 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299939712}
I20260709 13:12:22.549271 32105 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.550283 28730 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:22.577919 28475 catalog_manager.cc:5697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 2 to 5, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:22.579499 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:22.588143 29260 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:22.580114 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 110342us
I20260709 13:12:22.580235 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.580129 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.395150 32182 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:12:22.581465 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:22.583942 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:22.584513 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.614989 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.575291 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:22.615659 29257 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.604327 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:22.623287 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:22.625021 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51767us
I20260709 13:12:22.605531 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:22.626686 29259 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:22.606171 28730 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:12:22.609887 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:22.417550 32154 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:22.605227 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:22.631994 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.454653 32261 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:22.641224 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.641436 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:22.642449 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.650085 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.642493 28655 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:22.650810 28581 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:22.644428 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.653398 28649 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:22.645440 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.655128 28653 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:22.399467 31824 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.213s
W20260709 13:12:22.648416 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 58952.7us
I20260709 13:12:22.642796 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.671850 28652 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 4.
I20260709 13:12:22.658977 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:22.673244 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:22.674055 28647 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:22.676757 32147 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:22.678229 32147 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:22.679996 28728 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:22.549942 32105 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.610502 32100 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:22.684181 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:22.685966 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.687184 28656 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:22.687791 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 64638.7us
I20260709 13:12:22.698071 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:22.698990 28650 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:22.670388 28655 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:22.690831 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:22.627786 32150 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.712416 29257 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:22.714509 29260 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:22.636409 32251 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:12:22.678583 32147 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.717738 32182 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.722810 32150 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.750562 32154 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:22.758294 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 74201.8us
I20260709 13:12:22.454439 32256 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.763119 29252 raft_consensus.cc:2410] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:22.649333 32261 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.695735 32209 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:22.779739 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:22.698030 32136 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:22.716675 32211 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:22.789222 32261 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:22.778882 32258 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.779147 32154 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.794109 32197 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:22.793713 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 65209.4us
I20260709 13:12:22.796171 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.728799 32244 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.810314 28655 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
W20260709 13:12:22.801759 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 103790us
I20260709 13:12:22.812156 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:22.812386 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:22.777016 32100 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:22.808050 28652 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:22.792785 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:22.765579 32147 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.804232 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:22.815836 28581 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:22.814404 28650 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:22.821332 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:22.797783 32136 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:22.832217 28722 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:22.803198 32211 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.835431 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:22.836331 28475 catalog_manager.cc:5697] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 5, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:22.843662 28726 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:22.827771 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:22.815155 32154 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:22.780263 32182 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.846032 32276 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:22.811913 31852 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:12:22.846212 32094 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:22.869122 28728 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:22.832319 32192 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:22.817203 32258 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:22.839761 32136 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:22.845134 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 515332us
I20260709 13:12:22.815200 32259 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:12:22.832011 32197 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:22.927583 28475 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 5 to 8, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 8 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:22.819773 32186 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:22.904032 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 443721us
I20260709 13:12:22.842368 32211 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.847055 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:22.915557 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:22.873963 32177 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.164s	user 0.013s	sys 0.000s
I20260709 13:12:22.840826 32189 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:22.930811 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:22.912611 32094 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.937940 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:22.938941 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:22.876641 32215 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:22.941612 28475 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:22.919691 32199 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.147s	user 0.011s	sys 0.002s
I20260709 13:12:22.936792 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:22.950595 28577 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:22.868508 32025 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:12:22.846593 32277 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:12:22.868676 32237 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:12:22.918375 32192 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:22.944983 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:22.972975 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:22.952129 28475 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 5, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:22.944150 32189 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:22.872167 32270 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 13:12:22.997540 32270 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:22.997949 32270 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:22.998997 32270 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.000429 32270 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.820149 32244 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.003924 32244 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:22.945981 32228 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.182s	user 0.012s	sys 0.002s
I20260709 13:12:23.005753 32228 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.007916 32258 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.008296 32228 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:23.009334 32274 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:12:23.013355 32197 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.014263 28721 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:22.875991 32278 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:12:22.943800 31852 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:23.016490 31852 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.017263 32215 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:22.945861 32177 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.019088 31852 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:23.006223 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.020299 32177 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:22.996532 32189 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.030781 32182 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:22.952188 32094 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:22.962394 32199 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:22.961634 32150 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:22.992270 32192 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:23.090761 32234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.019s	sys 0.041s
I20260709 13:12:22.959355 32283 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 13:12:23.056834 32105 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:23.099546 32183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.015s	sys 0.041s
I20260709 13:12:23.103047 32034 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:12:23.113317 32234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.019s	sys 0.042s
I20260709 13:12:23.131102 32105 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:23.107561 32256 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:23.152246 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:23.155534 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 345192us
W20260709 13:12:23.121698 32183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.015s	sys 0.041s
W20260709 13:12:23.147949 32093 consensus_meta.cc:287] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.372s	user 0.010s	sys 0.004s
I20260709 13:12:23.124121 32200 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:23.168550 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:23.151006 32278 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:23.178829 32154 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.191887 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:23.184456 32234 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:23.183997 32256 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:23.182060 32200 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:23.225989 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.154495 32105 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.236634 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:23.284232 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 89072.5us
I20260709 13:12:23.294296 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:23.294770 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 102951us
I20260709 13:12:23.225930 32303 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.298440 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.299366 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.303431 29257 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:23.304241 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:23.302994 29251 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
W20260709 13:12:23.297132 32229 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.541s	user 0.011s	sys 0.005s
I20260709 13:12:23.306773 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.307140 29259 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:23.307715 29259 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:23.185534 32278 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.201416 32234 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.307613 29255 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:23.242839 32295 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:23.322141 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.308694 29259 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.307128 32256 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:23.325579 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.326345 29259 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.316481 32304 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:23.326375 32302 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.330168 32302 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.331743 32189 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:23.332489 32074 consensus_meta.cc:287] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.932s	user 0.009s	sys 0.000s
I20260709 13:12:23.326866 29251 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:23.336500 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:23.328928 32304 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:23.339505 32147 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.517s	user 0.003s	sys 0.007s
I20260709 13:12:23.332955 32074 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.340029 32147 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.343948 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:23.329571 32098 consensus_meta.cc:287] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.375s	user 0.013s	sys 0.001s
W20260709 13:12:23.347649 32289 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:12:23.347836 32003 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.196s	user 0.008s	sys 0.005s
I20260709 13:12:23.348366 32003 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.350432 32038 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.350692 32003 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:23.348712 32147 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.312637 32200 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.344318 32183 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:12:23.340803 32304 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:23.360173 29251 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:23.304873 32303 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.334487 32189 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:23.354219 32254 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.105s	user 0.013s	sys 0.000s
I20260709 13:12:23.343922 32256 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:23.353334 32261 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.542s	user 0.004s	sys 0.007s
I20260709 13:12:23.372429 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:23.373111 29257 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.318463 32229 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.385094 32256 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.346098 32150 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:23.390918 32150 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:23.391408 32150 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.394554 32303 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.396648 29259 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:12:23.397186 29259 pending_rounds.cc:85] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 7
I20260709 13:12:23.397516 29259 pending_rounds.cc:107] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:23.370473 32200 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.370929 32105 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.371781 32154 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:23.365432 32032 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 1.275s	user 0.014s	sys 0.003s
I20260709 13:12:23.398836 32032 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.372087 32254 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.401080 32261 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.375721 32074 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.375823 32211 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.378573 32136 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.380152 32278 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.380800 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:23.397851 29259 raft_consensus.cc:2889] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.369879 32094 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.328485 32295 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:12:23.382364 29260 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260709 13:12:23.385965 32229 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.388072 32234 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.402912 32254 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.404862 29255 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:23.406059 32211 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.408892 32136 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.409456 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:23.423484 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 125967us
I20260709 13:12:23.424250 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:23.424291 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.412971 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.425740 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.426120 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.426717 29260 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:23.411149 32094 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.412788 29256 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:23.428642 29260 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:23.403259 29258 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:23.403782 32032 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.403648 32261 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.411691 32295 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:23.433974 29260 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: [5.7-8.9]
I20260709 13:12:23.434257 32295 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:23.416349 32192 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.435249 32295 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.436604 32295 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.437466 32192 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.402694 29257 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:23.411329 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.438724 28724 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:23.439361 29259 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:23.419512 32150 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.443770 32150 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:23.445259 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:23.446086 32032 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:23.446779 32032 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:23.447680 28647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.024s	sys 0.036s
W20260709 13:12:23.448096 28647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.024s	sys 0.036s
I20260709 13:12:23.450063 28725 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:23.440852 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2375) took 1897 ms. Trace:
I20260709 13:12:23.451560 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:23.451408 32256 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:23.452159 28724 rpcz_store.cc:276] 0709 13:12:21.543220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.543786 (+   566us) service_pool.cc:224] Handling call
0709 13:12:21.544165 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:23.439234 (+1895069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.440590 (+  1356us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54001b9254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:23.440778 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4356516736}
W20260709 13:12:23.429298 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 125130us
I20260709 13:12:23.453083 32150 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:23.461130 29223 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:23.462117 32295 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:23.462674 32295 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:23.463639 32295 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.466908 32200 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.467501 32200 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.470000 32200 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.470371 32074 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.471251 32074 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.477332 32074 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.486208 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.487066 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.488373 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.488350 28580 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:23.493219 28579 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:23.489948 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.495883 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.524812 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.525425 28572 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.496754 32249 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:23.509232 32122 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.533213 32249 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:23.533411 32122 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.536538 32122 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:23.515023 32272 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.792s	user 0.003s	sys 0.000s
I20260709 13:12:23.538067 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.534636 32249 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.539620 32249 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.543215 28572 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:23.546801 28572 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:23.548331 28572 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:23.555600 32208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.008s	sys 0.004s
W20260709 13:12:23.556453 32208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.009s	sys 0.004s
I20260709 13:12:23.543830 28580 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:23.541105 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.558121 32074 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:23.563591 32074 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.566385 32074 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:23.567884 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 82211.3us
I20260709 13:12:23.568908 32074 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.569613 32269 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:23.569574 32074 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.570148 32269 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:23.571331 32269 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.573975 32269 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.578704 32074 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:23.580274 28723 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:12:23.586601 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 109750us
I20260709 13:12:23.589331 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:23.591087 29252 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:23.594830 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:23.595134 32200 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:23.596141 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:23.595892 32200 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.595492 29259 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.595160 32279 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:23.598171 32279 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:23.598402 32200 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:23.599740 28650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.011s	sys 0.003s
I20260709 13:12:23.599143 32279 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:23.600111 28650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.011s	sys 0.003s
I20260709 13:12:23.600669 32279 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.601107 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:23.601915 28621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.003s	sys 0.014s
I20260709 13:12:23.602245 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.602792 29251 raft_consensus.cc:2376] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8. Re-sending same reply.
I20260709 13:12:23.603559 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.599542 32200 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:23.604631 28580 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:12:23.602265 28621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.015s
W20260709 13:12:23.605680 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 672200us
I20260709 13:12:23.606492 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.608829 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:23.609395 31877 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:23.612778 32200 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:23.614390 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.614993 32268 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:23.615356 28727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.022s	sys 0.034s
W20260709 13:12:23.615087 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:23.615811 28727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.023s	sys 0.035s
I20260709 13:12:23.616721 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.617067 29259 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:23.619266 28654 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:23.621500 32268 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:23.621894 32268 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.622217 32268 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.630410 32268 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.632830 32268 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:23.633167 28545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.280s	user 0.028s	sys 0.029s
W20260709 13:12:23.633669 28545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.028s	sys 0.029s
I20260709 13:12:23.636620 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.638841 32209 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.639331 32209 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:23.641022 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:23.641604 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 45524.5us
I20260709 13:12:23.643854 32055 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:23.644484 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.644832 31929 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:23.645174 28651 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:23.645283 31929 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:23.646173 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.646935 28651 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:23.647415 28547 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.647682 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.648535 32055 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:23.649072 32055 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:23.649355 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.649560 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.650020 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.650611 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.651304 28649 raft_consensus.cc:2368] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
I20260709 13:12:23.651646 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.652146 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.652468 28650 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:23.649940 32055 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.653353 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.654732 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:23.613406 32200 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:23.657150 28545 connection.cc:256] RPC call timeout handler was delayed by -1.1220535520001249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2684s for a response
I20260709 13:12:23.657470 32251 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:23.658253 32200 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:23.658833 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.659544 32200 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:23.657137 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.650290 28647 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.670017 32074 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:23.670691 32074 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:23.671187 32074 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.656992 28650 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:23.675278 28650 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:23.676594 28650 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.677582 28650 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.678305 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:23.679349 29254 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.683409 32249 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.684026 32249 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.649902 28653 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:23.652925 28649 raft_consensus.cc:2410] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:23.646173 31929 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:23.694581 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.697840 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:23.705160 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.705828 28575 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:23.648867 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.707202 28651 raft_consensus.cc:2410] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:12:23.703482 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.708420 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.635661 32268 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:23.713881 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.714972 28650 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:12:23.715358 28650 pending_rounds.cc:85] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 4
I20260709 13:12:23.711522 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.715631 28650 pending_rounds.cc:107] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:12:23.715996 28650 raft_consensus.cc:2889] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.721475 28653 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:23.721668 28647 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:23.704938 32279 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:23.718010 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.726155 28649 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:23.716044 32207 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:23.730363 28654 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:23.731763 32207 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:23.732239 32207 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.737897 32322 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:23.738566 32322 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.727823 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.723836 32256 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:23.743968 32302 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:23.728587 32211 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:12:23.728451 32032 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:23.749536 32032 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:23.750589 32032 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.753473 32256 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:23.754403 32256 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.755039 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 984) took 1363 ms. Trace:
I20260709 13:12:23.755748 28723 rpcz_store.cc:276] 0709 13:12:22.392995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.420991 (+ 27996us) service_pool.cc:224] Handling call
0709 13:12:23.754726 (+1333735us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400234bd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:23.754941 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2661376384}
W20260709 13:12:23.757823 28725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 1746) took 2195 ms (client timeout 1909 ms). Trace:
W20260709 13:12:23.758260 28725 rpcz_store.cc:269] 0709 13:12:21.562607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.562734 (+   127us) service_pool.cc:224] Handling call
0709 13:12:23.757633 (+2194899us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54000a6ed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:23.757728 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4230592384}
I20260709 13:12:23.761173 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:23.762682 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.763990 28575 raft_consensus.cc:2410] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:12:23.759243 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 102168us
I20260709 13:12:23.768653 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.770269 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:23.771219 29256 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:23.740847 32322 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.775738 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:23.753485 32279 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:23.779135 28649 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:23.724215 32295 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:12:23.780784 32279 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:23.786736 32279 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.788609 32200 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:23.791497 32200 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.779196 32208 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:23.792364 32208 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:23.792778 32208 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.789849 32295 consensus_queue.cc:1243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:23.785553 32322 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:23.790867 32249 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.790601 32074 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.780454 32309 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:23.781714 29224 leader_election.cc:400] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
I20260709 13:12:23.795336 29254 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:23.812202 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.812407 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:23.805454 32322 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:23.804852 32200 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:23.819108 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.819937 28580 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:23.820361 28572 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:12:23.815721 28575 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:23.817670 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.823598 28579 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:23.826885 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.827759 28574 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:12:23.830957 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.814646 32122 raft_consensus.cc:2764] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:23.819540 32277 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:23.818966 32249 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:23.835557 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.818931 32324 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:23.836427 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.837604 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.838089 28574 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:23.840082 32324 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.840654 32074 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.842317 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.843012 28574 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.843174 32324 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.833997 32200 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:12:23.845399 32249 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:23.846705 32249 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.849373 32322 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.858906 28574 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:23.861670 28651 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:23.864444 28651 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:23.862219 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.865131 28579 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.865382 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:23.868443 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:23.859710 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52607.6us
I20260709 13:12:23.872774 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:23.874961 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:23.875448 28651 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.875989 28574 pending_rounds.cc:85] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 7
I20260709 13:12:23.875770 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:23.876362 28574 pending_rounds.cc:107] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:23.876420 28651 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.876699 28574 raft_consensus.cc:2889] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.840948 32209 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:23.879050 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.872193 32326 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:23.874326 32323 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:12:23.880297 32055 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:23.886209 31852 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.889905 31852 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.892050 32279 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.893115 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.884055 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:23.886415 32250 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.896974 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:23.897377 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.898352 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.898722 28653 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:23.898617 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.899622 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.900126 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:23.901216 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.873816 32324 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:23.904230 28579 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:23.899541 29256 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:23.903286 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.906558 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.877652 32074 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:23.909117 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:23.910684 28649 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:23.909469 31852 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:23.913241 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 144943us
I20260709 13:12:23.916544 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:23.918102 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.919153 29252 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:23.921178 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.922281 29252 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:23.922500 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.885187 32326 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:23.926160 32074 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:23.938844 32074 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.913384 32035 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:23.939927 32035 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.940385 32324 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:23.941893 32326 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:23.941149 31852 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:23.925828 32076 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.907680 32250 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.942876 32326 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:23.943250 32076 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.945863 32076 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.907893 32154 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:23.946403 32209 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:23.946571 32279 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:23.946835 32154 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:23.952139 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:23.953217 29252 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:23.955024 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:23.948573 32207 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.961227 28651 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:12:23.961795 28651 pending_rounds.cc:85] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 7
I20260709 13:12:23.962112 28651 pending_rounds.cc:107] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:23.962459 28651 raft_consensus.cc:2889] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.966732 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:23.967664 28577 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.944847 32250 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:23.940400 32035 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.957159 32251 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:23.957228 32076 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:23.948127 32154 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.956440 32208 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.976887 32251 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.942886 31852 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:23.985039 32076 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.000244 32076 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:24.001418 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:24.002784 32207 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:24.004326 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:24.010939 28579 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 7: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:24.004951 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 1.03088e+06us
W20260709 13:12:24.014139 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 137413us
I20260709 13:12:24.015213 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:24.015251 29256 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260709 13:12:23.977325 32122 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:12:24.018126 29259 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:24.018492 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:23.991223 32251 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.023720 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:24.024669 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.020278 28577 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:24.001065 32055 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:24.022634 32322 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.028432 32004 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:24.028856 32004 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:24.027586 32055 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:24.029803 32004 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.030961 32004 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:24.031767 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2379) took 1606 ms. Trace:
I20260709 13:12:24.034291 31852 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:24.034942 31852 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.037127 32208 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:24.032179 28721 rpcz_store.cc:276] 0709 13:12:22.425521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.455784 (+ 30263us) service_pool.cc:224] Handling call
0709 13:12:22.625998 (+170214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:23.014736 (+388738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.031521 (+1016785us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54002da354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:24.031705 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892352896}
I20260709 13:12:24.021703 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:24.044100 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:24.044832 32207 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.045293 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:24.045521 32207 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:24.045979 32207 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:24.046450 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:24.046799 32207 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.047528 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:24.048509 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:24.049242 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:24.050455 32269 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:24.057693 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.053256 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:24.059593 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:24.061043 32004 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.064273 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:24.065176 32324 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.066505 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.067724 29251 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:24.068333 29253 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:24.075086 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:24.075773 28577 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:24.077582 28577 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:24.064958 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:24.079357 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:24.082581 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 182521us
I20260709 13:12:24.084519 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:24.095060 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:24.110941 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:24.081175 32004 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.094031 32208 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:24.113037 32327 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:24.114713 32324 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:24.071576 32332 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:12:24.128252 28475 catalog_manager.cc:5697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 3 to 5, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.137972 28475 catalog_manager.cc:5697] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 4 to 5, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.140540 28475 catalog_manager.cc:5697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 1 to 3, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:24.144733 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:24.133047 32327 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:24.162161 32327 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:24.167164 32291 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:24.163944 32326 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:12:24.185560 28546 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:24.176111 32291 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:24.170356 32332 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 13:12:24.196723 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.199031 32339 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:12:24.211493 32291 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.212914 32291 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.215566 32327 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:24.187251 32329 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:12:24.218750 31852 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:24.221683 31852 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:24.222208 31852 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:24.223531 31852 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.225485 31852 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:24.228353 28577 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:24.229970 32208 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.232260 32208 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.232758 28655 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:24.118615 32032 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:24.094322 32200 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:12:24.233040 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:24.240202 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.251678 32324 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:24.250124 32327 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.235874 32335 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:24.257782 32335 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.258355 32335 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:24.236043 32329 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:24.239483 32291 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:24.265551 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 80039.3us
I20260709 13:12:24.236438 32032 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.268642 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:24.263636 32208 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.271361 32032 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.271827 32208 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.274487 32208 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.275182 29259 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:24.262845 32329 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:24.262830 32291 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:24.281891 32324 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.290426 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.285888 32333 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.284420 32360 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:24.308260 31929 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.310084 28581 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:24.304579 32329 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:24.313110 32329 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:24.316044 32346 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
I20260709 13:12:24.297204 32353 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:12:24.320479 32291 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.323813 32360 consensus_queue.cc:1243] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:24.339689 31852 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:12:24.492229 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.549276 28581 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:24.561034 28651 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:12:24.561553 28651 pending_rounds.cc:85] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 2
I20260709 13:12:24.561798 28651 pending_rounds.cc:107] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:12:24.562026 28651 raft_consensus.cc:2889] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:24.563562 28650 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:24.568199 32371 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:24.552314 32360 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:24.591810 32372 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:24.595217 29258 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:24.568939 32371 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:24.598871 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.602502 32372 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:24.604746 32371 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.582201 32366 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.582528 32360 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:24.618168 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.627990 32364 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 13:12:24.634455 32207 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.013s	sys 0.019s
W20260709 13:12:24.634897 32207 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.014s	sys 0.020s
I20260709 13:12:24.637524 32360 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.638705 32360 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:24.648111 32341 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.463s	user 0.002s	sys 0.000s
I20260709 13:12:24.615913 32366 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:24.649813 32349 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.458s	user 0.002s	sys 0.001s
I20260709 13:12:24.651136 32366 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.619663 32335 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:24.653944 32335 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.654486 28578 raft_consensus.cc:2410] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:24.656219 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.656826 28650 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:24.664023 32035 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.687s	user 0.006s	sys 0.006s
I20260709 13:12:24.665531 32035 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.669497 28656 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:24.669461 32035 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:24.673735 32369 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:12:24.674721 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:24.675246 29259 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.664328 28650 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:24.677932 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:24.679520 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:24.700539 29256 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:24.706286 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:24.714190 32207 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:24.715786 32207 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.720890 32268 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:24.727246 32268 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.727792 32268 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.728751 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2382) took 2302 ms. Trace:
I20260709 13:12:24.695935 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:24.729167 28727 rpcz_store.cc:276] 0709 13:12:22.426551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.605965 (+179414us) service_pool.cc:224] Handling call
0709 13:12:22.606213 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.606411 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:22.963638 (+357227us) log.cc:844] Serialized 14 byte log entry
0709 13:12:24.728418 (+1764780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:24.728473 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:24.728517 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.728583 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:24.728695 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1112061,"prepare.queue_time_us":577200,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":1009110,"threads_started":2,"wal-append.queue_time_us":388482,"wal-append.run_cpu_time_us":1192,"wal-append.run_wall_time_us":1001515}
W20260709 13:12:24.731072 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 717259us
I20260709 13:12:24.732100 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:24.715031 32374 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:24.732842 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:24.733183 32374 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:24.733613 28721 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:24.733705 32374 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.730717 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1091) took 1136 ms. Trace:
I20260709 13:12:24.726156 32207 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.738008 28723 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:24.736660 28725 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:24.740244 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:24.740869 28721 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:24.742564 31929 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:24.683486 29259 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:24.743779 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:24.744163 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:24.744690 28573 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:24.745363 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:24.746047 28572 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:24.746239 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:24.746948 28727 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:24.744742 28546 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:24.748350 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:24.748710 32363 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:24.735189 29257 rpcz_store.cc:276] 0709 13:12:23.594485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.599070 (+  4585us) service_pool.cc:224] Handling call
0709 13:12:24.695783 (+1096713us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:24.730653 (+ 34870us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4560640}
I20260709 13:12:24.749374 32363 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:24.750219 32363 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.752820 28725 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:12:24.753711 32333 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:24.753983 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:24.754235 32333 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:24.754814 28721 raft_consensus.cc:2410] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:12:24.755108 32333 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:24.755723 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:24.750541 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:24.763500 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:24.764860 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:24.765776 28727 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:24.766809 32351 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.767540 32351 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.768316 28725 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:24.769233 32322 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.743942 31929 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:24.770849 31929 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.764647 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:24.775081 32371 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:24.775475 32371 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.775863 32371 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.778676 31929 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:24.780613 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:24.781597 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.781544 29257 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:24.783473 32371 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:24.784518 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:24.793571 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61560.3us
I20260709 13:12:24.798000 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:24.801694 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.808027 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.811354 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:24.814072 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:24.815392 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:24.818567 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.827847 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2409) took 2022 ms. Trace:
I20260709 13:12:24.828303 28656 rpcz_store.cc:276] 0709 13:12:22.805804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.806923 (+  1119us) service_pool.cc:224] Handling call
0709 13:12:22.807212 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:24.671824 (+1864612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.827630 (+155806us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540025a154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:24.827787 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4282335488}
I20260709 13:12:24.832327 32371 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:24.833760 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.790290 32335 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:24.834537 32335 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:24.835000 32335 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.785916 32329 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:12:24.841457 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:24.842108 28579 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.847265 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.854494 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:24.855160 29257 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:24.855314 28579 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:24.856597 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:24.855223 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.857481 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:24.869392 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:24.863005 32366 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:24.865816 32329 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:24.871577 28656 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:24.865487 32360 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 13:12:24.884940 29251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.005s	sys 0.005s
W20260709 13:12:24.885372 29251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.005s	sys 0.006s
W20260709 13:12:24.892302 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.876269 32329 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.879993 32366 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:24.877867 32362 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:12:24.909839 32154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.019s	sys 0.000s
I20260709 13:12:24.902045 32329 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:24.919067 32366 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:24.909952 32374 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:24.922307 32374 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:24.917063 32154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.020s	sys 0.001s
I20260709 13:12:24.925776 32268 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:24.991904 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.991628 28656 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
W20260709 13:12:25.015030 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.063735 29252 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:25.066048 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:25.067660 29251 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:25.068113 29253 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:25.069969 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:25.074100 32268 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.075702 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:25.076251 29255 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:12:25.092419 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:25.093827 28572 raft_consensus.cc:606] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:25.094543 28572 raft_consensus.cc:614] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:25.076821 29255 pending_rounds.cc:85] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 8
I20260709 13:12:25.096616 29255 pending_rounds.cc:107] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:12:25.097060 29255 raft_consensus.cc:2889] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:25.099363 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:25.105896 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:25.112432 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2532) took 1295 ms. Trace:
I20260709 13:12:25.100616 28574 raft_consensus.cc:606] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:25.140480 28574 raft_consensus.cc:614] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:25.144565 29251 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
W20260709 13:12:25.156539 28751 debug-util.cc:398] Leaking SignalData structure 0x7b0800105d00 after lost signal to thread 27435
I20260709 13:12:25.136992 28578 rpcz_store.cc:276] 0709 13:12:23.817175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.817337 (+   162us) service_pool.cc:224] Handling call
0709 13:12:25.111811 (+1294474us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b540031ef54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:25.112162 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914529024}
W20260709 13:12:25.165904 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.166810 28622 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:25.168242 32322 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:25.149371 29260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1092) took 1549 ms (client timeout 1573 ms). Trace:
W20260709 13:12:25.170372 29260 rpcz_store.cc:269] 0709 13:12:23.599611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.599736 (+   125us) service_pool.cc:224] Handling call
0709 13:12:25.105426 (+1505690us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:25.149253 (+ 43827us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2846592}
I20260709 13:12:25.175727 32363 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:25.176674 32363 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.180047 32363 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.184094 32004 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:25.184422 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 141130us
W20260709 13:12:25.198817 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.226940 32154 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.227738 32154 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:25.231388 32055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.006s	sys 0.011s
I20260709 13:12:25.232043 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:25.252593 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 82884.7us
I20260709 13:12:25.253103 32250 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:25.254390 32250 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:25.256875 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:25.258177 29258 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:25.257294 32250 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:25.261538 32055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.228s	user 0.007s	sys 0.012s
I20260709 13:12:25.274013 32248 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.149410 32269 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:25.275051 32248 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.276324 32269 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:25.278913 32269 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.276310 32329 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.295009 32268 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.296191 32268 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:25.300645 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5620 after lost signal to thread 28513
W20260709 13:12:25.303246 28751 debug-util.cc:398] Leaking SignalData structure 0x7b080019e540 after lost signal to thread 28605
W20260709 13:12:25.303664 28751 debug-util.cc:398] Leaking SignalData structure 0x7b080012e9c0 after lost signal to thread 28606
I20260709 13:12:25.304113 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:25.308622 29258 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:25.280655 32351 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.304170 32154 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:25.306080 32268 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.207129 32322 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.324281 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1103) took 1426 ms. Trace:
I20260709 13:12:25.330940 29254 rpcz_store.cc:276] 0709 13:12:23.897377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.897625 (+   248us) service_pool.cc:224] Handling call
0709 13:12:23.897907 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:23.902435 (+  4528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:23.902463 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:23.906305 (+  3842us) log.cc:844] Serialized 26 byte log entry
0709 13:12:24.080069 (+173764us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:24.080124 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.080212 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:25.323733 (+1243521us) raft_consensus.cc:1685] finished
0709 13:12:25.323780 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:25.324078 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4179,"raft.queue_time_us":4550,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5208,"thread_start_us":128638,"threads_started":1,"wal-append.queue_time_us":236320,"wal-append.run_cpu_time_us":2282,"wal-append.run_wall_time_us":1070970}
I20260709 13:12:25.324198 32335 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.339463 32329 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.362547 32322 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.374606 32248 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.411653 32335 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:25.408977 32251 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.359s	user 0.015s	sys 0.007s
I20260709 13:12:25.417465 32251 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.420873 28647 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:12:25.422211 32251 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.564805 32034 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:25.566282 32034 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:25.586290 32035 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:25.586834 32035 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:25.588204 32035 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:25.589205 32035 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:25.607731 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:25.609846 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:25.611387 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.612531 32366 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:25.613255 32366 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.613777 32366 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:25.625837 32366 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.629735 32366 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.631335 32363 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.632165 32363 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.636776 32363 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:25.652083 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 425962us
I20260709 13:12:25.655763 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1973) took 1371 ms. Trace:
I20260709 13:12:25.656406 32332 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.657127 32332 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.656243 28648 rpcz_store.cc:276] 0709 13:12:24.284629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.286792 (+  2163us) service_pool.cc:224] Handling call
0709 13:12:24.287336 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:25.184242 (+896906us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:25.184720 (+   478us) log.cc:844] Serialized 14 byte log entry
0709 13:12:25.315696 (+130976us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:25.315741 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:25.315774 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.655361 (+339587us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540001c2d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:25.655406 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:25.655591 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":298,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":5483,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":12647,"spinlock_wait_cycles":2061460480,"thread_start_us":124094,"threads_started":1,"wal-append.queue_time_us":155297}
I20260709 13:12:25.659472 32332 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:25.663280 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.664497 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:25.680812 32327 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:25.679018 32354 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:25.682155 32354 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.680939 32323 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:25.676551 32279 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.684975 32279 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.685583 32354 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.686721 32327 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.687546 32279 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:25.690157 32279 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:25.690670 32279 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:25.693608 32279 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:25.698489 32380 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.698765 32362 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.699209 32380 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:25.699393 32362 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.688935 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:25.702546 32362 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.687454 32327 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:25.705431 32327 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:25.702481 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:25.705758 32360 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:25.706283 32360 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:25.707410 32360 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:25.713208 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:25.708976 32360 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:25.734194 32380 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:25.735991 32392 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.736770 32392 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.716249 32279 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.739481 32327 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:25.739886 32279 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:25.740185 32327 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.740608 32279 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:25.742484 32279 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:25.742946 32279 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:25.742980 32335 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:25.743415 28751 debug-util.cc:398] Leaking SignalData structure 0x7b0800378d80 after lost signal to thread 28680
I20260709 13:12:25.743712 32332 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:25.743918 32335 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.745189 32354 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:25.743934 28751 debug-util.cc:398] Leaking SignalData structure 0x7b080030d3a0 after lost signal to thread 28681
I20260709 13:12:25.745801 32354 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:25.746835 28751 debug-util.cc:398] Leaking SignalData structure 0x7b0800409fe0 after lost signal to thread 28754
I20260709 13:12:25.746768 32335 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:25.747357 28751 debug-util.cc:398] Leaking SignalData structure 0x7b0800409fc0 after lost signal to thread 28755
I20260709 13:12:25.747949 32354 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.748135 32327 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.749337 32357 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:25.750011 32357 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.752498 32357 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.744506 32332 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.755139 32332 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:25.756146 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.743593 32279 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:25.758371 32122 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:25.759105 32122 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:25.760079 32392 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:25.762749 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54068.5us
W20260709 13:12:25.763742 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.772490 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:25.780453 32122 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:25.782575 32122 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:25.781472 32410 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:25.786466 32410 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:25.787691 32410 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.775530 32279 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.795491 32279 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:25.797297 32410 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:25.799944 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08004096e0 after lost signal to thread 29286
W20260709 13:12:25.800407 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08004096a0 after lost signal to thread 31824
W20260709 13:12:25.800967 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08004094a0 after lost signal to thread 32094
W20260709 13:12:25.801236 28751 debug-util.cc:398] Leaking SignalData structure 0x7b0800409480 after lost signal to thread 32098
W20260709 13:12:25.801525 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08004093e0 after lost signal to thread 32136
W20260709 13:12:25.801959 28751 debug-util.cc:398] Leaking SignalData structure 0x7b0800409300 after lost signal to thread 32189
W20260709 13:12:25.802220 28751 debug-util.cc:398] Leaking SignalData structure 0x7b080028a1a0 after lost signal to thread 32192
W20260709 13:12:25.802471 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08004092c0 after lost signal to thread 32197
W20260709 13:12:25.808954 28751 debug-util.cc:398] Leaking SignalData structure 0x7b0800363520 after lost signal to thread 32199
W20260709 13:12:25.809423 28751 debug-util.cc:398] Leaking SignalData structure 0x7b080024fd00 after lost signal to thread 32209
I20260709 13:12:25.792781 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:25.812264 32248 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:25.815279 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:25.816358 28572 raft_consensus.cc:2410] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:12:25.816085 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:25.817509 28573 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
W20260709 13:12:25.822541 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.825155 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:25.827023 32248 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.827365 32360 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:25.828423 32277 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:25.828529 32360 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:25.830024 32277 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:25.830909 32360 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:25.831135 32277 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:25.831492 32277 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:25.832427 32277 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.833573 32277 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:25.837399 32409 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:25.838056 32409 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.839781 32371 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.840428 32371 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.841391 32409 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:25.843760 32371 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.848912 32360 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:25.868162 28652 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:25.868448 32360 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:25.869063 28545 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.118s (SENT)
I20260709 13:12:25.870816 32360 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:25.871275 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa680 after lost signal to thread 32229
W20260709 13:12:25.871628 28751 debug-util.cc:398] Leaking SignalData structure 0x7b080020d840 after lost signal to thread 32237
W20260709 13:12:25.871970 28751 debug-util.cc:398] Leaking SignalData structure 0x7b0800368dc0 after lost signal to thread 32254
W20260709 13:12:25.872234 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa620 after lost signal to thread 32261
I20260709 13:12:25.874133 32269 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:25.874702 32374 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:25.851480 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.874783 32269 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.875447 32374 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.877759 32374 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.878456 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:25.879442 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:25.880327 28647 raft_consensus.cc:2393] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 7: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:25.880622 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:25.880810 32291 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:25.883160 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:25.883965 29253 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:25.885591 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:25.868865 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 791) took 2232 ms. Trace:
I20260709 13:12:25.886493 28652 rpcz_store.cc:276] 0709 13:12:23.636799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.867459 (+2230660us) service_pool.cc:224] Handling call
0709 13:12:25.867833 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:25.868625 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.868807 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:25.887238 28751 debug-util.cc:398] Leaking SignalData structure 0x7b08002675a0 after lost signal to thread 32276
I20260709 13:12:25.852818 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:25.888190 28579 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:25.855844 28573 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:25.861518 32279 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.890306 32279 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.862864 32250 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.893369 32366 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:25.893689 29257 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:25.894084 32366 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.893457 32250 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.896739 32366 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.897547 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:25.898183 32366 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:25.898875 32366 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.901932 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:25.864424 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:25.904601 28648 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:25.905742 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:25.907342 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:25.911437 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:25.912446 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:25.914196 32250 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.898331 29252 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:25.917735 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:25.919111 28721 raft_consensus.cc:2410] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:12:25.920300 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:25.923453 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:25.926429 28648 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:25.921902 28574 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:25.928175 32279 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:25.935316 32269 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:25.897835 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:25.942665 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 112878us
I20260709 13:12:25.959004 29253 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:25.964758 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:25.965480 28648 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:25.965674 32404 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.966297 32404 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.968472 32404 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.969949 28654 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:25.970019 32405 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:25.970781 32405 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.971268 31824 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.971832 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:25.971997 31824 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:25.974206 32248 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:25.980633 32248 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:25.975828 28651 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:25.977196 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:25.977653 32366 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:25.989111 28655 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:25.990890 28654 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:25.992231 32279 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:25.971310 32405 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:25.978775 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:25.975759 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:25.983613 31824 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:25.985486 28578 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:25.997399 32404 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.005421 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:26.014591 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.015132 29253 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:26.023888 28727 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:26.016501 32412 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:12:26.038120 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.041311 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:26.042044 28653 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:26.043787 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:26.045717 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50853.3us
I20260709 13:12:26.046051 28730 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:26.046638 28730 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:26.047911 28730 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.039453 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:26.053514 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.050643 32404 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.059463 32404 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:26.060253 28723 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:26.061270 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.061762 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.062407 29256 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:26.063009 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.064375 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:26.066871 29255 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.067114 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.068409 32074 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.068480 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.055091 32411 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:26.065652 29251 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:26.069519 28724 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.069151 32074 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.066097 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:26.070813 28579 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 5.
I20260709 13:12:26.072579 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.081336 28649 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:26.092253 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:26.092905 29254 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:26.094199 28545 leader_election.cc:336] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.909s (SENT)
I20260709 13:12:26.095460 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.095395 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.097306 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.096153 29257 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:26.098188 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:26.098798 28727 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:26.099406 28730 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:26.099466 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.104487 29260 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:26.105613 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 992) took 1323 ms. Trace:
I20260709 13:12:26.100358 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:26.109555 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.121186 32291 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.122727 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:26.123378 28652 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:26.124033 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:26.124778 28650 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
W20260709 13:12:26.129541 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 139270us
I20260709 13:12:26.132230 32410 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:26.133690 29259 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:26.134799 32410 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:12:26.136056 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.109395 28728 rpcz_store.cc:276] 0709 13:12:24.727905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.731612 (+  3707us) service_pool.cc:224] Handling call
0709 13:12:24.731968 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:24.866439 (+134471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:24.866480 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:24.867030 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:12:25.002855 (+135825us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:25.048395 (+ 45540us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.031996 (+983601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.043099 (+ 11103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.043161 (+    62us) raft_consensus.cc:1685] finished
0709 13:12:26.043173 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.051294 (+  8121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":851373,"prepare.queue_time_us":154697,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":99,"raft.queue_time_us":1236967,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":162,"thread_start_us":380022,"threads_started":4,"wal-append.queue_time_us":59551,"wal-append.run_cpu_time_us":3699,"wal-append.run_wall_time_us":1132942}
I20260709 13:12:26.137192 32122 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:26.138480 29260 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:26.138592 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.139003 29260 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:26.139938 32279 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:26.140465 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.141834 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.142688 29259 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:26.144609 29257 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:26.148490 32034 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:26.149030 32094 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.149380 32034 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:26.151165 32136 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.151934 32136 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:26.153697 32192 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.154309 32192 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.159735 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:26.160847 32411 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:26.161466 32411 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:26.162134 32192 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:26.162438 32411 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:26.162984 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 78773.6us
I20260709 13:12:26.167837 29254 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:26.170719 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:26.171777 28650 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:26.174104 29252 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:26.139961 29260 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.176129 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.177213 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:26.180603 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.185879 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.186058 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.187094 29259 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:26.193529 29255 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:26.197490 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:26.198673 32248 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:26.149850 32094 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.201308 31852 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:26.201684 32415 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:26.203562 31824 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.231042 31824 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:26.232601 28726 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:26.204926 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.205482 32303 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:26.205746 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.206763 32004 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:26.207338 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.209821 29260 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:26.173297 32250 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:12:26.210006 32074 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:26.210343 28722 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:26.212508 28545 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.120s (SENT) [suppressed 24 similar messages]
I20260709 13:12:26.223167 32200 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:26.224053 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:26.204456 28723 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
W20260709 13:12:26.223250 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49367.6us
I20260709 13:12:26.245216 28723 pending_rounds.cc:85] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 4
I20260709 13:12:26.245600 28723 pending_rounds.cc:107] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:12:26.245932 28723 raft_consensus.cc:2889] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:26.247551 28649 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
W20260709 13:12:26.248426 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.220332 31852 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:26.238996 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.240566 28724 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:26.250058 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.265856 31852 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:26.236318 32136 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:26.246898 32248 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:26.250963 32269 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:12:26.249104 32250 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:26.254277 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.255538 32414 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:12:26.242949 32004 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.223028 32415 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.284301 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:26.287005 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.317258 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.317857 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:26.235913 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 104202us
I20260709 13:12:26.292215 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.286401 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:26.308175 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.293718 32366 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:26.321116 28545 leader_election.cc:336] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.195s (SENT)
I20260709 13:12:26.324263 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:26.318188 28729 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:26.329421 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:26.309543 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.316118 32004 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.314816 28468 maintenance_manager.cc:419] P 12655fdad3714eb6a91469c435fc7ad5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033338
I20260709 13:12:26.340997 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.298506 32248 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:26.314337 32250 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.320166 32251 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:26.339251 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.316064 32405 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:26.337378 28722 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.343448 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.345712 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.327973 32277 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:26.337242 32074 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:26.336912 31824 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:26.323803 32414 consensus_queue.cc:1243] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:26.346879 32425 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:26.347385 32250 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.367702 28730 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:26.372038 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.372997 28725 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:26.351007 32360 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:26.374105 29260 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:12:26.376091 29260 pending_rounds.cc:85] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 5
I20260709 13:12:26.376502 29260 pending_rounds.cc:107] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:12:26.376912 29260 raft_consensus.cc:2889] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:26.375262 32374 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.378091 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.377539 28476 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.378273 32374 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:26.379391 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.369655 31929 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:12:26.382397 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:26.382709 31929 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:26.384333 31824 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:26.384649 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.385653 28727 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:26.385661 32374 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:26.386638 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:26.387151 32154 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:12:26.387459 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48854.9us
I20260709 13:12:26.387992 31824 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:26.388646 31824 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:26.389204 28724 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:26.389832 31824 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.368289 32425 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:26.392540 32425 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:26.391752 32093 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:26.394114 32093 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:26.394559 32093 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:26.395838 32093 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.358018 32409 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:26.397501 32409 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.399380 32093 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.400556 32248 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.401993 32248 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.352972 32200 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:12:26.406648 31929 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:26.407153 31929 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:26.408619 32360 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:26.409029 32034 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:26.408185 32303 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:12:26.409770 32360 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.412461 28723 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:26.358177 32074 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.379451 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.380836 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.416730 28725 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:26.417527 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:26.422886 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.384064 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:26.347019 32098 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:26.425776 28729 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:12:26.426568 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53931.7us
I20260709 13:12:26.437599 28722 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:26.440738 32405 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:26.439914 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.441653 28725 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:26.442782 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.408190 31929 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.452461 28725 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:26.445845 32098 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.458354 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.459091 28728 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.461447 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.461756 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.462489 28723 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:26.463245 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.463757 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.464501 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.467753 32136 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:26.470800 28476 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.450871 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.484269 28726 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:26.425287 32074 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:26.426496 32409 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:26.464604 28723 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:26.478418 32415 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:26.489261 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.490887 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.489046 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.492522 28729 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.484318 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.495550 28727 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
W20260709 13:12:26.498538 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 179106us
W20260709 13:12:26.500597 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 246392us
I20260709 13:12:26.501782 28726 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:26.499308 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:26.482892 32136 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:26.501649 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.521261 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.522260 28727 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:12:26.527413 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 210930us
I20260709 13:12:26.531471 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:26.532742 28649 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:26.509677 32251 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:26.542066 32251 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:26.542542 32251 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.551005 28723 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:26.519862 32415 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:12:26.558722 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.558873 28726 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:12:26.541507 28727 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:26.524309 28476 catalog_manager.cc:5697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 5 to 6, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:26.564385 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 180602us
I20260709 13:12:26.572647 28726 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:26.574366 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:26.577064 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 232209us
I20260709 13:12:26.577668 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.581125 28723 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.570703 28476 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 5 to 7, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 7 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.553694 32094 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:26.592397 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:26.597955 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.567061 32366 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:26.604233 29252 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:26.567807 32415 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:26.610703 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:26.611231 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.612017 29260 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:26.616209 31929 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:26.621290 32136 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.623162 32136 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.584710 32291 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:26.630445 32250 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.631907 28723 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:26.632651 32250 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:26.633145 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800306220 after lost signal to thread 27435
W20260709 13:12:26.655295 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800306680 after lost signal to thread 28513
W20260709 13:12:26.656507 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800306ee0 after lost signal to thread 28605
I20260709 13:12:26.633767 28723 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:26.637207 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:26.656818 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800306f00 after lost signal to thread 28606
I20260709 13:12:26.657174 29251 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:26.658187 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf9a0 after lost signal to thread 28680
W20260709 13:12:26.659502 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800156de0 after lost signal to thread 28754
W20260709 13:12:26.659801 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800312be0 after lost signal to thread 28755
I20260709 13:12:26.571336 32098 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:26.638943 32428 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:26.580684 32371 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:12:26.641587 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:26.642514 32366 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.643091 32076 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:26.645282 32430 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:26.638962 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:26.633653 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 339316us
W20260709 13:12:26.660830 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800105dc0 after lost signal to thread 29286
W20260709 13:12:26.687482 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08000bac00 after lost signal to thread 29287
I20260709 13:12:26.620448 32425 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.660305 28476 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 4 to 5, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:26.662406 28729 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:26.591144 32277 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:26.692173 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.664479 32431 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:12:26.687836 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8c20 after lost signal to thread 31824
W20260709 13:12:26.696907 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800105ac0 after lost signal to thread 32094
W20260709 13:12:26.697309 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8b00 after lost signal to thread 32098
W20260709 13:12:26.697672 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8aa0 after lost signal to thread 32136
W20260709 13:12:26.698010 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800105de0 after lost signal to thread 32189
W20260709 13:12:26.698290 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08001054a0 after lost signal to thread 32192
W20260709 13:12:26.698551 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6500 after lost signal to thread 32197
W20260709 13:12:26.698817 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800396c40 after lost signal to thread 32199
W20260709 13:12:26.699116 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2b40 after lost signal to thread 32209
W20260709 13:12:26.637619 32426 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:12:26.692870 28729 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:12:26.701201 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:26.701391 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4fe0 after lost signal to thread 32229
I20260709 13:12:26.699957 28725 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:26.700248 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:26.701862 28723 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
W20260709 13:12:26.702368 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800156e00 after lost signal to thread 32237
W20260709 13:12:26.702802 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8ee0 after lost signal to thread 32261
W20260709 13:12:26.703176 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800105ec0 after lost signal to thread 32276
I20260709 13:12:26.690433 32154 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:26.713227 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:26.716081 28476 catalog_manager.cc:5697] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 5, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:26.703280 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.726387 28723 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:12:26.632671 31852 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.730857 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:26.726145 28574 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
W20260709 13:12:26.736455 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 183735us
W20260709 13:12:26.733834 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 127893us
I20260709 13:12:26.738437 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:26.741439 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 212975us
I20260709 13:12:26.713827 32098 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:26.741039 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.670356 31929 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 13:12:26.749290 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.747308 28728 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:26.714228 32430 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:26.751060 28730 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:26.752038 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.758095 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:26.733862 32371 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:26.769560 28476 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 4, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 4 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.774501 29251 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:26.706553 32277 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.758630 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:26.776167 28547 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.779913 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.781111 28723 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:26.781230 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.785516 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:26.786239 28578 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:26.758402 32291 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:26.790766 28476 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 3 to 6, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 6 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:26.798668 28475 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 378) took 15954 ms (client timeout 15000 ms). Trace:
I20260709 13:12:26.777567 32371 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:26.799140 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.802577 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:26.801419 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.803066 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:26.803439 28574 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
W20260709 13:12:26.804453 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:26.808051 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 205708us
I20260709 13:12:26.780160 32098 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:26.788880 32250 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:26.815346 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:26.803755 29257 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:26.818977 28578 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:26.795941 32291 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.797402 31929 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:26.825248 28730 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:26.808007 32371 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.848553 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.822845 32291 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:26.853422 28729 raft_consensus.cc:2410] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:12:26.855492 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.826437 32250 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:26.828480 31929 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:26.863477 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.860504 28476 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 4 to 6, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 6 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:26.799643 32415 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.874230 28574 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:26.857471 32437 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:26.884619 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.899068 32445 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:26.900633 32442 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:12:26.895761 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:26.910570 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 110966us
I20260709 13:12:26.870594 31929 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:26.919459 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:26.882164 28476 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:26.931094 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:26.930778 28476 catalog_manager.cc:5697] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 1 to 4, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 4 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.935405 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:26.884191 32425 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:26.946614 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:26.799300 28475 rpcz_store.cc:269] 0709 13:12:10.661412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.815871 (+154459us) service_pool.cc:224] Handling call
0709 13:12:26.603130 (+15787259us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:24.211808 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:24.212418 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:24.212456 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:12:24.212476 (+    20us) tablet.cc:662] Decoding operations
0709 13:12:24.213619 (+  1143us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:24.213689 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:24.213731 (+    42us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:12:24.214625 (+   894us) tablet.cc:701] Row locks acquired
0709 13:12:24.214645 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:12:24.214823 (+   178us) write_op.cc:270] Start()
0709 13:12:24.214938 (+   115us) write_op.cc:276] Timestamp: P: 1783602744214774 usec, L: 0
0709 13:12:24.214960 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:24.215666 (+   706us) log.cc:844] Serialized 3999 byte log entry
0709 13:12:24.562376 (+346710us) op_driver.cc:464] REPLICATION: finished
0709 13:12:24.785191 (+222815us) write_op.cc:301] APPLY: starting
0709 13:12:24.786115 (+   924us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:24.843414 (+ 57299us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:24.843563 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:24.882925 (+ 39362us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:24.883188 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:12:24.883240 (+    52us) write_op.cc:312] APPLY: finished
0709 13:12:24.883550 (+   310us) log.cc:844] Serialized 77 byte log entry
0709 13:12:24.883774 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.883957 (+   183us) write_op.cc:454] Released schema lock
0709 13:12:24.884028 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:24.884550 (+   522us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.884596 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2465105,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":175036,"apply.run_cpu_time_us":4684,"apply.run_wall_time_us":100214,"num_ops":10,"prepare.queue_time_us":52109,"prepare.run_cpu_time_us":9355,"prepare.run_wall_time_us":40440,"raft.queue_time_us":208417,"raft.run_cpu_time_us":56836,"raft.run_wall_time_us":109511,"replication_time_us":307332,"thread_start_us":160187,"threads_started":4,"wal-append.queue_time_us":36311,"wal-append.run_cpu_time_us":15583,"wal-append.run_wall_time_us":1669691}]]}
I20260709 13:12:26.948810 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:26.953070 29252 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:26.954918 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:26.958055 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.950522 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:12:26.958249 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 203140us
I20260709 13:12:26.970710 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:26.909816 31852 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:26.886888 32443 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:26.973515 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.974092 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.853641 32430 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:26.961301 32004 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.004s
I20260709 13:12:26.981349 31852 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:12:26.999709 32435 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:27.000322 32435 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:27.000725 32435 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:26.951995 32074 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.007462 32074 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:27.009166 32444 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 13:12:27.011315 28727 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:27.011833 28727 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:27.013717 28730 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.012742 28727 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:27.022061 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:27.023862 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.025725 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.984444 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.030540 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.031737 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.032116 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:26.946305 32076 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:26.981860 28545 leader_election.cc:336] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.248s (SENT)
I20260709 13:12:27.036468 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:27.038092 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 64964.8us
I20260709 13:12:27.026997 32074 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:27.027971 28727 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:26.982653 28476 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 3 to 5, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:27.043579 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 93145.8us
I20260709 13:12:26.963864 32360 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.051183 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:27.052186 28728 raft_consensus.cc:2376] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8. Re-sending same reply.
I20260709 13:12:27.055658 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.056704 28721 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 5: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:27.057808 28729 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:27.054183 28476 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:27.067355 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:27.047828 32074 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.047591 32360 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.897048 32098 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:26.910362 32250 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.075127 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.070158 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:27.086941 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 129769us
I20260709 13:12:27.092461 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.095389 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:27.074637 32074 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.045794 32004 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.113415 28696 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:27.114245 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 53256us
I20260709 13:12:27.119262 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:27.095976 32251 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.000s
I20260709 13:12:27.079016 32360 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.103974 29252 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:27.126998 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.129696 28725 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:27.127991 28730 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:27.134941 28721 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:27.135413 28721 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:27.123144 28476 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:27.151754 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 185879us
W20260709 13:12:27.152187 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.154982 32425 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:27.155584 29224 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:27.158102 32437 raft_consensus.cc:2764] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:27.150199 28721 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.132288 32405 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.162969 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:27.166355 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:27.167729 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 207077us
I20260709 13:12:27.138206 32449 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:27.137141 32445 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:27.150300 32431 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:27.158567 32303 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:27.159632 32277 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.134543 32251 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.175395 28721 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.175704 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:27.171635 28727 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:12:27.186141 32248 consensus_meta.cc:287] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.784s	user 0.014s	sys 0.000s
I20260709 13:12:27.186781 32248 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:27.188889 32433 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:27.189360 32433 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:27.189636 32136 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.003s
W20260709 13:12:27.190237 32448 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:27.190596 28722 raft_consensus.cc:2410] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:27.190331 32433 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.191177 32443 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.191663 32443 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.192101 32443 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.192399 28723 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:27.193420 32431 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:27.194840 32433 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:27.168231 32427 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:12:27.170397 28476 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 5 to 6, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 6 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:27.196401 32431 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:27.177312 32303 consensus_queue.cc:1243] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:27.189643 32366 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.197693 32366 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.198696 32445 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.200263 32366 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.196278 28476 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 3 to 8, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 8 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:27.200155 32371 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.201292 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.206892 28725 raft_consensus.cc:2410] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:12:27.213186 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 277854us
I20260709 13:12:27.159361 32434 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:27.205323 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 92098.3us
W20260709 13:12:27.213560 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.201526 28476 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:27.215322 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.218511 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.185117 32277 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:27.221204 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:27.209445 32431 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:27.213078 32366 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.233311 32366 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.235759 32366 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.235816 32251 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.207497 32248 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:27.236718 32248 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.229697 32436 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:12:27.238992 32248 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.240792 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:27.241688 32136 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:27.242197 32004 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.242734 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:27.243636 32136 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.244123 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:27.244944 32136 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.245442 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:27.246632 28696 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:27.247208 32136 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.248072 32136 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.249111 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:27.249303 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:27.249444 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.250106 28722 raft_consensus.cc:2410] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:27.250172 28725 raft_consensus.cc:2410] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:27.260731 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:27.262938 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 243369us
I20260709 13:12:27.265203 28721 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:27.226598 32277 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.286132 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:27.286710 29260 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:27.308276 28721 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:12:27.308838 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 151163us
I20260709 13:12:27.308888 28721 pending_rounds.cc:85] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 7
I20260709 13:12:27.310122 28721 pending_rounds.cc:107] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:12:27.310359 28721 raft_consensus.cc:2889] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:27.310995 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.313222 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.314486 29254 raft_consensus.cc:2410] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:12:27.230365 32431 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.318473 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:27.322628 29252 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:27.319038 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 141530us
I20260709 13:12:27.324338 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:27.318975 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:27.320380 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:27.327092 28620 leader_election.cc:336] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.525s (SENT)
I20260709 13:12:27.332114 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:27.332798 29257 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:27.333441 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 61642.2us
I20260709 13:12:27.317409 31852 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:27.325119 32431 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:27.345209 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:27.371332 28656 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:27.373277 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 194516us
I20260709 13:12:27.377717 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.379504 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:27.310235 31929 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.380141 28652 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:27.384544 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:27.383642 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 62290.4us
I20260709 13:12:27.385658 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.386454 28578 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:27.387096 28654 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:27.388332 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.391513 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:27.326746 32122 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:12:27.415922 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 92991.7us
I20260709 13:12:27.338466 32458 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:27.431480 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.432114 28721 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:27.445605 29260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:12:27.446398 29260 raft_consensus.cc:606] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:27.446890 29260 raft_consensus.cc:614] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:27.436298 31852 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:27.453301 32291 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.001s
I20260709 13:12:27.453784 32291 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.456183 32291 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.460148 29252 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:27.462217 28656 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
W20260709 13:12:27.440810 32453 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:12:27.431434 32458 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.457682 32443 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:27.483353 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.486225 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.478281 28620 leader_election.cc:336] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.740s (SENT)
I20260709 13:12:27.422132 32200 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:27.491102 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:27.492053 28580 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 6: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:27.493755 29252 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.496920 29257 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:27.458869 32465 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:27.440176 32436 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:12:27.503458 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.492935 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:27.501166 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:27.507731 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63286.4us
I20260709 13:12:27.509807 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:27.497856 32463 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.511368 29257 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.512804 28580 raft_consensus.cc:2368] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:27.484042 32458 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:27.509876 32200 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.517418 32291 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:27.515241 32435 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:12:27.506330 32371 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.531937 28576 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:12:27.539304 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.556478 29256 raft_consensus.cc:2368] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7.
I20260709 13:12:27.543166 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.557375 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:27.557507 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 79268.5us
W20260709 13:12:27.558319 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.559509 29257 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.539618 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.545897 32452 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:12:27.562044 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:27.562691 29259 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:27.563162 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.563853 29253 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:27.529587 32463 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:27.565362 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.565953 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.566504 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.567083 32463 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:27.567673 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:27.568477 32471 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:27.568639 32074 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.569700 29255 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:27.569887 32374 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:27.570520 32374 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.570953 32074 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.571311 29254 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:27.568653 32136 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:12:27.572639 32136 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:27.573184 32136 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:27.573770 32474 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:27.574462 32136 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.568516 32415 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.576776 32415 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:27.578577 32443 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.579432 32415 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:27.537423 32435 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.583047 32425 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:27.583937 32435 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.534458 32291 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:27.586535 32291 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:27.488937 31852 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.530869 32200 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.555666 32371 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.565145 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:27.589850 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.590790 28721 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:27.586251 32360 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:27.605324 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46432.7us
I20260709 13:12:27.605674 29252 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:27.568574 28577 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:27.597432 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.530859 28654 pending_rounds.cc:85] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 8
I20260709 13:12:27.607030 28654 pending_rounds.cc:107] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:12:27.607354 28654 raft_consensus.cc:2889] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:27.611441 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:27.612303 29260 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:27.528376 28695 connection.cc:256] RPC call timeout handler was delayed by -1.1729814119998991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:12:27.618322 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:27.620349 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.620862 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.625313 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67245.6us
I20260709 13:12:27.627192 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:27.572664 32374 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.638427 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:27.644704 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:27.645777 32136 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.647259 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:27.639410 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:27.650844 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 206077us
I20260709 13:12:27.649664 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:27.652351 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:27.649958 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:27.654466 28578 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:27.655246 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.655395 28723 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:27.651913 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.657562 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.658365 28577 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
W20260709 13:12:27.659655 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49464.5us
I20260709 13:12:27.655956 28580 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 4.
I20260709 13:12:27.661499 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:27.661629 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:27.662302 28575 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.663482 32374 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:27.664204 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:27.664052 32374 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:27.666711 32374 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:27.669596 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.670861 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.661525 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:27.653431 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.674331 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:27.674875 28652 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:27.675439 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.676527 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:27.638140 32004 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:27.683416 29251 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:27.677173 28650 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:27.508085 32465 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:27.653575 32425 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:27.685125 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:27.688334 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:27.696995 29260 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:27.700089 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:27.699671 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:27.700201 28574 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:27.703285 29259 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:27.672235 32436 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:27.701540 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:27.712589 28647 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.709949 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:27.676807 32098 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.678078 32433 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:27.684693 32200 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.713842 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:27.718403 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:27.719497 28656 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:27.716255 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:27.706753 32374 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:27.745298 28580 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.721958 28655 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:12:27.752019 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52413us
I20260709 13:12:27.700058 32122 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.754616 28578 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:27.759099 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52528.3us
I20260709 13:12:27.761971 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:27.724270 28696 leader_election.cc:400] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7.
I20260709 13:12:27.763828 28696 leader_election.cc:403] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:27.765408 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49230.4us
I20260709 13:12:27.766201 29254 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:27.760541 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:27.768036 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:27.713840 32465 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:27.709271 32452 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:27.748498 32425 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.687388 32277 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.716212 32415 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.691306 32004 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.706451 32371 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:12:27.781742 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:27.781920 28580 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:27.773599 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 73561.8us
I20260709 13:12:27.753392 32433 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:27.709563 32455 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:12:27.799651 32480 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:27.797513 32463 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:27.770793 31929 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.771847 32486 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:27.772692 32122 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.809147 32374 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:27.776528 32098 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7.
I20260709 13:12:27.788130 32465 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:27.782702 32452 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:27.869475 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 116252us
I20260709 13:12:27.810972 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:27.818009 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:27.774907 32435 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:27.827600 32461 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.831161 32371 consensus_queue.cc:1243] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:27.720994 32405 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:12:27.804807 28574 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:27.821740 32445 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:27.821408 32484 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:12:27.866364 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 45632.3us
I20260709 13:12:27.820523 32481 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.180s
I20260709 13:12:27.826938 32486 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:27.933706 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 218159us
I20260709 13:12:27.938478 28696 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:27.880174 32458 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.825387 32463 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:27.887434 28575 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:27.880990 28652 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:27.840638 32480 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:27.945371 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 127470us
I20260709 13:12:27.875375 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:27.946955 29254 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:27.860797 32136 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.894542 32465 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:27.941969 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 226105us
I20260709 13:12:27.885507 32374 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:27.889643 32360 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:27.871925 32452 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:27.978861 28573 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:12:27.886384 32445 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:27.958003 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:27.940902 32074 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:27.947347 32431 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.563s	user 0.001s	sys 0.010s
I20260709 13:12:27.935101 32415 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:27.939380 32405 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:27.943100 32098 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:27.991554 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 120388us
I20260709 13:12:27.935361 32251 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:12:27.988196 32410 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:28.016644 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:28.017036 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 76847.1us
I20260709 13:12:28.018333 29257 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:27.993281 32366 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.017783 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:27.999349 32405 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.000641 32098 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:28.024269 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:28.025094 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67165.2us
I20260709 13:12:28.025887 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:28.027146 32488 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:12:27.993662 32431 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.021859 32405 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.006274 32136 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:12:27.976976 32433 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.023921 32291 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.021905 32277 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:28.055605 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 244677us
I20260709 13:12:28.021486 32495 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:12:28.036724 32463 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.021615 32410 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.062952 32410 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.021956 32432 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:12:28.065296 32431 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.066134 28579 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:28.067065 32251 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:28.067440 32251 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:28.068064 28647 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:28.068531 32098 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.069816 32098 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.069918 32486 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:28.095088 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 69239.1us
I20260709 13:12:28.038044 32435 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:28.099277 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 114983us
I20260709 13:12:28.104849 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:28.101759 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:28.112430 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55773.9us
I20260709 13:12:28.115249 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:28.117138 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:28.131125 32504 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.119989 32431 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:28.138128 32504 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.138201 32431 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:28.138616 32504 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.138789 32431 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.146520 32291 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.148316 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:28.026023 32445 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.177898 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:28.152750 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:28.146682 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.171779 29260 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:28.179561 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 77922.3us
I20260709 13:12:28.152312 28575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:28.180073 29257 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:28.180510 28575 raft_consensus.cc:606] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:28.180985 28575 raft_consensus.cc:614] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:28.135025 32494 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:12:28.182081 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:28.182570 28620 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:28.187028 29259 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:12:28.187963 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:28.050846 32465 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.187470 29259 pending_rounds.cc:85] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 6
I20260709 13:12:28.135051 32458 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:28.195753 29259 pending_rounds.cc:107] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:12:28.199796 29259 raft_consensus.cc:2889] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:28.151687 32435 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:28.200773 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:28.176396 32415 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:28.174329 32122 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.027549 32500 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:12:28.211987 32485 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:28.212393 32074 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.050064 32480 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:28.217031 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 262424us
I20260709 13:12:28.194936 32366 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.203565 32200 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.209491 32486 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.230808 32486 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:28.231282 32486 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:28.233565 32493 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:12:28.236960 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:28.237473 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.206193 32491 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.239065 32445 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:28.265388 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 73787.7us
I20260709 13:12:28.216466 32415 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.223807 32200 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:28.301350 32200 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.264570 32505 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:12:28.305809 32415 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:28.306522 32415 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.306881 32507 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:28.307309 32415 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:28.307502 32507 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:28.273216 32360 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.310159 32360 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:28.311057 32509 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:28.313251 32467 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:28.317520 32436 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:28.318596 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:28.291380 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:28.222076 32506 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.263402 32481 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:12:28.328990 32481 consensus_queue.cc:1243] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:28.335438 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:28.264643 32499 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:12:28.336426 32499 consensus_queue.cc:1243] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:28.318536 32436 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:28.342005 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.343377 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.344252 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:28.345135 28652 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
W20260709 13:12:28.350500 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 109354us
W20260709 13:12:28.246325 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 64291us
I20260709 13:12:28.296718 32405 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.358541 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:28.360600 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:28.361258 28649 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.319444 32458 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.257110 32136 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 13:12:28.350101 32453 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:12:28.267853 32486 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.349174 32436 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:28.357179 32443 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:28.272140 32452 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.267495 32435 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:28.400192 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 283135us
I20260709 13:12:28.407943 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:28.404757 28577 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:28.376147 32279 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:28.404469 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 179539us
W20260709 13:12:28.416249 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:28.424919 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 72393.1us
I20260709 13:12:28.394333 32506 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.308809 32507 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:28.437741 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 76748.8us
I20260709 13:12:28.417797 32465 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:28.410926 32443 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.422621 32279 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.461678 32360 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:28.422446 32136 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:12:28.462883 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:28.466761 32459 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:28.479171 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53166.2us
I20260709 13:12:28.462347 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:28.490973 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:28.432389 32518 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:28.497105 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55572.8us
I20260709 13:12:28.498306 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:28.505846 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 122732us
I20260709 13:12:28.464759 32431 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.495438 32518 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:28.495783 32459 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:28.504868 32433 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.506153 32098 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:28.506646 32360 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.517557 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:28.439517 32506 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.454193 32465 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:28.513741 32511 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:12:28.528228 28576 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:28.510489 32200 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.533298 32250 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:28.533905 32250 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:28.535063 32250 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.500891 32436 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.542695 32436 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:28.546653 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:28.548511 32279 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.541227 32527 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:28.553548 32527 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.555276 32459 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.557996 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.558816 28727 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:28.560454 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:28.524078 32098 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:28.562220 32098 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.563887 32098 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.568326 32519 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:28.556710 32459 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.518918 32518 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.574841 28649 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
W20260709 13:12:28.576923 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53677.8us
I20260709 13:12:28.580104 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:28.583003 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.578531 32405 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:28.608059 32371 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:28.540112 32251 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:28.611004 32525 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:12:28.611155 32251 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.526620 31852 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:12:28.613327 32250 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.614917 32486 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.616097 32452 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:28.509040 32504 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.618490 32504 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:28.556789 32527 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:28.622526 32506 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:28.624774 32492 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:28.628624 32443 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:28.630182 32004 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:28.631528 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:28.634918 32465 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.637614 32004 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:28.637792 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 57794.9us
I20260709 13:12:28.677788 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:28.678740 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 118370us
W20260709 13:12:28.682176 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 135601us
I20260709 13:12:28.692592 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:28.693677 29258 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 5: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:28.696523 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:28.700542 32360 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:28.684316 32433 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.701313 32433 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.702701 29253 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:28.684687 32410 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.703344 32410 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.703562 32433 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:28.703759 32410 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.696200 32491 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:12:28.690248 32495 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:28.706079 32495 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.706435 32495 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.696429 32435 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.709388 32435 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:28.709744 32435 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.690377 32291 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:12:28.695844 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:28.713271 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67712.1us
I20260709 13:12:28.675105 32465 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:12:28.715549 32465 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:28.715955 32465 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:28.716665 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:28.729044 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:28.730125 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:28.730948 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:28.733307 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:28.735227 28654 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:28.737679 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.746081 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:28.677302 32492 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:12:28.676541 32443 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:12:28.755752 28648 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:28.747678 28655 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.750097 28647 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.750762 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:28.752736 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:28.759500 28652 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:28.753700 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:28.733183 32074 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.761981 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:28.776819 28649 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:28.716822 32465 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:28.776319 32463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.006s	sys 0.020s
I20260709 13:12:28.793455 32207 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:28.799319 32410 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:28.803656 32502 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.777s	user 0.005s	sys 0.000s
I20260709 13:12:28.808349 32508 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:28.792332 32463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.007s	sys 0.020s
I20260709 13:12:28.809041 32508 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:28.810542 32508 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.817247 32465 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.819199 32431 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:28.820310 32485 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 13:12:28.820745 32485 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:28.822613 32445 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.002s
I20260709 13:12:28.822994 29258 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:28.823328 32539 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.823879 32539 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:28.824419 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 381278us
I20260709 13:12:28.827731 32495 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.829205 32539 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:28.830227 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.831823 28621 leader_election.cc:400] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:28.834344 28621 leader_election.cc:403] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:28.835642 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:28.836414 28578 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.837162 32505 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.841259 32499 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:28.842743 32405 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:28.841324 32505 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.843138 32405 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:28.843947 32405 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:28.846797 32505 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.847795 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:28.854645 28573 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.850093 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:28.855232 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:28.853456 28578 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:28.856202 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:28.859093 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:28.861063 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:28.863137 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:28.864385 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:28.866076 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.867411 28729 raft_consensus.cc:2410] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:28.870623 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:28.871731 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:28.872880 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:28.875028 28652 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:28.876149 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:28.877725 29253 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:28.858227 32405 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.857656 32250 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:28.880631 28655 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.880777 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:28.883538 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:28.883605 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.884316 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.925163 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:28.926085 28652 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.862645 32499 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.870440 32449 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.925822 29224 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:28.930440 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:28.862645 32207 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:28.931316 28729 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:28.932307 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.934536 28724 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:28.879146 32136 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.932662 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.933130 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:28.933461 28722 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:28.936012 28722 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:28.881441 32500 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.881307 32506 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:28.878597 32537 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:28.938452 28652 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:28.946833 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:28.962378 28724 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:12:28.975281 28724 pending_rounds.cc:85] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 7
I20260709 13:12:28.975590 28724 pending_rounds.cc:107] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:12:28.975837 28724 raft_consensus.cc:2889] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:28.964323 32495 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.936575 32436 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:28.966539 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:28.977953 28727 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.939464 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:28.928589 32492 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:28.937485 28722 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.885790 32415 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.980860 28728 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:28.982381 28722 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.957866 32410 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:28.985466 28721 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:28.989145 28727 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:28.990360 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.991451 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:28.992494 28727 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:28.990581 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:28.998174 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:28.982321 32537 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.004010 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:28.985423 32492 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:28.996301 32409 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:29.011144 28722 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:29.013180 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:29.013479 28729 pending_rounds.cc:85] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 5
I20260709 13:12:29.013845 28724 pending_rounds.cc:85] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 7
I20260709 13:12:29.013865 28729 pending_rounds.cc:107] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:12:29.013888 28580 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:29.014708 28724 pending_rounds.cc:107] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:12:29.014673 28729 raft_consensus.cc:2889] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:29.015184 28724 raft_consensus.cc:2889] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:29.006227 32207 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:28.936264 32449 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.013190 32409 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:29.020992 32409 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.024729 28722 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:29.025344 28722 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:29.028870 28573 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:29.030367 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:29.032130 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:29.033635 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.032644 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:29.036296 28722 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.038757 28722 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.040958 32449 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:29.045349 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:29.046911 28580 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:29.047910 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:29.053344 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:29.056253 32537 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:29.055179 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:29.061964 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.063017 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:29.063660 28726 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.060302 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:29.068768 29253 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:29.071496 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:29.072492 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:29.075266 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:29.076774 28726 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:29.075851 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:29.077400 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:29.073127 29252 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:29.080453 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:29.084363 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:29.090752 28574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2426) took 1514 ms (client timeout 1843 ms). Trace:
I20260709 13:12:29.092382 28581 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:29.091429 28574 rpcz_store.cc:269] 0709 13:12:27.576404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.640611 (+ 64207us) service_pool.cc:224] Handling call
0709 13:12:29.090504 (+1449893us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b54000ec9d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:29.090683 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81435520}
I20260709 13:12:29.080318 32360 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.086308 32463 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:29.080869 32537 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:29.088828 32500 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:29.080688 32495 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:12:29.089421 32485 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:29.107071 32518 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.005s
I20260709 13:12:29.081080 32465 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:12:29.150585 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:29.135630 32463 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.149118 28722 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:29.176693 32435 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:29.177318 32508 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:29.179293 32435 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:29.180416 28649 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:29.080320 32492 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:29.161514 32518 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:29.190404 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:29.192127 32518 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:29.188921 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:29.192682 32465 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:29.194232 32459 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:29.187960 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:29.202905 32207 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:29.203580 32207 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:29.204648 28573 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:29.205152 32469 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.204655 32207 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.152493 32537 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:29.206799 32537 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.161175 32500 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:29.209194 32374 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.209983 32500 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.183234 32463 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.214331 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:29.216665 32485 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:29.218820 32486 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:29.184885 32445 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:29.219506 32445 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:29.219436 32486 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:29.220512 32445 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:29.233788 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2423) took 1658 ms. Trace:
I20260709 13:12:29.235425 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:29.234272 28579 rpcz_store.cc:276] 0709 13:12:27.575567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.688037 (+112470us) service_pool.cc:224] Handling call
0709 13:12:29.232772 (+1544735us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54001aa254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:29.232987 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811220352}
I20260709 13:12:29.294970 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:29.224385 32445 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:29.371536 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 76681.6us
W20260709 13:12:29.378679 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.385385 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:29.268621 32459 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:29.400202 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.342200 32495 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:29.384115 32449 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:29.238863 32469 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.155s
I20260709 13:12:29.241245 32465 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:12:29.342978 32443 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 13:12:29.343233 32517 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:12:29.447223 28650 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:29.448534 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.446208 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.430799 32449 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.466666 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.467939 28654 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:29.434482 32459 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:29.473242 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:29.492142 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:29.452916 32486 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:29.429502 32495 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.499368 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.495839 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:29.471247 32277 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:29.472635 32449 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.500319 28651 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:29.507201 28654 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:12:29.508713 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 226181us
I20260709 13:12:29.473426 32098 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:29.496651 32460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.244s	user 0.018s	sys 0.027s
I20260709 13:12:29.478559 32200 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:29.517853 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:29.522181 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:29.524250 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.523612 32136 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.533607 32136 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.534709 32495 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:29.540037 32551 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:12:29.540678 32436 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:29.543783 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1050) took 1222 ms. Trace:
I20260709 13:12:29.512180 32452 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.550554 28725 rpcz_store.cc:276] 0709 13:12:28.321135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.321633 (+   498us) service_pool.cc:224] Handling call
0709 13:12:28.343731 (+ 22098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:28.363577 (+ 19846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:28.363627 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:28.363700 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:28.363748 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.543549 (+1179801us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b54002d9e54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:29.543597 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.543721 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45007104}
I20260709 13:12:29.506595 32430 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:12:29.499963 32459 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:29.546888 32550 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:12:29.521332 32460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.018s	sys 0.028s
I20260709 13:12:29.562165 28695 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:29.562695 28695 leader_election.cc:403] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:29.526034 32098 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.597911 32098 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:29.598261 32459 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:29.599603 32463 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:29.521716 32277 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.605782 32277 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:29.606245 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2583) took 2120 ms. Trace:
W20260709 13:12:29.609508 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 84329.7us
I20260709 13:12:29.550380 32436 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:29.607491 28581 rpcz_store.cc:276] 0709 13:12:27.486281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.687419 (+201138us) service_pool.cc:224] Handling call
0709 13:12:29.092155 (+1404736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.092867 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.606030 (+513163us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000ec9d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:29.606165 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3227383552}
I20260709 13:12:29.628435 28580 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:29.606307 32530 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:29.633435 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.636677 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:29.639524 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.640928 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.641670 28652 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:29.621821 32136 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:29.626394 32508 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.551581 32563 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:12:29.645612 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:29.638832 32495 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:29.638598 32530 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.651041 32495 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.653645 32436 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.654708 32436 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.655175 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:29.658981 32559 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:12:29.664197 32561 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.664767 32561 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.665552 32463 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:29.667057 32561 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:29.668411 32567 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:29.669044 32567 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:29.671015 32510 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:12:29.671840 32567 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:29.652814 32530 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:29.689644 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:29.695128 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 53743us
W20260709 13:12:29.690970 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 183160us
I20260709 13:12:29.700139 32495 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:29.700490 29255 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:29.722506 32432 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:29.727109 32534 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.943s	user 0.000s	sys 0.003s
I20260709 13:12:29.730136 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:29.752698 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.753561 28648 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:29.755261 28654 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:29.767259 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.756242 32535 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:29.774091 32535 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:29.775059 32535 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.766800 32508 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:29.778216 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:29.778885 29260 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:29.706061 32449 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.783208 32449 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:29.784893 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.786154 29254 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:29.787276 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:29.787621 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:29.788595 29257 raft_consensus.cc:2410] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:29.789825 29257 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:12:29.790117 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 870) took 1455 ms. Trace:
I20260709 13:12:29.790498 28577 rpcz_store.cc:276] 0709 13:12:28.334885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.335083 (+   198us) service_pool.cc:224] Handling call
0709 13:12:29.789953 (+1454870us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b54003511d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:29.790060 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120467840}
I20260709 13:12:29.791325 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:29.791886 28725 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.793129 28728 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:29.794297 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:29.777192 32506 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.796231 32506 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.799206 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:29.756649 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.800163 28721 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:29.787822 29254 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.803231 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:29.802034 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.810091 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:29.810331 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:29.811998 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:29.810767 28729 raft_consensus.cc:2376] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7. Re-sending same reply.
I20260709 13:12:29.814963 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:29.815141 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:29.746713 32074 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.855906 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:29.826196 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:29.853996 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:29.828316 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:29.866855 28722 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:29.866664 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:29.870425 28730 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:29.868660 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:29.871065 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:29.870934 28728 raft_consensus.cc:2368] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:29.868172 28573 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:29.871810 28722 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.853673 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:29.872623 28572 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.850976 29260 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:29.819660 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:29.875530 28656 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.876885 29254 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:29.863883 28729 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:29.897974 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.040470 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:29.886359 28721 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:30.041664 29254 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:30.042436 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:29.895190 28723 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
W20260709 13:12:30.010005 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.043951 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:29.953439 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:30.044943 28723 raft_consensus.cc:2410] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:30.010049 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:30.045527 28728 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.935221 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:30.046290 28729 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:29.912577 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:30.047228 29251 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.048051 28656 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:12:29.893628 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 67520.8us
I20260709 13:12:29.648288 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.049921 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:29.964609 32535 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.050734 32505 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:30.051148 32505 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:30.051535 32505 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.948926 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.053342 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:29.814335 32449 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:30.054965 32279 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:29.829277 32510 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:29.898741 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65826.9us
I20260709 13:12:30.059026 28724 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:30.067240 28722 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:30.068967 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.071008 29260 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:30.069259 29254 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: [5.7-9.9]
I20260709 13:12:30.078017 28726 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:29.814131 32500 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:29.948915 32004 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:30.080681 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:30.092002 29254 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:29.828245 32136 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:30.102890 28724 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:29.868135 32486 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.914587 32495 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:29.900179 32573 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.055962 32510 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:29.963163 32430 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:30.055968 32251 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.914317 32405 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:29.901762 32074 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:30.083746 32467 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:30.103652 32004 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.106536 32279 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.829110 32436 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.276s
I20260709 13:12:30.121237 32510 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:30.125152 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.817860 32508 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.285s
W20260709 13:12:30.134720 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 319831us
I20260709 13:12:29.878693 32433 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.232s
I20260709 13:12:30.136521 32495 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.104566 32519 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:30.144881 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 291346us
I20260709 13:12:30.155095 28728 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:12:30.184953 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.185413 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.185787 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.191977 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:30.192907 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.104059 32500 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.111079 32136 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.193635 28579 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
W20260709 13:12:30.217509 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 319152us
I20260709 13:12:30.227989 29254 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:30.226161 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:30.127130 32486 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.241701 29257 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:30.134924 32573 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.247622 29251 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:30.248415 28730 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.143070 32405 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.138134 32430 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.184377 32510 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:30.194947 32582 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:30.232513 32569 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:30.274497 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2026) took 1409 ms. Trace:
I20260709 13:12:30.226219 32251 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:12:30.275122 28649 rpcz_store.cc:276] 0709 13:12:28.865372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.865469 (+    97us) service_pool.cc:224] Handling call
0709 13:12:28.865713 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.185843 (+320130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.274087 (+1088244us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54003b1854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:30.274408 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723288832}
I20260709 13:12:30.284623 29256 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:30.285398 28730 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
W20260709 13:12:30.287359 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.193264 32495 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:30.287853 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.195183 32519 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.288249 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:30.311025 28545 leader_election.cc:400] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
W20260709 13:12:30.296685 28725 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.002s
I20260709 13:12:30.312043 28725 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:30.302047 29254 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:30.313782 28726 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:12:30.322543 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.324263 29256 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:30.285267 32569 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:30.286968 32279 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.344803 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:30.270676 32510 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:30.342921 32409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.018s	sys 0.022s
I20260709 13:12:30.315412 32492 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:30.276424 32582 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.291317 32469 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:12:30.371639 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:30.339659 32098 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:30.364499 32409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.019s	sys 0.022s
I20260709 13:12:30.358505 32508 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.359362 32584 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.391707 32582 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.380765 32583 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:30.394058 32581 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:12:30.402585 28572 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:30.366226 32449 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:30.405575 29252 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:12:30.380568 32564 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:12:30.417785 32585 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.418571 32585 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.421592 32593 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.422300 32585 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.422399 32593 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:30.425966 32136 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.426859 32136 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.427482 32136 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:30.431283 32573 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:30.437503 32569 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.442330 32519 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.444590 32510 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:30.407730 32578 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:12:30.408345 32492 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:30.385138 32594 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.454128 32594 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.462359 32500 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.463692 32486 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.474362 32587 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:30.475073 32587 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:30.475572 32587 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:30.407423 32577 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:12:30.486419 32495 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:30.411985 32583 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.491875 32583 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.493213 32004 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.495424 32074 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:30.495620 32443 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:30.496047 32492 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:30.496135 32443 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:30.497159 32492 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.497319 32443 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:30.498016 32430 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.499801 32449 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:30.500981 32449 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:30.504462 32405 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.360517 32279 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.404768 32508 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.408581 32584 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.518783 32584 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.387418 32098 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.383219 32435 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.521615 32435 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.524300 32435 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.537245 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:30.540427 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.542229 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.543148 28578 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
W20260709 13:12:30.544049 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.550745 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.551301 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:30.552752 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.553742 28581 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:30.555143 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.556365 32601 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:30.556936 32601 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.557262 32437 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:30.557667 28579 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:30.557827 32437 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:30.558876 32437 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.560037 32437 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.560832 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.561980 32467 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:30.562515 32467 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.563838 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.564831 28578 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:30.566057 32098 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.567958 32506 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.557370 32601 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:30.575263 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.579859 28578 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:30.600343 32507 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.571157 32508 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.606973 32136 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:30.590055 32594 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.608083 32593 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:30.620728 32505 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.004s
I20260709 13:12:30.642993 32505 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.600543 32601 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.610891 32467 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.662289 29257 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:30.670369 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.671062 28696 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:30.672946 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.687388 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.689352 29251 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:30.690218 32610 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:12:30.691279 32610 consensus_queue.cc:1243] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:30.666978 32480 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.672250 32430 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:30.666671 32593 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:30.698215 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1169) took 1022 ms. Trace:
I20260709 13:12:30.698149 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:30.705430 29260 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:30.698770 29258 rpcz_store.cc:276] 0709 13:12:29.676017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.676132 (+   115us) service_pool.cc:224] Handling call
0709 13:12:29.686035 (+  9903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:29.698220 (+ 12185us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:29.800500 (+102280us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.658770 (+858270us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:30.667272 (+  8502us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.667491 (+   219us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:30.667569 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.667661 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:30.697991 (+ 30330us) raft_consensus.cc:1685] finished
0709 13:12:30.698018 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.698151 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8160,"prepare.queue_time_us":37557,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":21007,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":796,"thread_start_us":872932,"threads_started":3,"wal-append.queue_time_us":598161}
I20260709 13:12:30.712625 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:30.694998 32279 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:30.691540 32467 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:30.693562 32430 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:30.724532 32430 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:30.693027 32480 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:30.727598 32480 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:30.728319 32594 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:30.729696 32452 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:30.730836 32452 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:30.731192 32452 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:30.733412 32611 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:30.734043 32611 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.734572 32611 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.740226 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1163) took 1306 ms. Trace:
W20260709 13:12:30.742456 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.691824 32610 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:30.687229 32136 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:30.751781 28575 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:30.760023 28575 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:30.740993 29252 rpcz_store.cc:276] 0709 13:12:29.433897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.434864 (+   967us) service_pool.cc:224] Handling call
0709 13:12:29.454579 (+ 19715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:30.416257 (+961678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.739806 (+323549us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b5400538254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:30.740125 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2186206464}
I20260709 13:12:30.755002 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:30.753800 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:30.694499 32601 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:30.728875 32594 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.764886 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.760926 28575 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.769505 28575 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.770905 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.732347 32452 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.775115 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.755837 32610 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:30.695055 32593 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.759889 32499 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:30.779714 28619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.028s	sys 0.063s
I20260709 13:12:30.782850 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.784065 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:30.793929 28619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.028s	sys 0.063s
I20260709 13:12:30.794009 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.795221 29258 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
W20260709 13:12:30.796437 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 424887us
I20260709 13:12:30.800160 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:30.804870 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 228904us
I20260709 13:12:30.806285 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:30.809787 28649 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:30.819685 28577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.012s
W20260709 13:12:30.820766 28577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.009s	sys 0.012s
W20260709 13:12:30.821677 28727 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.001s
W20260709 13:12:30.822080 28727 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.005s	sys 0.001s
I20260709 13:12:30.822762 32469 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:30.766440 32437 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:30.767012 32594 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.827070 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.832253 28575 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:12:30.845307 28575 pending_rounds.cc:85] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 8
I20260709 13:12:30.845587 28575 pending_rounds.cc:107] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:12:30.845876 28575 raft_consensus.cc:2889] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:30.834865 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.835704 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:30.848567 28578 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.761313 32508 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:12:30.842934 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.843457 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.849069 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.853971 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:30.854578 28656 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
W20260709 13:12:30.837250 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 470069us
W20260709 13:12:30.804908 28620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.012s
W20260709 13:12:30.856081 28620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.012s
W20260709 13:12:30.856591 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 630620us
I20260709 13:12:30.842187 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:30.859579 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:30.823324 32469 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:30.860328 28581 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 5.
I20260709 13:12:30.764130 32506 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:12:30.861893 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1815) took 1035 ms. Trace:
I20260709 13:12:30.863130 28721 rpcz_store.cc:276] 0709 13:12:29.826727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.069970 (+243243us) service_pool.cc:224] Handling call
0709 13:12:30.070342 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.070551 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:30.344174 (+273623us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.861501 (+517327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:30.861559 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:30.861619 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.861694 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.861833 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23520,"prepare.queue_time_us":435428,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"thread_start_us":718382,"threads_started":2}
I20260709 13:12:30.793108 32601 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:30.863644 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:30.866449 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1803) took 1054 ms. Trace:
I20260709 13:12:30.865250 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:30.865607 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:30.791651 32098 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:30.871874 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:30.827723 32437 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.874650 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:30.852972 32599 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:30.875180 32567 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:12:30.878165 28578 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:30.867108 28727 rpcz_store.cc:276] 0709 13:12:29.810549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.811180 (+   631us) service_pool.cc:224] Handling call
0709 13:12:29.811473 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:29.821245 (+  9772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.821298 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:29.821933 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.233540 (+411607us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:30.822480 (+588940us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.864739 (+ 42259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.864840 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:30.864888 (+    48us) raft_consensus.cc:1685] finished
0709 13:12:30.864905 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.865060 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49986,"prepare.queue_time_us":272710,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":10345,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":39342,"thread_start_us":820618,"threads_started":2,"wal-append.queue_time_us":445133}
W20260709 13:12:30.864686 28722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.004s	sys 0.007s
I20260709 13:12:30.880138 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:30.885546 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:30.863657 32452 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.864053 32592 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.827517 32499 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:30.864305 32469 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:30.895684 28727 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:30.900019 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:30.876021 32492 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:30.896538 32200 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:30.893193 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:30.981074 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:30.879705 32510 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:30.874578 32430 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:30.917455 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.900746 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:30.877393 32582 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:30.877935 32601 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:30.865470 32537 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:30.905767 32563 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:30.900404 32519 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:31.155296 32519 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:31.156978 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 171755us
I20260709 13:12:31.172583 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1817) took 1345 ms. Trace:
I20260709 13:12:30.983901 32459 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.167s
W20260709 13:12:31.134367 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 241241us
I20260709 13:12:31.176570 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:30.987102 32467 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:31.003065 32587 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:12:30.877555 32595 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:12:30.882335 32437 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.881785 32599 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:31.139349 29255 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:12:31.141350 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 255872us
I20260709 13:12:30.878248 32098 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:31.141702 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 267103us
I20260709 13:12:31.144757 32405 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:31.154609 32613 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.166s	user 0.003s	sys 0.006s
W20260709 13:12:31.154838 32633 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 13:12:31.147943 32614 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:31.236145 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.173069 28726 rpcz_store.cc:276] 0709 13:12:29.827409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.079164 (+251755us) service_pool.cc:224] Handling call
0709 13:12:30.313544 (+234380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:30.314160 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.172387 (+858227us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54001e6ed0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:31.172524 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538057472}
W20260709 13:12:31.132745 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 147123us
I20260709 13:12:31.148447 32582 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:31.181592 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.133318 32425 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:12:31.138234 32618 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:31.148586 32583 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:31.191869 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 291927us
I20260709 13:12:31.192315 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:31.276566 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:31.276976 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 84738.4us
W20260709 13:12:31.280586 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.192484 28723 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:31.150866 32445 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:30.886467 32610 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.145716 32430 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.175729 32279 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:31.195590 32587 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.160382 32374 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.223518 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:31.200837 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1424) took 1424 ms. Trace:
I20260709 13:12:31.183951 32459 consensus_queue.cc:1243] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:31.227598 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.241139 32405 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:31.156806 32537 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.194532 32467 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.310550 32467 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.229770 32586 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:31.197288 32507 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.004s
W20260709 13:12:31.198704 32625 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:12:31.138270 32510 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.173506 32505 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.251168 32601 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.253201 32593 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.237500 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:31.265674 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1816) took 1438 ms. Trace:
I20260709 13:12:31.199106 32250 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:12:31.226162 32599 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.171162 32004 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:12:31.281965 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:31.141425 32592 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.288080 28728 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:31.289053 29255 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:31.288921 29260 rpcz_store.cc:276] 0709 13:12:29.776807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.087971 (+311164us) service_pool.cc:224] Handling call
0709 13:12:30.088298 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.706332 (+618034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.200582 (+494250us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54006cbe54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:31.200775 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418627840}
I20260709 13:12:31.175889 32432 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.143306 32492 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.292073 28730 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
W20260709 13:12:31.292536 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:31.272187 32635 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:12:31.356464 32437 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.358079 32492 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.358791 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1168) took 1685 ms. Trace:
I20260709 13:12:31.359189 32437 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:31.359153 29259 rpcz_store.cc:276] 0709 13:12:29.673153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.673288 (+   135us) service_pool.cc:224] Handling call
0709 13:12:29.673706 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:29.674054 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:30.394479 (+720425us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b1800378d00. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a2b80e3c7 00007f4a27e209a7 00007f4a27e300bf 00007f4a27e30038
0709 13:12:30.525328 (+130849us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4800230ad8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2cd3faa1 00007f4a2cd36b37 00007f4a2cd369ca 00007f4a2ce2e26f 00007f4a2ce2df37 00007f4a2ce4255c 00007f4a2ce42508 00007f4a2ce42488 00007f4a2ce42443 00007f4a2ce416ec 00007f4a2bd6ba96
0709 13:12:30.802379 (+277051us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.879020 (+ 76641us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:30.881450 (+  2430us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.881861 (+   411us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:30.881928 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.882060 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:31.358584 (+476524us) raft_consensus.cc:1685] finished
0709 13:12:31.358605 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.358726 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3182,"prepare.queue_time_us":61306,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":8089,"raft.run_cpu_time_us":4000,"raft.run_wall_time_us":854978,"spinlock_wait_cycles":6425216,"thread_start_us":483282,"threads_started":2,"wal-append.queue_time_us":340953}
W20260709 13:12:31.301364 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 77963.2us
I20260709 13:12:31.305420 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.364636 28581 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:31.364807 28696 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:31.367870 32594 consensus_meta.cc:287] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:12:31.306000 32596 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:31.306056 32506 raft_consensus.cc:2764] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:31.306627 32465 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:31.369304 32596 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:31.369557 32465 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.370285 32596 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.371955 32465 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.307641 32587 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.287395 32200 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:31.372960 32200 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:31.373930 32200 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.376324 32432 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.378605 32432 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.359467 32535 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:31.381110 32606 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:31.381423 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.381798 32606 consensus_queue.cc:1243] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:31.382023 29259 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:31.382594 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.382899 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.383733 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.383985 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.384341 29255 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:31.384519 29259 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:31.327327 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.320637 32586 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:31.388075 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:31.331362 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 93937.8us
I20260709 13:12:31.330981 28722 rpcz_store.cc:276] 0709 13:12:29.827056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.070684 (+243628us) service_pool.cc:224] Handling call
0709 13:12:30.071059 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:30.280418 (+209359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.280452 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:30.309359 (+ 28907us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.884888 (+575529us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:30.902077 (+ 17189us) log.cc:844] Serialized 14 byte log entry
0709 13:12:31.265284 (+363207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.265376 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:31.265421 (+    45us) raft_consensus.cc:1685] finished
0709 13:12:31.265434 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.265608 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":249788,"prepare.queue_time_us":269928,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":473104,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":41707,"thread_start_us":835907,"threads_started":3,"wal-append.queue_time_us":848676}
I20260709 13:12:31.302413 32445 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:31.317611 32604 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:31.320711 32519 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:31.341271 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 59405.1us
I20260709 13:12:31.395855 32469 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.396004 32445 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.396960 28572 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:31.344063 32250 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:31.343652 32405 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.329484 32510 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:31.398792 32469 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.283342 32618 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.345729 32582 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.326347 32610 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.391716 32601 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:31.346742 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2437) took 1191 ms. Trace:
I20260709 13:12:31.404186 28577 rpcz_store.cc:276] 0709 13:12:30.155092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.155233 (+   141us) service_pool.cc:224] Handling call
0709 13:12:30.155558 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:30.155795 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.155818 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:30.156235 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.821678 (+665443us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:30.821758 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.822156 (+   398us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:31.346545 (+524389us) raft_consensus.cc:1685] finished
0709 13:12:31.346565 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.346690 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":571744,"threads_started":1,"wal-append.queue_time_us":1150357}
W20260709 13:12:31.406205 32636 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.002s
I20260709 13:12:31.410897 32618 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.411204 32510 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.327394 32434 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.413180 32601 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.413308 32434 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.337119 32507 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:31.413812 32601 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.414763 28722 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:31.415380 32510 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:31.415779 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.297123 32374 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.348994 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:31.349885 32628 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.120s	user 0.000s	sys 0.005s
I20260709 13:12:31.416056 32601 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.354504 32430 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.355839 32537 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.368340 32594 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.291435 32485 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:31.390686 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.395705 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.395501 32604 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.395759 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.449795 28730 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:31.449903 28726 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:31.302912 32279 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.401609 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.402305 32250 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:31.322794 32621 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:31.414156 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.420539 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.420899 28654 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:31.421568 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.422087 32443 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.422341 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2040) took 1614 ms. Trace:
I20260709 13:12:31.400698 32586 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.423445 28723 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:12:31.463698 28723 pending_rounds.cc:85] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 6
I20260709 13:12:31.463960 28723 pending_rounds.cc:107] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:12:31.464191 28723 raft_consensus.cc:2889] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:31.356351 32611 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.000s
I20260709 13:12:31.351192 32098 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.416960 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.342370 32499 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.417932 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.474359 28647 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 5.
I20260709 13:12:31.474624 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:31.475351 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:31.417603 28725 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 6.
I20260709 13:12:31.418658 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.475368 28730 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:31.476933 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.419965 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:31.416368 28722 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:31.428915 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.429857 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:31.418355 32374 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.457823 28580 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
I20260709 13:12:31.457216 28577 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:31.467024 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.463605 32436 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:31.468299 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.468605 28581 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:31.470125 32279 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:31.470206 32586 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.470762 32611 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.460167 28655 rpcz_store.cc:276] 0709 13:12:29.808057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.808158 (+   101us) service_pool.cc:224] Handling call
0709 13:12:29.866111 (+ 57953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:30.130039 (+263928us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:30.139211 (+  9172us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.571013 (+431802us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b1800332680. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a 00007f4a27e20a2a
0709 13:12:30.900310 (+329297us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:30.979183 (+ 78873us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.984626 (+  5443us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:30.984669 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.984735 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:31.289137 (+304402us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:31.422070 (+132933us) raft_consensus.cc:1685] finished
0709 13:12:31.422099 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.422260 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113110,"prepare.queue_time_us":8889,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":308973,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":150873,"spinlock_wait_cycles":14663808,"thread_start_us":523031,"threads_started":2,"wal-append.queue_time_us":1079102}
I20260709 13:12:31.471837 32592 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.459554 32618 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:12:31.463176 32485 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:31.539510 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.419636 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:31.545109 28695 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.949s (SENT) [suppressed 18 similar messages]
I20260709 13:12:31.466535 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:31.507548 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.482928 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.503731 29223 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:31.539471 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.546880 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:31.520897 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 91094.2us
I20260709 13:12:31.492321 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.547308 28574 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:31.548449 28696 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:31.477957 28725 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:31.444862 32469 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:12:31.538537 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:31.553738 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:31.558991 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 271454us
W20260709 13:12:31.550273 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.550985 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:31.532964 28726 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:31.545140 28730 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:31.558568 28581 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:31.547277 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 43670.9us
I20260709 13:12:31.559719 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:31.567828 28730 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:31.557569 28696 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.592600 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:31.568118 28577 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:31.594447 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:31.595726 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.597975 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:31.601877 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.603435 28724 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:31.604053 28722 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:31.468536 32467 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:12:31.604238 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.594105 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.614773 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:31.556885 32098 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:31.602598 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:31.562659 32601 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:31.467753 32621 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.562367 32507 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:31.623957 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53555.5us
I20260709 13:12:31.603974 32586 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:31.621608 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50084.8us
I20260709 13:12:31.613976 32593 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:31.636117 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:31.536717 32436 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.542510 32599 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.643270 28727 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:31.571131 32537 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:12:31.619104 32582 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:31.622377 32519 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:31.627249 32506 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:31.629781 32618 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:31.629580 32606 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:31.625838 32425 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:31.604216 32432 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:12:31.602716 32592 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:31.568351 32492 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:12:31.618321 28696 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.624648 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:31.685562 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 67353.9us
I20260709 13:12:31.649209 32582 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.740120 32582 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:31.631246 32507 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:31.744768 32507 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.635707 32586 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:31.749282 32586 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:31.750028 28695 leader_election.cc:336] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.843s (SENT)
I20260709 13:12:31.750559 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:31.751799 32537 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:31.638712 32593 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:31.753923 32593 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.690385 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:31.626838 32495 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:31.757562 32495 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:31.757902 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67648us
I20260709 13:12:31.758667 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.759416 32445 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:31.759713 32495 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.694231 32583 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:31.760015 32445 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:31.760375 32583 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:31.760488 32480 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:31.760612 32445 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:31.684474 32592 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.700824 28581 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:31.761904 32592 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:31.706974 32436 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:31.673321 32467 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:31.763622 32467 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.764115 32467 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:31.725489 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 100973us
I20260709 13:12:31.765977 32611 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.766597 32430 raft_consensus.cc:2764] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:31.726092 32499 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:31.766919 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:31.655992 32506 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:31.767185 32499 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:31.767524 32506 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.767839 32499 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.768617 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.769600 32606 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:31.769897 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.770169 32606 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:31.727703 32587 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:31.674387 32618 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.771193 32618 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.771227 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.771111 32606 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.772238 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.773916 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:31.774567 29258 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.776593 32611 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:31.777361 32611 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:31.771126 32587 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.778264 32621 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.778712 32611 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.725335 32432 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:31.780067 32432 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:31.780160 32587 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.726397 32604 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:31.732671 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:31.781612 29254 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:31.681950 32425 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.782517 32425 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.634415 32465 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:12:31.784346 32465 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:31.784747 32465 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:31.785382 32537 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:31.785686 32465 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.787115 32465 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.787317 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.652048 32519 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:31.789724 32519 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.617426 32250 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.760890 32583 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.781085 32432 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.785975 32537 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.648170 32485 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:31.731362 32594 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:31.738444 32641 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:12:31.760943 32480 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.798659 29254 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:31.812217 28579 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:31.818679 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.824819 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.825598 29259 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:31.826287 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.834146 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.835068 29251 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:31.813624 32432 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.759477 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:31.813553 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:31.844647 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.819880 32480 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:31.846900 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 87469.2us
I20260709 13:12:31.857954 29251 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:31.860317 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:31.861606 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:31.872272 29258 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:31.876756 28647 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:31.881204 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:31.882324 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.883936 29251 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 7: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:31.925249 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.925819 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.863150 32449 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:31.928093 29258 raft_consensus.cc:2368] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11.
I20260709 13:12:31.933468 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.935904 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.884423 32639 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:31.931479 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.941221 29251 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:31.884367 32652 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.928398 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 292335us
I20260709 13:12:31.938941 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.949532 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:31.950623 32654 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:31.955425 32654 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:31.955941 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.957203 32659 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:31.956856 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.957782 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.925881 32604 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.962615 32604 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:31.959203 29259 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:12:31.966018 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:31.967578 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:31.970841 32604 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.957767 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:31.986974 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:31.933033 32449 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:31.995441 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 144778us
I20260709 13:12:31.996934 32611 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:31.997751 32611 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:32.004304 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.005344 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:31.959718 32599 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:31.989567 32279 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:32.031076 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.033561 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:32.046334 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:32.002581 32449 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.055733 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:32.051630 29252 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:32.054195 28622 leader_election.cc:400] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11.
I20260709 13:12:32.057237 28622 leader_election.cc:403] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:32.059028 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:32.064119 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.065914 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:32.084095 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 127298us
W20260709 13:12:32.088378 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.088254 28726 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:32.048667 32279 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:32.065213 32587 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:31.990891 32652 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.066892 32004 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.045863 32564 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:12:32.100951 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:32.102504 28726 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:32.105212 28726 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:32.105718 28696 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:32.106197 28722 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:32.110064 32593 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.114079 32593 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.115128 32593 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.115748 32593 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:32.127506 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.085749 32596 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.051405 32618 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.090364 32537 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:32.123018 32647 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:12:32.094484 32279 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:32.142422 32655 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:12:32.096127 32251 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:32.139767 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:32.140626 29257 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:32.147032 29252 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:32.131534 32620 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:32.151939 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:32.135777 32596 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:32.152818 32644 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
W20260709 13:12:32.160023 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 94217.9us
I20260709 13:12:32.095724 32467 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.142784 32593 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.155117 32517 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:32.172670 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:32.158428 32620 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:32.175155 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:32.176815 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:32.179579 32499 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:32.185463 29253 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:32.181191 32645 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 13:12:32.220284 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47668.7us
I20260709 13:12:32.175812 32593 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.182893 32620 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:32.235941 32649 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:12:32.145190 32611 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.239162 29258 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:32.240649 32596 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:32.235152 32443 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.004s
W20260709 13:12:32.268925 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 213306us
I20260709 13:12:32.217870 32667 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:32.301414 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:32.294854 32537 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:32.306715 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1064) took 1130 ms. Trace:
I20260709 13:12:32.307291 28721 rpcz_store.cc:276] 0709 13:12:31.176179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.176312 (+   133us) service_pool.cc:224] Handling call
0709 13:12:31.176605 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.303675 (+127070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.303711 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.303757 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:31.303795 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.306363 (+1002568us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002d8554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:32.306434 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.306637 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291738368}
I20260709 13:12:32.310000 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.317386 28652 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:32.319484 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:32.320148 28574 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.321323 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.241662 32593 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:32.332326 32674 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:12:32.303157 32200 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.337057 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.338513 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.340070 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:32.328053 32648 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:12:32.325301 32517 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:32.354358 32593 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:32.340131 32507 consensus_meta.cc:287] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
W20260709 13:12:32.361481 32661 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:12:32.342737 32200 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:32.370703 32507 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:32.391228 32616 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 1.099s	user 0.000s	sys 0.008s
I20260709 13:12:32.393818 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.394855 28652 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:32.402995 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.404196 28572 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:32.406060 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2610) took 1121 ms. Trace:
I20260709 13:12:32.407794 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:32.406607 28578 rpcz_store.cc:276] 0709 13:12:31.284376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.284528 (+   152us) service_pool.cc:224] Handling call
0709 13:12:31.284786 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.321251 (+ 36465us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:31.339366 (+ 18115us) log.cc:844] Serialized 14 byte log entry
0709 13:12:31.635594 (+296228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.635675 (+    81us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:31.635752 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.383929 (+748177us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b540031ea54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:32.405835 (+ 21906us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.405991 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148015,"prepare.queue_time_us":15769,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1926,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10535,"spinlock_wait_cycles":82930432,"thread_start_us":295199,"threads_started":1,"wal-append.queue_time_us":491607}
I20260709 13:12:32.410815 28574 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:32.416270 29224 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:32.326164 32679 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:32.432861 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 1070) took 1193 ms. Trace:
I20260709 13:12:32.433432 28728 rpcz_store.cc:276] 0709 13:12:31.232062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.232253 (+   191us) service_pool.cc:224] Handling call
0709 13:12:32.372980 (+1140727us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54001b9754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:32.425301 (+ 52321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117684096}
I20260709 13:12:32.435837 29255 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:32.432058 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.437767 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:32.438971 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:32.440513 32670 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.131s	user 0.000s	sys 0.003s
I20260709 13:12:32.347318 32499 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:32.425908 32506 consensus_meta.cc:287] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.001s
W20260709 13:12:32.427057 32586 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.001s
I20260709 13:12:32.456739 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.459796 28652 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:32.426486 32425 consensus_meta.cc:287] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.001s
I20260709 13:12:32.430053 32564 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.355473 32517 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:32.416963 32618 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.456382 32467 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:32.452782 32649 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:32.437255 32601 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:32.488341 32467 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:32.453907 32519 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.005s
I20260709 13:12:32.414570 32443 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 13:12:32.489512 32661 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:32.453624 32652 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:32.480383 32506 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.531540 32506 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.521497 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.521524 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:32.491811 32601 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:32.480430 32436 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:32.488740 32586 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:32.533314 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:32.533536 32436 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.534228 28656 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:32.534296 32436 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.492058 32564 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:32.537142 32671 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:12:32.538334 32467 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:32.538918 32678 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:12:32.538978 32564 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.539405 32467 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.533327 32601 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.542474 32601 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:32.523808 32445 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.003s
I20260709 13:12:32.545636 32445 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.546784 28577 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:32.547771 28656 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:32.552711 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.554754 28656 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:32.555266 32564 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.556648 32564 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.556136 32445 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.559315 32564 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.560645 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:32.563266 32480 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.002s
I20260709 13:12:32.563486 28656 raft_consensus.cc:2376] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7. Re-sending same reply.
I20260709 13:12:32.563771 32480 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:32.564116 32436 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.564528 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.565132 28656 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
W20260709 13:12:32.565624 32592 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.003s
I20260709 13:12:32.566192 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1443) took 1192 ms. Trace:
W20260709 13:12:32.567868 32432 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.005s
I20260709 13:12:32.568125 32437 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:32.577131 28694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.032s	sys 0.080s
W20260709 13:12:32.577509 28694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.032s	sys 0.080s
I20260709 13:12:32.491389 32499 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.578801 32507 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:32.580591 32465 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.789s	user 0.009s	sys 0.002s
I20260709 13:12:32.581275 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.488962 32425 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.582175 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:32.583642 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:32.582417 29251 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:12:32.586802 29225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.040s	sys 0.036s
W20260709 13:12:32.587226 29225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.040s	sys 0.036s
I20260709 13:12:32.588430 28655 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:32.588984 29253 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:32.591979 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.573114 29256 rpcz_store.cc:276] 0709 13:12:31.374083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.385468 (+ 11385us) service_pool.cc:224] Handling call
0709 13:12:31.406121 (+ 20653us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:31.406516 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.406545 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:31.407121 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 13:12:31.602519 (+195398us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:31.833049 (+230530us) log.cc:844] Serialized 14 byte log entry
0709 13:12:31.833291 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.833377 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.383417 (+550040us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b4800230ad8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2cd3faa1 00007f4a2cd36b37 00007f4a2cd369ca 00007f4a2ce2e26f 00007f4a2ce2df37 00007f4a2ce4255c 00007f4a2ce42508 00007f4a2ce42488 00007f4a2ce42443 00007f4a2ce416ec 00007f4a2bd6ba96
0709 13:12:32.565898 (+182481us) raft_consensus.cc:1685] finished
0709 13:12:32.565994 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.566134 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107522,"prepare.queue_time_us":333987,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":1290,"raft.run_cpu_time_us":3136,"raft.run_wall_time_us":586479,"spinlock_wait_cycles":11317120,"thread_start_us":393711,"threads_started":2,"wal-append.queue_time_us":447543}
I20260709 13:12:32.594213 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:32.489050 32517 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:32.586825 32507 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.599406 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:32.599997 29253 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.600327 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.599030 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:32.603482 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2048) took 1187 ms. Trace:
I20260709 13:12:32.591053 32465 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:32.593163 32616 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:12:32.607245 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 489667us
I20260709 13:12:32.590875 32601 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.592104 32596 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.570082 32519 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.577946 32592 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:32.613752 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:32.646811 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 325268us
I20260709 13:12:32.647454 28721 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.649421 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:32.650041 28728 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:32.591122 32499 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:32.587147 32437 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.651973 29253 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:12:32.622133 28649 rpcz_store.cc:276] 0709 13:12:31.416051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.416174 (+   123us) service_pool.cc:224] Handling call
0709 13:12:31.416482 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.416815 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:31.651323 (+234508us) log.cc:844] Serialized 14 byte log entry
0709 13:12:31.986512 (+335189us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.987027 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:12:31.987218 (+   191us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:31.987264 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.987345 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.603209 (+615864us) raft_consensus.cc:1685] finished
0709 13:12:32.603241 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.603404 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4657,"prepare.queue_time_us":427094,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":42741,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":19467,"thread_start_us":361199,"threads_started":2,"wal-append.queue_time_us":255204}
I20260709 13:12:32.620918 32465 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.597481 32279 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.658941 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.657743 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:32.660693 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.661584 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.670146 28574 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:32.670868 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.673074 28647 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:32.677556 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:32.646328 32436 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:32.679399 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:32.677556 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.687068 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:32.652134 32507 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:32.685866 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:32.690308 29252 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:32.692338 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.693034 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.560886 32449 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:32.698288 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:32.668759 32465 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.626157 32596 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:32.702301 32676 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.401s	user 0.000s	sys 0.003s
W20260709 13:12:32.703939 32583 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.889s	user 0.004s	sys 0.008s
I20260709 13:12:32.705615 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1072) took 1416 ms. Trace:
I20260709 13:12:32.708595 32620 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.711654 28578 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.731642 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1809) took 2915 ms. Trace:
I20260709 13:12:32.713563 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:32.700280 32627 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.394s	user 0.003s	sys 0.007s
I20260709 13:12:32.698068 28728 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:32.667881 32469 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:12:32.647289 32601 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.723253 28725 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:32.725589 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:32.695479 32582 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.955s	user 0.011s	sys 0.004s
I20260709 13:12:32.732091 28729 rpcz_store.cc:276] 0709 13:12:29.812134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.047102 (+234968us) service_pool.cc:224] Handling call
0709 13:12:30.047448 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:30.319398 (+271950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.319432 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:30.320038 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 13:12:30.803755 (+483717us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:30.804558 (+   803us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.831781 (+ 27223us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.832543 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.832615 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:31.199795 (+367180us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b1800427ba0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:31.816208 (+616413us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b1800427ba0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:32.332859 (+516651us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:32.727158 (+394299us) raft_consensus.cc:1685] finished
0709 13:12:32.727190 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.727400 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23185,"prepare.queue_time_us":537,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":262213,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":25190,"spinlock_wait_cycles":52010496,"thread_start_us":707956,"threads_started":2,"wal-append.queue_time_us":804180}
I20260709 13:12:32.718057 32480 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.751453 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.752143 28649 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:32.760288 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:32.764827 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:32.770399 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:32.731344 32583 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.659088 32667 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:12:32.692723 32507 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:32.745838 28578 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:12:32.773937 29254 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.043s	sys 0.060s
I20260709 13:12:32.777431 28649 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.728976 28723 rpcz_store.cc:276] 0709 13:12:31.289730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.289902 (+   172us) service_pool.cc:224] Handling call
0709 13:12:31.290335 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.464942 (+174607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.705305 (+1240363us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001b8854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:32.705550 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305340672}
W20260709 13:12:32.780725 29254 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.043s	sys 0.060s
W20260709 13:12:32.774482 32587 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.673s	user 0.013s	sys 0.000s
I20260709 13:12:32.790973 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.791857 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2440) took 1001 ms. Trace:
I20260709 13:12:32.792160 28647 rpcz_store.cc:276] 0709 13:12:31.790396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.790673 (+1000277us) service_pool.cc:224] Handling call
0709 13:12:32.791796 (+  1123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:32.794803 32656 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.833s	user 0.001s	sys 0.002s
I20260709 13:12:32.728941 28721 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:32.799554 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:32.750437 32582 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.771795 32586 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.811972 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.812917 28647 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:32.813585 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:32.784260 32642 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:32.814502 28656 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:32.785955 32507 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.772984 32480 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:12:32.819409 28730 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:32.803548 32587 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11.
I20260709 13:12:32.808100 32667 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:32.832232 32611 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:32.833209 32437 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:32.836614 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 140386us
I20260709 13:12:32.842309 28656 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:32.843173 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2438) took 1053 ms. Trace:
I20260709 13:12:32.845033 32279 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.845162 32611 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.846540 32690 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:32.847379 32611 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.847961 32690 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:32.848613 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:32.812705 32495 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.846743 32601 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.849160 28721 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.839928 28647 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:32.851503 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2437) took 1062 ms. Trace:
I20260709 13:12:32.851943 28647 rpcz_store.cc:276] 0709 13:12:31.789537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.813700 (+1024163us) service_pool.cc:224] Handling call
0709 13:12:32.839691 (+ 25991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.851152 (+ 11461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.851435 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.843600 28656 rpcz_store.cc:276] 0709 13:12:31.789825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.815428 (+1025603us) service_pool.cc:224] Handling call
0709 13:12:32.839107 (+ 23679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.842855 (+  3748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.843104 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.863019 28649 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:32.864095 28649 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:12:32.864555 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2444) took 1049 ms. Trace:
W20260709 13:12:32.853868 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.865770 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.864802 28649 rpcz_store.cc:276] 0709 13:12:31.815329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.863622 (+1048293us) service_pool.cc:224] Handling call
0709 13:12:32.863927 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.864391 (+   464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.864518 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.877736 28721 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:32.834365 32519 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.834046 32667 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:32.885076 28647 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:32.885897 28652 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:32.841166 32592 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.888105 28656 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:32.878924 32410 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:32.853354 32499 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.892122 28649 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:32.893360 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2063) took 1102 ms. Trace:
I20260709 13:12:32.896936 28647 rpcz_store.cc:276] 0709 13:12:31.791072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.865126 (+1074054us) service_pool.cc:224] Handling call
0709 13:12:32.884743 (+ 19617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.893046 (+  8303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.893270 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.897780 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2064) took 1100 ms. Trace:
I20260709 13:12:32.898365 28656 rpcz_store.cc:276] 0709 13:12:31.797394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.866670 (+1069276us) service_pool.cc:224] Handling call
0709 13:12:32.887869 (+ 21199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.897511 (+  9642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.897728 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.886658 32449 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.878859 32495 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.901165 28649 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:32.893728 32693 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:32.905686 32693 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.901765 32596 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.898149 32410 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.914409 32495 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.916415 32410 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:32.914435 32583 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.923911 32517 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.925103 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:32.926728 32620 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:32.937887 32668 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.962s	user 0.004s	sys 0.000s
I20260709 13:12:32.939844 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:32.949936 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:32.941146 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:32.947510 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.948721 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:32.954056 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.955277 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:32.951911 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1205) took 1010 ms. Trace:
I20260709 13:12:32.956581 29259 rpcz_store.cc:276] 0709 13:12:31.941131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.968658 (+ 27527us) service_pool.cc:224] Handling call
0709 13:12:31.972004 (+  3346us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:12:31.972977 (+   973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.973050 (+    73us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:12:31.974114 (+  1064us) log.cc:844] Serialized 104 byte log entry
0709 13:12:31.979860 (+  5746us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:32.063168 (+ 83308us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.087843 (+ 24675us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.300998 (+213155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.301971 (+   973us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.936980 (+635009us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:32.940037 (+  3057us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b1800393ca0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:32.951631 (+ 11594us) raft_consensus.cc:1685] finished
0709 13:12:32.951650 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.951834 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85521,"prepare.queue_time_us":162540,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":83763,"raft.run_cpu_time_us":578,"raft.run_wall_time_us":10147,"spinlock_wait_cycles":33604224,"thread_start_us":250067,"threads_started":3,"wal-append.queue_time_us":1177}
I20260709 13:12:32.961894 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:32.964224 28721 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:32.966239 28721 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:32.967000 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:32.967754 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:32.965427 32582 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:32.970366 32507 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:32.982285 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:32.983448 28728 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:32.985200 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:32.987740 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:32.960376 32519 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:32.993146 28728 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:32.996789 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.000890 28726 pending_rounds.cc:85] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 8
I20260709 13:12:33.001228 28726 pending_rounds.cc:107] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:12:33.001319 28729 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:33.001502 28726 raft_consensus.cc:2889] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:33.001796 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.002542 28728 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:33.002794 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.000461 28722 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260709 13:12:33.004281 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.004375 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:32.986441 32507 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.004966 28722 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:33.007853 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.008476 28725 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:32.909299 32667 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.011300 28728 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:33.011709 32449 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:33.026299 32612 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 1.717s	user 0.005s	sys 0.001s
I20260709 13:12:33.028134 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2046) took 2679 ms. Trace:
I20260709 13:12:33.028645 28651 rpcz_store.cc:276] 0709 13:12:30.348691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.351352 (+  2661us) service_pool.cc:224] Handling call
0709 13:12:30.351780 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:30.352335 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.352499 (+   164us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:30.353282 (+   783us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.797021 (+443739us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:30.797088 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.797182 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.024948 (+2227766us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:33.027728 (+  2780us) raft_consensus.cc:1685] finished
0709 13:12:33.027759 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.028026 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71051,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"spinlock_wait_cycles":27713280,"thread_start_us":443143,"threads_started":1,"wal-append.queue_time_us":954926}
I20260709 13:12:33.036214 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:33.036370 32587 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:32.999533 32465 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.039747 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:33.021963 32667 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:33.041745 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:33.043210 32465 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.044111 32200 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.044448 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:33.044914 32586 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.045662 28728 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:33.045975 28572 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:33.046414 32250 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:33.048076 28728 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:33.045681 32586 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.050912 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1203) took 1121 ms. Trace:
I20260709 13:12:33.017788 32449 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.051288 29251 rpcz_store.cc:276] 0709 13:12:31.929400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.942117 (+ 12717us) service_pool.cc:224] Handling call
0709 13:12:31.954794 (+ 12677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.590943 (+636149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.050657 (+459714us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400700154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.050852 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442736000}
I20260709 13:12:33.053110 32449 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.058314 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.050614 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.059028 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:33.074563 29251 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:33.074661 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:33.070789 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.038479 32517 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.075678 28725 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:33.048753 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:33.082013 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.083218 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.083539 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.083789 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:33.087122 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.088418 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:33.089560 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.091111 28576 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:33.091437 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.054869 32459 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:12:33.098989 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.084909 32510 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.102281 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.085122 32587 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.075102 32507 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:12:33.113062 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.097333 32250 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:33.097193 32432 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:33.095295 32519 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.096088 32499 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:33.100164 32583 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.116456 32567 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:12:33.138478 32434 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:33.096995 32586 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:12:33.139250 32587 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:33.139781 32586 consensus_queue.cc:1243] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:33.106130 32582 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:33.095839 32592 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:33.119974 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.147610 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:33.156647 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 63069.6us
I20260709 13:12:33.121047 32510 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.158397 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.158672 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:33.162730 32279 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:33.122520 32432 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.122740 32250 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:33.165100 28580 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:33.165756 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.167115 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.141597 32499 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.167860 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:33.168221 32405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.765s	user 0.034s	sys 0.046s
W20260709 13:12:33.172282 32405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.769s	user 0.035s	sys 0.046s
I20260709 13:12:33.144484 32582 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:33.171216 28695 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.173206 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.177111 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:33.157047 32583 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:33.182301 28725 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:33.163393 32601 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:33.170012 32432 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.168265 32592 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:33.185690 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.195305 28656 raft_consensus.cc:2410] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:12:33.182804 32583 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:33.195963 32583 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.196326 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.173950 32250 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.184149 32405 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.173728 32499 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.178575 32582 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:33.204617 32701 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:33.173223 32279 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.194803 32592 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:33.180003 32459 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:33.210747 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:33.217537 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.218847 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1081) took 1232 ms. Trace:
I20260709 13:12:33.218117 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2053) took 1800 ms. Trace:
I20260709 13:12:33.239253 28648 rpcz_store.cc:276] 0709 13:12:31.417528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.417643 (+   115us) service_pool.cc:224] Handling call
0709 13:12:31.417922 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.648255 (+230333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.648306 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.648373 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:31.648434 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.217903 (+1569469us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003b0e54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.217949 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.218063 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529056000}
I20260709 13:12:33.231204 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2061) took 1526 ms. Trace:
I20260709 13:12:33.242251 28655 rpcz_store.cc:276] 0709 13:12:31.705271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.705510 (+   239us) service_pool.cc:224] Handling call
0709 13:12:31.705830 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.589066 (+883236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.230920 (+641854us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b540022bd54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.231131 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029144832}
I20260709 13:12:33.253240 28726 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:33.187722 32601 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.237691 28730 rpcz_store.cc:276] 0709 13:12:31.986441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.987601 (+  1160us) service_pool.cc:224] Handling call
0709 13:12:31.990092 (+  2491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.821798 (+831706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.218581 (+396783us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54000cf154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.218779 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906456960}
W20260709 13:12:33.286512 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.289742 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:33.267184 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.257275 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:33.289719 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 112743us
W20260709 13:12:33.213414 32698 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:12:33.385421 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.228919 32519 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.417670 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:33.292877 32639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.304s	user 0.007s	sys 0.000s
I20260709 13:12:33.419313 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.233566 32459 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:33.418139 28648 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:33.211504 32279 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.222618 32582 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.434217 28656 raft_consensus.cc:2376] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7. Re-sending same reply.
I20260709 13:12:33.289535 32517 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:33.427652 32592 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.429267 32709 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:33.370083 32601 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.437932 32507 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.445592 32507 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.416518 32587 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:12:33.447162 32587 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:33.447590 32587 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:33.449338 32459 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.450601 32459 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.426213 32467 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:33.452028 32467 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.439762 32279 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.426856 32705 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:33.453691 32279 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.454676 32467 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.227854 32432 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.455782 32279 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.210173 32250 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.457233 32432 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.457396 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.438088 32499 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.458614 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.459431 28730 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:33.460042 32499 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.458734 32250 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.230996 32583 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.462961 32583 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.465255 32601 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:33.465853 32708 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:12:33.467897 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 175444us
W20260709 13:12:33.469195 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.460322 28647 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:33.469556 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:33.431747 32639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.445s	user 0.007s	sys 0.005s
I20260709 13:12:33.441346 32592 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.477954 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.478240 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.478724 28722 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.479792 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.481253 28728 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:33.481554 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:33.483052 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:33.450690 32582 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.480774 32583 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.443104 32710 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:12:33.487394 32586 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:33.487866 32586 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:33.470640 32709 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.489856 28730 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:33.492244 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.493878 28728 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.484848 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.447803 32507 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:33.471608 32639 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:33.500627 28722 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:33.502789 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.448587 32587 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.504081 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.468060 32517 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.510377 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.512720 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.497056 32611 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.493160 32709 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.495811 32437 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:33.518711 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:33.488780 32586 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.505319 32519 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.522426 28728 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
W20260709 13:12:33.522082 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 104217us
I20260709 13:12:33.515462 32583 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.526189 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:33.513676 32582 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.521786 32587 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.518689 32599 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:33.538352 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.521543 32405 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:12:33.532321 32586 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.526561 32713 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:33.544672 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2062) took 1817 ms. Trace:
I20260709 13:12:33.524684 32437 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.545373 28650 rpcz_store.cc:276] 0709 13:12:31.727293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.727443 (+   150us) service_pool.cc:224] Handling call
0709 13:12:31.727788 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.778820 (+ 51032us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:31.946365 (+167545us) log.cc:844] Serialized 14 byte log entry
0709 13:12:31.946603 (+   238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.946669 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:31.946729 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.544336 (+1597607us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54003d4fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.544406 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.544588 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118975,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"raft.queue_time_us":252,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":35691,"spinlock_wait_cycles":116827520,"thread_start_us":167157,"threads_started":1}
I20260709 13:12:33.537262 32250 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:33.540560 32499 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:33.551908 32713 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:33.537949 32639 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.558007 32250 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:33.582650 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2613) took 2249 ms. Trace:
I20260709 13:12:33.583161 28579 rpcz_store.cc:276] 0709 13:12:31.324009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.324224 (+   215us) service_pool.cc:224] Handling call
0709 13:12:31.324700 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.818025 (+493325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.573180 (+1755155us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54001aa254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.573392 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120589056}
I20260709 13:12:33.568527 32601 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:33.593590 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:33.592476 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:33.563069 32499 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.594628 29260 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:33.592104 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:33.597103 29251 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:33.597635 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:33.598222 29258 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.599009 32437 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:33.597661 32250 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.606269 32405 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.606877 32405 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:33.608435 32711 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:12:33.613227 32706 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:33.613703 32706 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:33.613777 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:33.613986 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:33.617300 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:33.619571 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:33.621465 32405 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.626014 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.628434 32405 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.629863 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.631444 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:33.632467 29260 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:33.633888 28696 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.637173 29258 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:33.632642 32098 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.638403 32499 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.638586 32136 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.638482 32706 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:33.639954 28653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 2055) took 2221 ms (client timeout 1836 ms). Trace:
I20260709 13:12:33.640164 32706 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:33.640416 28653 rpcz_store.cc:269] 0709 13:12:31.418591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.421257 (+  2666us) service_pool.cc:224] Handling call
0709 13:12:33.639697 (+2218440us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003a93d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:33.639851 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2582165376}
I20260709 13:12:33.642259 28696 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.630929 32517 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.646112 28696 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.649609 28696 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:33.648329 32098 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.654120 28726 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:12:33.654249 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1208) took 1669 ms. Trace:
I20260709 13:12:33.654659 29255 rpcz_store.cc:276] 0709 13:12:31.984597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.992764 (+  8167us) service_pool.cc:224] Handling call
0709 13:12:32.024787 (+ 32023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.436521 (+411734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.654012 (+1217491us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b540053d9d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.654193 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944763776}
I20260709 13:12:33.645455 32136 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:33.656800 28729 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:33.653867 32601 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.659318 28726 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:12:33.660377 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.661878 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.662099 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.662629 28729 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:33.663378 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.664064 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.642558 32405 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:12:33.662477 28726 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:33.633109 32713 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.657151 32098 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.666762 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:33.669543 32098 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.667557 32563 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:12:33.669874 32517 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:33.670413 32693 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:33.670467 32517 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.670619 32563 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:33.666359 32662 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:12:33.671689 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:33.671813 32662 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:33.672238 32662 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:33.671133 32517 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.671164 32563 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:33.674297 32563 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.675486 32563 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.676064 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 906) took 1357 ms. Trace:
I20260709 13:12:33.676520 28575 rpcz_store.cc:276] 0709 13:12:32.318364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.318482 (+   118us) service_pool.cc:224] Handling call
0709 13:12:32.318695 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.331424 (+ 12729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.331469 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.331542 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:32.331586 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.675790 (+1344204us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b540036d654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.675848 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.676002 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28675328}
I20260709 13:12:33.686550 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:33.690487 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.690660 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:33.690948 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.691619 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.692523 29223 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:33.692844 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:33.698251 29256 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:33.694247 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.701579 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:33.702534 29256 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:33.707701 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:33.707873 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:33.708935 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.708630 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:33.710026 28648 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:33.706677 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:33.712745 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:33.714746 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.715703 28656 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:33.718415 28729 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:33.774180 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:33.710304 32569 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:33.775126 29255 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:33.761493 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 70889.7us
I20260709 13:12:33.777226 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:33.782223 28653 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.784075 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.786644 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:33.808668 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.711747 32659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.750s	user 0.007s	sys 0.002s
I20260709 13:12:33.785138 28656 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:33.787519 28655 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:33.818543 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:33.770124 32721 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:12:33.823091 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1063) took 2832 ms. Trace:
I20260709 13:12:33.820987 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.821131 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.822707 28573 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:33.824981 28656 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:33.823737 28727 rpcz_store.cc:276] 0709 13:12:30.991068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.131863 (+140795us) service_pool.cc:224] Handling call
0709 13:12:31.132414 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.643710 (+511296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.822120 (+2178410us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54001275d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:33.823004 (+   884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174207872}
I20260709 13:12:33.768824 32434 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:33.724050 32654 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.710845 32437 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:33.716378 32567 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:33.716078 32279 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.705220 32122 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:12:33.817734 32569 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:33.820293 32659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.859s	user 0.008s	sys 0.002s
I20260709 13:12:33.788300 32693 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.779150 32586 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:33.820649 32433 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:33.715881 32507 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:12:33.840651 32374 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:33.839404 32431 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.818327 32430 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.816219 32250 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:33.852881 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:33.834666 32434 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:33.917045 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.981835 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.774255 32662 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.047765 32662 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.047916 32434 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.053277 32098 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:34.067219 28653 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
W20260709 13:12:34.012619 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 195944us
I20260709 13:12:33.987003 32430 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.069696 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:34.070742 32431 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:34.071223 32431 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.071671 32431 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.071825 32430 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:34.043534 32725 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.073789 32725 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.076560 32725 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:34.078030 32724 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:12:33.977988 32374 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:34.082933 32431 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.938486 32586 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:33.938215 32459 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 13:12:33.981479 32517 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:33.856603 32569 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.915231 32567 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:33.861361 32433 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:33.909220 32693 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.093094 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:34.099282 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 323543us
I20260709 13:12:33.856354 32437 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:33.856803 32659 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:34.108739 32587 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.005s
I20260709 13:12:34.149672 28722 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:34.142484 32098 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.043892 32250 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.109171 32594 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:34.171202 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 78238.4us
I20260709 13:12:34.145135 32725 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.177628 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:34.188593 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 250464us
I20260709 13:12:34.168648 32433 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:34.189872 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.195760 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.192525 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:34.197623 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 379141us
I20260709 13:12:34.178174 32430 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:34.194476 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 481228us
W20260709 13:12:34.193735 32706 consensus_meta.cc:287] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.000s
I20260709 13:12:34.199954 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.206346 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.188320 32098 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.211930 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.199517 32443 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:34.220413 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:34.213199 32434 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:34.194802 32594 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.216868 32122 raft_consensus.cc:2764] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:34.197253 32725 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.217262 32410 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:34.227638 32443 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.221989 32507 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.190853 32374 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.229025 32434 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.243455 32431 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.258596 32410 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:34.232529 32659 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.238747 32693 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:34.215826 32567 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.261626 32122 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:34.239285 32563 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:34.270944 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 72326.1us
I20260709 13:12:34.275385 28650 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:34.260504 32279 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:34.288882 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.223812 32437 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.276487 32434 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:34.298619 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 78311.6us
I20260709 13:12:34.288724 32374 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.279625 32410 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.302405 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.303848 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:34.304945 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:34.310895 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:12:34.307372 32709 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.003s
I20260709 13:12:34.297031 32431 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:12:34.316080 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:34.318989 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:34.319070 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:34.318634 28575 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:34.330168 28579 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 6: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:34.317109 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:34.319562 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.332563 28648 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:34.332913 28578 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:34.335137 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:34.310130 32410 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.332465 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:34.314005 32122 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:34.312525 32517 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:34.312971 32485 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.312662 32499 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.350696 28577 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:34.350666 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:34.323248 32279 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.352931 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:34.326037 32594 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.359746 28579 raft_consensus.cc:2410] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:12:34.326418 32443 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.323676 32459 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.362528 32459 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.328616 32736 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.331163 32586 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.365800 32566 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:34.336541 32250 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:34.369580 32734 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:12:34.371423 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:34.373569 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.355885 32507 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:34.368561 32433 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.349942 32122 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.315532 32737 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:12:34.386766 28577 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:34.386983 28621 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.388739 32250 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:34.389600 32745 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:12:34.414419 32562 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.415720 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:34.372483 32098 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.360594 32485 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.416615 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.431450 28727 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
W20260709 13:12:34.432898 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.391635 32122 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.360600 32499 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.407259 32459 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.333981 32709 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.377686 32566 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.405159 32507 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:34.410327 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:34.425027 28576 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:12:34.433380 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.434356 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 47459.1us
W20260709 13:12:34.438009 29257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1206) took 2478 ms (client timeout 2011 ms). Trace:
I20260709 13:12:34.445801 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:34.460446 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:34.462194 29251 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:34.464958 29255 raft_consensus.cc:2410] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:12:34.470414 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.465809 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:34.439438 32735 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:12:34.463406 29257 rpcz_store.cc:269] 0709 13:12:31.946535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.957468 (+ 10933us) service_pool.cc:224] Handling call
0709 13:12:34.424452 (+2466984us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54001559d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:34.424570 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380509952}
I20260709 13:12:34.469835 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:34.378715 32736 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.472728 28729 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:34.448532 32566 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:34.438834 32586 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.472476 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:34.431638 32707 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.432951 32587 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.476970 28655 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:34.487043 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.490806 28575 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 7: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:34.471164 32725 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.473892 32250 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:34.474021 32459 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.532454 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2467) took 1536 ms. Trace:
I20260709 13:12:34.479372 32752 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:34.492327 32713 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:34.521853 32443 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.554581 28723 rpcz_store.cc:276] 0709 13:12:32.996304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.997553 (+  1249us) service_pool.cc:224] Handling call
0709 13:12:32.997930 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.998155 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:33.010821 (+ 12666us) log.cc:844] Serialized 14 byte log entry
0709 13:12:34.231877 (+1221056us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b1800413140. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a 00007f4a27e20a2a
0709 13:12:34.531879 (+300002us) log.cc:844] Serialized 14 byte log entry
0709 13:12:34.532075 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:34.532125 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:34.532176 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.532247 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.532396 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9099,"prepare.queue_time_us":86442,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":1303,"raft.queue_time_us":2922,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":15665,"spinlock_wait_cycles":3526400,"thread_start_us":289781,"threads_started":2,"wal-append.queue_time_us":1345101}
I20260709 13:12:34.558883 28723 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:34.559765 28723 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:34.560608 28723 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:34.536419 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.547520 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.441144 32562 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.490609 32639 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.493731 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.568295 32562 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:34.534468 32567 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.592518 32567 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.593879 32709 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:34.549075 32507 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.595381 32567 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:34.574147 32736 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:34.574604 32519 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.603453 32519 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.607019 32519 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.525579 32586 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:12:34.578629 32713 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:34.579929 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:34.532413 32595 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:34.620807 32713 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.596459 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 121024us
I20260709 13:12:34.622135 32499 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:34.493887 32587 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.576642 32747 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:12:34.575517 32434 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.641897 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.643846 28652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 861) took 2327 ms (client timeout 1759 ms). Trace:
I20260709 13:12:34.493652 32707 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.578215 32425 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:34.600426 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:34.621021 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:34.566237 32752 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.597867 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 104280us
I20260709 13:12:34.651897 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.633535 32654 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:34.563975 32459 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.625716 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2629) took 1960 ms. Trace:
I20260709 13:12:34.628911 32410 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.630038 28721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2462) took 1662 ms (client timeout 1510 ms). Trace:
W20260709 13:12:34.659390 28721 rpcz_store.cc:269] 0709 13:12:32.967364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.967527 (+   163us) service_pool.cc:224] Handling call
0709 13:12:34.629796 (+1662269us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400280fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:34.629942 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3239422336}
I20260709 13:12:34.580058 32443 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.599402 32639 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.631916 28647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2463) took 1473 ms (client timeout 1546 ms). Trace:
W20260709 13:12:34.673784 28647 rpcz_store.cc:269] 0709 13:12:33.163486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.163620 (+   134us) service_pool.cc:224] Handling call
0709 13:12:34.631691 (+1468071us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540023e454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:34.631831 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664731904}
I20260709 13:12:34.632817 32586 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:34.633520 32569 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.636359 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.600533 32709 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:34.644096 28654 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:12:34.644369 28652 rpcz_store.cc:269] 0709 13:12:32.316839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.513535 (+196696us) service_pool.cc:224] Handling call
0709 13:12:34.643573 (+2130038us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540025a654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:34.643757 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723844096}
I20260709 13:12:34.691455 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:34.649168 28651 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:34.623754 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:34.693145 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:34.693918 28651 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:34.638375 32517 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.656494 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.699983 28655 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:34.701314 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:34.657205 32654 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:34.657589 28573 rpcz_store.cc:276] 0709 13:12:32.665789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.666174 (+   385us) service_pool.cc:224] Handling call
0709 13:12:32.666643 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.832017 (+1165374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.625466 (+793449us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400165654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:34.625655 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2658204544}
I20260709 13:12:34.664525 32374 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:34.662851 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:34.661187 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.670245 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.670919 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.671190 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.675602 32710 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:34.683127 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.698446 28651 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:34.659003 32599 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.678093 32607 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.686360 32586 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:34.662122 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:34.704305 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 47910.7us
I20260709 13:12:34.723147 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:34.724952 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 63882.1us
I20260709 13:12:34.726354 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.730803 28578 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:34.732563 28579 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:34.713423 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:34.735190 28721 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:34.735477 28578 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:12:34.736470 28579 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:34.672695 32687 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.697662 32662 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:34.741879 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:34.753384 28721 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:34.755088 28721 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:34.758275 28721 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:34.760957 28721 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:34.715709 32499 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:34.817974 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.821854 28575 raft_consensus.cc:2368] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:34.823761 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.706459 32430 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:12:34.701579 32712 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:12:34.701738 32564 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:12:34.739617 32452 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:12:34.742291 32567 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.833997 32433 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.838008 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 878) took 1058 ms. Trace:
I20260709 13:12:34.838382 32744 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:34.838999 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 876) took 1126 ms. Trace:
I20260709 13:12:34.839797 32744 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:34.840466 32744 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:34.725087 32607 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.844515 32712 consensus_queue.cc:1243] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:34.720285 32599 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.846561 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2484) took 1370 ms. Trace:
I20260709 13:12:34.847090 28730 rpcz_store.cc:276] 0709 13:12:33.476133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.476354 (+   221us) service_pool.cc:224] Handling call
0709 13:12:33.481147 (+  4793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.491365 (+ 10218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.846272 (+1354907us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b54001ba154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:34.846493 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19464448}
I20260709 13:12:34.848462 32599 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.739636 32250 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:34.838400 28654 rpcz_store.cc:276] 0709 13:12:33.779709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.779878 (+   169us) service_pool.cc:224] Handling call
0709 13:12:34.643745 (+863867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.690677 (+ 46932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.837798 (+147121us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b540025a650. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:34.837950 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1985852288}
I20260709 13:12:34.839509 28648 rpcz_store.cc:276] 0709 13:12:33.712246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.712469 (+   223us) service_pool.cc:224] Handling call
0709 13:12:34.838818 (+1126349us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540023e954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:34.838941 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073642368}
I20260709 13:12:34.854743 32712 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:34.855188 32712 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:34.817778 32662 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.856137 32712 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.858790 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.858053 32662 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.860061 32443 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.860440 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 883) took 1037 ms. Trace:
I20260709 13:12:34.860329 32566 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.860836 32586 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.862198 32586 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:34.861028 28656 rpcz_store.cc:276] 0709 13:12:33.823395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.825937 (+  2542us) service_pool.cc:224] Handling call
0709 13:12:33.826248 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.169507 (+343259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:34.226645 (+ 57138us) log.cc:844] Serialized 14 byte log entry
0709 13:12:34.246156 (+ 19511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:34.246219 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:34.246270 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.860146 (+613876us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540006e0d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:34.860195 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.860307 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":127588,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":484,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":788765568,"thread_start_us":64382,"threads_started":2,"wal-append.queue_time_us":58347}
I20260709 13:12:34.862829 32566 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.827328 28723 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:34.861228 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:34.864468 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:34.831516 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:34.874025 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 173527us
I20260709 13:12:34.874297 28579 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:34.875484 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.716800 32517 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.875757 28696 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:34.882341 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:34.877815 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 207371us
I20260709 13:12:34.747352 32374 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 13:12:34.886081 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:34.917690 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:34.919560 32740 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.919762 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:34.920696 28723 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:34.874361 32583 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.919550 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.723713 32710 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:34.920816 32562 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:34.879372 32599 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:34.927795 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:34.765779 32687 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.932188 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:34.933280 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:34.933127 28656 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.912149 32519 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:34.937780 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:34.938825 28648 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:34.837229 32762 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:12:34.940742 28652 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:34.953022 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:34.926841 32736 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:34.863732 32654 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.942966 32583 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.941421 32519 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:34.937968 32443 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:34.974509 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:34.978488 28648 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:34.968366 32713 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:34.943225 32599 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:34.946220 32434 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:34.985522 28575 raft_consensus.cc:2368] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:34.971180 32685 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:34.967128 32587 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.939383 32430 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:12:34.978945 28656 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:34.972476 32707 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.981251 32519 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.993330 32685 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:34.991521 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 106447us
I20260709 13:12:34.982813 32443 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.009419 28546 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.984519 32459 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:34.992197 32654 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.017078 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.991556 32639 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.011422 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:34.981559 32583 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:34.929275 32744 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:34.981388 32425 consensus_queue.cc:1175] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "178f22d83287460fb8c0db0ba2799895" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
I20260709 13:12:34.991596 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2490) took 1468 ms. Trace:
I20260709 13:12:35.007968 32752 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:35.025295 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.012246 32443 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:35.027139 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.996555 32599 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.028234 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.028834 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:35.029997 28546 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:35.030913 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:34.995059 32713 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:35.036597 32764 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:12:35.040470 32517 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.030102 32639 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:35.033655 32685 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.026065 32710 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:35.045130 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.077531 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:35.069592 32564 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:35.079737 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.081132 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:35.081679 32122 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.002s
I20260709 13:12:35.082569 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.083798 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.060431 32583 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.085851 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.086753 28730 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:35.087281 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:35.087884 28730 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:35.077595 28726 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:12:35.089841 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:35.031654 28728 rpcz_store.cc:276] 0709 13:12:33.521180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.525859 (+  4679us) service_pool.cc:224] Handling call
0709 13:12:33.526175 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.526382 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:33.535229 (+  8847us) log.cc:844] Serialized 14 byte log entry
0709 13:12:34.569575 (+1034346us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b48001c0158. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2cd3faa1 00007f4a2cd36b37 00007f4a2cd369ca 00007f4a2ce2e26f 00007f4a2ce2df37 00007f4a2ce4255c 00007f4a2ce42508 00007f4a2ce42488 00007f4a2ce42443 00007f4a2ce416ec 00007f4a2bd6ba96
0709 13:12:34.862857 (+293282us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b180042f940. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287
0709 13:12:34.863250 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:12:34.988849 (+125599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:34.988920 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:34.988988 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:34.989610 (+   622us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:34.989796 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10105,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":4337,"raft.run_cpu_time_us":2261,"raft.run_wall_time_us":1032450,"spinlock_wait_cycles":10260096,"thread_start_us":136526,"threads_started":2}
I20260709 13:12:35.064507 28653 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:35.028756 32662 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:35.091917 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.066982 28650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 874) took 1359 ms (client timeout 1598 ms). Trace:
I20260709 13:12:35.082113 32122 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:35.103853 28650 rpcz_store.cc:269] 0709 13:12:33.707308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.707445 (+   137us) service_pool.cc:224] Handling call
0709 13:12:35.066776 (+1359331us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400259c54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:35.066915 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163642112}
I20260709 13:12:35.085384 32519 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.124145 28723 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:35.125921 28721 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:35.128211 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53312.6us
W20260709 13:12:35.044991 32279 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.683s	user 0.013s	sys 0.004s
I20260709 13:12:35.068774 32740 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:35.064270 32729 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:35.061666 32713 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.069516 32434 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.054291 32685 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:35.063566 32736 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:35.060527 32569 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.089221 32430 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:35.062599 32712 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.055780 32687 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:35.139359 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49582.3us
I20260709 13:12:35.184015 29252 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:35.172837 28479 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.139079 32279 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:35.191280 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:35.117173 32530 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:35.152343 29260 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:12:35.093675 32710 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:35.174467 28476 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43518 (request call id 375) took 20099 ms (client timeout 15000 ms). Trace:
I20260709 13:12:35.064857 32762 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:35.174746 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:35.185482 28581 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:12:35.062781 32507 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:35.186298 28479 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 6, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 6 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:35.150098 32682 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:35.187831 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.189911 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:35.190809 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.103061 32452 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:35.192078 29259 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.192170 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:35.211452 29252 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.150696 32729 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:35.203289 28581 pending_rounds.cc:85] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 6
I20260709 13:12:35.215945 28581 pending_rounds.cc:107] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:12:35.216302 28581 raft_consensus.cc:2889] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.206076 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.206657 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:35.221737 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:35.204566 32710 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:35.225833 32729 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.209227 32762 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.229115 32762 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:35.230603 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.231539 32519 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.233320 32562 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:12:35.234609 32562 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:35.235005 32562 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:35.235864 32562 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.205348 29257 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:35.237058 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.237977 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.238190 28579 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:35.239115 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.183990 32434 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.240187 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.241750 28573 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:35.242074 32434 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.193998 32530 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:35.243515 29253 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 7: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:35.211098 32507 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.196336 32752 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:12:35.245893 32639 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:35.184306 32736 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.246683 32639 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:35.247493   308 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:35.247748 32639 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:35.248103   308 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:35.248391 32736 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:35.248726 32687 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:35.249182 32687 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:35.247143 32507 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.250224 32687 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:35.250738   308 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.251647 32687 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.255529 32562 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.236444 29259 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:35.264263 28650 pending_rounds.cc:85] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 4
I20260709 13:12:35.264629 28650 pending_rounds.cc:107] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:12:35.264909 28650 raft_consensus.cc:2889] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.265094 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.266187 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.268000 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.273437 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.275151 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.277683 29252 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:35.278621 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:35.278846 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:35.279497 28656 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:35.291276 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 84042.7us
I20260709 13:12:35.291814 32519 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.293411 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.294577 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.295275 29252 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:35.214061 32569 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:12:35.298019 29259 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:35.293431 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:35.298550 28648 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:35.299202 28649 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:12:35.296780 32751 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.927s	user 0.012s	sys 0.000s
I20260709 13:12:35.303758 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.240123 32122 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.308045 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:35.311470 28723 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:35.311324 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:35.310370 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.292649 32519 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.312561 28730 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:35.304569 32583 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:12:35.333102 32705 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:35.333842 32705 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:35.329283 32443 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:35.345634 32485 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.347674 32443 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.335150 32705 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.326615 32279 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:35.348976 32705 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.354153 32410 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.356140 32595 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:35.357928 32607 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.358518 32519 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.356711 32595 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:35.207809 28479 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 6 to 7, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 7 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:35.196442 28476 rpcz_store.cc:269] 0709 13:12:15.054277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.054622 (+   345us) service_pool.cc:224] Handling call
0709 13:12:35.153172 (+20098550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:27.946037 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:28.099462 (+153425us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:28.112180 (+ 12718us) write_op.cc:435] Acquired schema lock
0709 13:12:28.112213 (+    33us) tablet.cc:662] Decoding operations
0709 13:12:28.295876 (+183663us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:28.295971 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:28.295997 (+    26us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:12:28.297483 (+  1486us) tablet.cc:701] Row locks acquired
0709 13:12:28.297537 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:12:28.297734 (+   197us) write_op.cc:270] Start()
0709 13:12:28.297905 (+   171us) write_op.cc:276] Timestamp: P: 1783602748297664 usec, L: 0
0709 13:12:28.297948 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:12:28.298778 (+   830us) log.cc:844] Serialized 6630 byte log entry
0709 13:12:28.795973 (+497195us) op_driver.cc:464] REPLICATION: finished
0709 13:12:28.977551 (+181578us) write_op.cc:301] APPLY: starting
0709 13:12:28.977646 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:28.980395 (+  2749us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:28.995011 (+ 14616us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:29.199210 (+204199us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:29.199634 (+   424us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=34
0709 13:12:29.199724 (+    90us) write_op.cc:312] APPLY: finished
0709 13:12:29.200258 (+   534us) log.cc:844] Serialized 119 byte log entry
0709 13:12:29.200469 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:29.200679 (+   210us) write_op.cc:454] Released schema lock
0709 13:12:29.200763 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:29.362126 (+161363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:29.373417 (+ 11291us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144938,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":181283,"apply.run_cpu_time_us":7699,"apply.run_wall_time_us":250909,"num_ops":17,"prepare.queue_time_us":173780,"prepare.run_cpu_time_us":16308,"prepare.run_wall_time_us":556008,"raft.queue_time_us":215782,"raft.run_cpu_time_us":67581,"raft.run_wall_time_us":171077,"replication_time_us":480903,"thread_start_us":473657,"threads_started":4,"wal-append.queue_time_us":147563,"wal-append.run_cpu_time_us":11467,"wal-append.run_wall_time_us":1779934}]]}
W20260709 13:12:35.401808 28467 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.400s	user 0.011s	sys 0.014s
I20260709 13:12:35.401616 28479 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.405803 28479 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.415128 28575 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:35.415031 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.301224 28656 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:35.421598 28721 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:35.423983 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.429510 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:35.428640 28656 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:35.433599 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.425578 28730 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:35.439198 29251 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:35.439723 28573 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:35.441352 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.441687 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:35.443104 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.443315 29257 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:35.444098 28573 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:35.448940 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.450222 29252 raft_consensus.cc:2368] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:35.450698 32443 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:35.452157 29252 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:12:35.453171 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:35.454634 32569 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:35.455176 32569 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:35.455665 32445 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:35.456423 32445 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:35.457123 32445 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:35.457320 32569 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.460124 32569 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.463987 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:35.469295 32595 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.472110 32595 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:35.473575 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.473910 32445 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.474807 32443 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:35.475813 32443 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:35.477885 32445 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.478060 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:35.479787 32642 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:35.480505 32642 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.481069 32642 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.481602 32519 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:35.482856 32519 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.478937 32443 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.484844 28723 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:35.486569 28726 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:35.489177 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:35.490429 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:35.494163 32519 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.500075 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.504101 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.508544 28725 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:35.510936 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.512188 29253 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:35.515094 32459 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:35.515565 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.516151 32431 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:35.517238 32374 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:35.517508 32459 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:35.513664 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.518826 32586 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:35.519466 32586 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:35.523488 32586 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:35.524925 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.527961 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 50272.1us
I20260709 13:12:35.516752 32431 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:35.534767 28730 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:35.535486 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.526295 28479 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:35.550231 32431 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:35.551268   323 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:12:35.552242 32431 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.553424 32586 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.556676 32519 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.562649 28723 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:35.566876 32705 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.559195 32519 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.586609 32485 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:12:35.591635 32485 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:35.592197 32485 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:35.570745 32705 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:35.606431 32758 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:35.607395 32459 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:35.624997 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.624796 32485 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.608414 32459 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:35.631146 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.622433 32519 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.634248 32693 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.634578 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:35.635630 28653 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:35.635156 32693 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:35.634598 32563 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:35.637329 32563 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:35.637588 28725 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:35.637979 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.638518 32563 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:35.639895 32563 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:35.632380 28723 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:12:35.642490 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.645141 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.651491 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1472) took 1228 ms. Trace:
I20260709 13:12:35.645905 32744 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.699231 29260 rpcz_store.cc:276] 0709 13:12:34.422506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.422651 (+   145us) service_pool.cc:224] Handling call
0709 13:12:34.423048 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.196007 (+772959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.651030 (+455023us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540003edd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:35.651301 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676534528}
I20260709 13:12:35.701191 32592 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.702273 32592 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.645916 32693 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:35.664623 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.705564 32485 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:35.669072 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.648115 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:35.707533 32709 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:35.708101 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 140591us
W20260709 13:12:35.708938 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 60986.5us
I20260709 13:12:35.711423 32459 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.698071 32729 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.698645 32374 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.626636 28479 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 7, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 7 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.711926 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:35.715122 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1470) took 1294 ms. Trace:
I20260709 13:12:35.712641 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:35.713342 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 80186.3us
I20260709 13:12:35.718482 32374 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.720777 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:35.721959 32374 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.729031 28728 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:35.736888 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:35.739241 28621 leader_election.cc:400] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:35.739744 28621 leader_election.cc:403] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:35.717927 32642 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.761785 28649 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:35.764554 28578 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:12:35.765231 28578 pending_rounds.cc:85] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 7
W20260709 13:12:35.767990 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 187329us
I20260709 13:12:35.768774 28578 pending_rounds.cc:107] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:35.770920 28578 raft_consensus.cc:2889] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.772019 28581 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:35.717454 29256 rpcz_store.cc:276] 0709 13:12:34.420120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.420760 (+   640us) service_pool.cc:224] Handling call
0709 13:12:34.421144 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.421327 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:34.441341 (+ 20014us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.308191 (+866850us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b1800472a80. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a 00007f4a27e20a2a
0709 13:12:35.627488 (+319297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:35.641434 (+ 13946us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:35.712425 (+ 70991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.714679 (+  2254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.714935 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16920,"prepare.queue_time_us":19720,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":5244,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6727,"spinlock_wait_cycles":9707264,"thread_start_us":287785,"threads_started":1,"wal-append.queue_time_us":1191488}
I20260709 13:12:35.773860 28576 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:35.758955 32374 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:35.781117 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 69296.9us
I20260709 13:12:35.782097 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:35.775827 32459 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:35.787693 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.789206 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:35.790453 28649 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:35.783160 28479 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 8, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 8 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.798501 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1100) took 1544 ms. Trace:
I20260709 13:12:35.777164 32693 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:35.799468 32693 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.802525 32693 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.798959 28727 rpcz_store.cc:276] 0709 13:12:34.253944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.432292 (+178348us) service_pool.cc:224] Handling call
0709 13:12:34.432535 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:35.624484 (+1191949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.624545 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:35.624595 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:35.624658 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.798071 (+173413us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000a73d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:35.798114 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.798315 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2694301056}
I20260709 13:12:35.804255 32582 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.805058 32582 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.805578 32640 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:35.806413   318 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:35.804122 32519 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.807739 29223 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:35.808131 32599 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:35.808638 32599 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:35.808436 32519 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.799875 28479 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:35.807788 32582 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.809320   318 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:35.823885 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.822698 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.822535 32599 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.824950   302 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:35.825103 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.825318 29259 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:35.807682 32756 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:12:35.826203 32599 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.826524 32756 consensus_queue.cc:1243] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:35.827288 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.825781 32683 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:35.828428   327 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.001s
I20260709 13:12:35.826439 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:35.821476 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:35.830382 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 129375us
I20260709 13:12:35.823225 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:35.812752 32705 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.835681 28729 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:35.820852   318 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:35.838541 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.820452 32592 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.841343 29260 raft_consensus.cc:2368] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:35.842378 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.844000 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.845366 28727 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:35.829957 32758 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:12:35.851033 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:35.841138   318 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:35.848829 28576 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:35.850127 28573 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:35.848397 32519 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.843134 28479 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 7, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 7 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.859404 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.865506 32642 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.866474 29259 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:35.852321 32710 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.872387 29252 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:12:35.872392 28622 leader_election.cc:400] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:35.872885 29252 pending_rounds.cc:85] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 6
I20260709 13:12:35.878693 29252 pending_rounds.cc:107] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:12:35.879119 29252 raft_consensus.cc:2889] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.882103 28696 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:35.883358 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:35.883545 32595 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:35.884089 32595 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.884608 32582 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:35.884758 32595 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.885157 32582 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:35.885722 32582 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:35.885380 32530 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.887414 32530 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:35.884609 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.890837 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:35.891629 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1842) took 2233 ms. Trace:
I20260709 13:12:35.894153 32459 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:35.894721 32459 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:35.895205 32459 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.895444 32595 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:35.900084 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.900475 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.901585 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.903187 32374 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.903855 32374 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:35.904608 32642 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:12:35.908124 32595 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.908690 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:35.909791 29259 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.910336 28728 pending_rounds.cc:85] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 7
I20260709 13:12:35.910673 28728 pending_rounds.cc:107] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:35.910983 28728 raft_consensus.cc:2889] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.913246 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:35.913983 28576 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.921221 29259 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
W20260709 13:12:35.922991 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.924281 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.924903 28696 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:35.922644 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44782.2us
I20260709 13:12:35.935403 28576 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:35.875375 32563 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:35.934909 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.938520 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:35.942378 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 91404.3us
I20260709 13:12:35.921101 32374 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.944358 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:35.867717 32592 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:12:35.967157 32592 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:35.967640 32592 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:35.951217   331 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.221s	user 0.003s	sys 0.001s
I20260709 13:12:35.968812 32592 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.950994 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:35.970973 28730 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.971227 28575 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:35.954803 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:35.972745 29255 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:35.941448 32758 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:35.973635 32758 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.976099 32758 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:35.958032   329 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:12:35.958261 32582 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.977275 28696 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:35.959065   332 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:12:35.892110 28724 rpcz_store.cc:276] 0709 13:12:33.658200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:33.717468 (+ 59268us) service_pool.cc:224] Handling call
0709 13:12:34.854416 (+1136948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:34.854793 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:34.854825 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:34.855333 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:12:35.007587 (+152254us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:35.007650 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.007747 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:35.079063 (+ 71316us) raft_consensus.cc:1685] finished
0709 13:12:35.079086 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.863665 (+784579us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001ba150. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:35.891384 (+ 27719us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2497,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"spinlock_wait_cycles":2473498368,"thread_start_us":151805,"threads_started":1,"wal-append.queue_time_us":194479}
I20260709 13:12:35.979074 32582 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:35.979821 32586 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:35.981215 32410 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:35.981844 32410 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:35.984309 32410 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:35.986908 28621 leader_election.cc:400] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:35.987560 28621 leader_election.cc:403] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:35.963732 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:35.941387 28479 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:35.964474 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 102611us
W20260709 13:12:35.966007   333 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:12:35.935855 32595 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:36.000435 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:36.001048 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 63130.5us
W20260709 13:12:36.001430 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 67523.9us
W20260709 13:12:35.988493 32569 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.008s
I20260709 13:12:35.987016 32642 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:36.005399 32582 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:36.007081 32582 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.006881 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:36.007563 32582 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:36.007601 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 64624.3us
I20260709 13:12:36.008383 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:36.008481 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:36.006937 32642 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:36.008391 32430 raft_consensus.cc:2764] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:12:36.009967 32430 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:36.009883 32642 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.006903 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:36.009963 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:36.020699 28730 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:36.028328 28727 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:36.032227 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:36.015882 28479 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:36.035142 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.019424 32705 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:36.043980 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:35.988271 28467 maintenance_manager.cc:643] P 12655fdad3714eb6a91469c435fc7ad5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.540s	user 0.185s	sys 0.099s Metrics: {"bytes_written":29929,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":42202,"dirs.run_cpu_time_us":501,"dirs.run_wall_time_us":4823,"drs_written":1,"lbm_read_time_us":51355,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":3,"lbm_write_time_us":126829,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":12007680,"thread_start_us":124372,"threads_started":2,"update_count":17,"wal-append.queue_time_us":171861}
I20260709 13:12:36.053305 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:36.050963 32374 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:36.020833 32519 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:36.038611 32430 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:36.055338 29253 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:36.058393 32563 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:36.061455 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.059070 28479 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 5, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 5 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.058974 28468 maintenance_manager.cc:419] P 12655fdad3714eb6a91469c435fc7ad5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10209 bytes on disk
I20260709 13:12:36.043059 32569 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:12:36.069383 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:36.095988 32709 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:36.071707 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:36.063884 32563 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.073439 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.076081 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.080068 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.081583 32430 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:36.069239 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:36.076951 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:36.090492 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.103646 29257 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:36.144394 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.114877 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:36.112574 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:36.144421 28730 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:36.067305 32519 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:36.124526 29251 raft_consensus.cc:2410] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:36.079375 32485 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:12:36.069854 32705 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:12:36.140326 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 88866.6us
I20260709 13:12:36.104614 32592 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.144965 29253 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:36.142064 28479 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:36.103636 32459 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.143702 32563 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:36.146912 32430 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.190537 28479 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.191124 28467 maintenance_manager.cc:643] P 12655fdad3714eb6a91469c435fc7ad5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.039s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13901,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3}
I20260709 13:12:36.195515 32667 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:36.198091 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.176954 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.177412 32443 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:36.177992   339 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:12:36.197952 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 125853us
I20260709 13:12:36.176309 29252 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:36.199601 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:36.192382 28479 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 8 to 9, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 9 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:36.204599 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 64524.7us
I20260709 13:12:36.200698 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:36.170696 32530 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:36.172662 32595 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:36.216624 28696 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:36.218024 28656 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:36.210615 32709 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:36.222545 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:36.207048 32758 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:36.225246 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:36.224833   343 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.229909 32374 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:36.230403 32374 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:36.230612 32437 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.230767 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:36.231178 32437 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.231387 32374 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.226001 32639 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:36.233419 32639 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:36.233829 32639 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:36.235507 32640 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:36.235916 32640 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.236277 32640 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.238652 32519 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:36.239725 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:36.215548 32443 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:36.228951 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:36.241904 28573 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:36.242003 32443 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:36.245252 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 44685.8us
I20260709 13:12:36.247506 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:36.250262 32459 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:36.221413 32709 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:36.251659 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:36.252053 32709 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.252457 28576 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:36.209615   318 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.254913   318 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:36.256224 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 224589us
I20260709 13:12:36.268247 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:36.274820   343 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:36.275125 28479 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 10, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 10 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.279898 28622 leader_election.cc:400] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:36.279309 28479 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 3 to 7, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 7 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.281329 28479 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 6, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 6 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:36.283205 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:36.282898 28479 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 3 to 5, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 5 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:36.232904 32374 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:36.271752 32729 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
I20260709 13:12:36.295874 32667 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:36.278268 32410 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:36.296963 32667 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.297132 32410 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.297453 32667 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:36.297662 32410 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.301884 32642 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:36.302691 32642 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.306092   307 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:36.307272 32595 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.236210 32437 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:36.312403 32563 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:36.289867 32741 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:36.269371   302 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:12:36.292549 32485 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.290962   343 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:36.292805 32582 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.327399 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:36.326270 32741 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:36.330112 29254 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:36.330825 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:36.331112 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:36.331987   344 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:12:36.337713 28656 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:36.313526 32410 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:36.364679 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 148136us
I20260709 13:12:36.368783 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.294320 32705 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:12:36.329267 32459 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:36.375711 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:36.381237 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:36.382412 28729 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:36.370139 32741 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:36.394721 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 76951.7us
W20260709 13:12:36.395527 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 326335us
I20260709 13:12:36.361162 32485 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:36.341375 32430 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.407336 28728 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:36.405853 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.381305 32530 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.409952 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:36.411854 32410 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:36.412089   348 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:36.412932 32710 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:36.403329 32592 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:36.391788 32642 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:36.422053 28579 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:36.428488 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:36.413833   347 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:12:36.445048 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:36.450147 28573 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.452029 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:36.405084 32599 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:36.456912 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:36.457058 28727 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:36.457955 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 235468us
W20260709 13:12:36.455493 29254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1477) took 1257 ms (client timeout 1588 ms). Trace:
I20260709 13:12:36.460708 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.472178 28656 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:36.462504 29254 rpcz_store.cc:269] 0709 13:12:35.197547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.230336 (+ 32789us) service_pool.cc:224] Handling call
0709 13:12:36.449579 (+1219243us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54006bf154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:36.455407 (+  5828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498759424}
W20260709 13:12:36.474280 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.482317 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:36.438422 32437 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.483112 28576 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:36.400058 32639 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.425192 32569 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:36.486791 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:36.489225 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:36.493728 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:36.460075 32430 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:36.431535   302 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:12:36.465713   348 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:36.513535 28696 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:36.509127 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:36.516182 32122 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:36.517321 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:36.520098 28695 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:36.512629 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:36.526355 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 74481.4us
I20260709 13:12:36.456607 32530 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.527052 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:36.528172 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:36.534660   340 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:36.535562 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:36.498955 32437 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.530153 32705 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.513276 32599 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:36.587352 28573 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:36.565692   307 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.566332 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:36.569177   345 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:12:36.598654 29251 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:36.571439 28650 raft_consensus.cc:2376] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11. Re-sending same reply.
I20260709 13:12:36.563621 28581 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:12:36.524744 32569 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.504473 32519 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:12:36.592989   356 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:36.593659   348 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.594616 32431 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:36.603045 28656 raft_consensus.cc:2376] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9. Re-sending same reply.
I20260709 13:12:36.583475 32563 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:36.579224 32582 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:36.600718 32592 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:36.623759 28650 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:12:36.627734 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 121208us
I20260709 13:12:36.627345   369 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:36.637359 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:36.638314 28577 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:36.639406 32530 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:36.627010 32431 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.640491 32639 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:36.641544 32592 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:36.642112 32431 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:36.642421 32437 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:36.649817 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:36.653327 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:36.653891 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:36.655467 28729 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
W20260709 13:12:36.657743 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 133201us
I20260709 13:12:36.557540 28727 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:36.657961 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:36.662424 29253 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:36.605203 32705 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.694736 32485 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:36.697198 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:36.697918 28653 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.603976   307 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:36.701123   363 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:12:36.728793 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.729338 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 206039us
I20260709 13:12:36.700289 28654 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:36.659024 32582 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:36.805868 28656 raft_consensus.cc:2376] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9. Re-sending same reply.
I20260709 13:12:36.810096 28580 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:36.810880 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:36.812040 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:36.814199 32582 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:36.817499   357 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.335s	user 0.003s	sys 0.000s
W20260709 13:12:36.817760   359 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.182s	user 0.004s	sys 0.004s
I20260709 13:12:36.820021 32564 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:36.821208 32595 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.821882 32741 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.831243 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:36.832094   353 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:36.840843   302 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.841655 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:36.842291 32710 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:36.845106 32693 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.849301 28723 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:36.849915 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.850611 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:36.885826 28729 raft_consensus.cc:2410] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:12:36.851833 32640 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:12:36.893432 29223 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:36.853615 32705 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:36.836743 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 301343us
W20260709 13:12:36.862577 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55602.7us
I20260709 13:12:36.862725 28573 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:36.860373 32667 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.002s
W20260709 13:12:36.856981 32709 consensus_meta.cc:287] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.604s	user 0.000s	sys 0.009s
W20260709 13:12:36.865300 29224 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.589s (SENT) [suppressed 15 similar messages]
I20260709 13:12:36.882413 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:36.883674 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52546.2us
I20260709 13:12:36.867112 32410 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.860975   343 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:36.817549 32582 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.862092   307 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:36.869606 32564 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:36.904147 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:36.902027 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:36.927616 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:36.928691 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63422us
I20260709 13:12:36.926162 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:36.895203 32459 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:36.991745 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:36.992451 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 150872us
I20260709 13:12:36.992738 28573 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:36.993456 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:36.994059 28650 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:36.994995 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67501.2us
I20260709 13:12:36.995823 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:36.996796 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:36.997493 29253 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:37.022337 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:37.022573 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 70968.7us
I20260709 13:12:36.990329 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:36.898516 32595 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:36.952159 32459 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.895501 32693 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:37.026206 32729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.046s	sys 0.066s
I20260709 13:12:36.886657   302 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:36.906075 32667 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.014112 32744 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:37.039994 28654 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.896654 32640 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.018518 32425 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:36.926440 32705 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:12:37.045070 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:36.934401 32410 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:36.907030 32709 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.029086 32599 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:37.019079   307 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:37.052929 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 148882us
I20260709 13:12:37.014814 32530 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:37.029650 32519 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:37.014559   340 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:37.058030 28651 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:37.048785 32729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.046s	sys 0.066s
I20260709 13:12:37.059536 32667 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.061878 32693 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.045539 32459 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:37.030457 32485 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:12:37.067485 28573 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:37.037936 32374 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:37.077840 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:37.055989   365 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.051245 32569 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.100055 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.063046   370 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:37.046641   343 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.064195 32744 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:37.120891 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 58551.7us
I20260709 13:12:37.062809 32710 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:12:37.121326 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.088487   340 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.138285 29251 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:37.104398 32530 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:37.119570   370 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:37.165916 29253 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
W20260709 13:12:37.157653 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 112686us
I20260709 13:12:37.135208 32599 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.153759 32741 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.090258 32519 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.106244   307 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.152716   352 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:37.141377   371 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.143642   340 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.157598   376 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:37.152557 32374 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.083616 32564 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:37.195870 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 73552.4us
I20260709 13:12:37.165596   372 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.118086 32425 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.180709   346 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.173166   370 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.135768   365 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.204350 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:37.206750 28648 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:37.206753 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:37.209497 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 131775us
I20260709 13:12:37.209522 28655 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:37.193267   352 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:37.195457   388 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:37.202298 32431 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:37.215072   378 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:12:37.249089 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:37.284142 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.250805 32431 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.251788 32640 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:37.254175   375 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:12:37.255170   382 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:12:37.256464   383 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:37.257170   395 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.266426 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:37.267351   381 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:12:37.267755 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.237773   388 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.207237   372 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.276453   343 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:37.267398 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.250427 32410 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:37.285256 29258 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:12:37.315658 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 105560us
I20260709 13:12:37.214002   371 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:37.213949   352 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:37.290333   380 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:12:37.290935 28654 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:37.234866   394 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:12:37.259223   384 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:37.268015 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:37.302416 29252 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:37.302479 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.303058 28653 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:37.305742 32374 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.239704   346 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:12:37.243414 32530 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.310107   365 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.311183 28650 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:37.283987 32569 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.281796 32595 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:37.319366 28655 raft_consensus.cc:2410] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:37.321892 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:37.333335 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.324885 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.325330 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.210474 32744 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.315470   396 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:37.329094 28652 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:37.305783 32519 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:37.330976 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 126810us
I20260709 13:12:37.332311 28649 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:12:37.339218 28577 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:37.339421   396 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.320070   394 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:37.342070 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.342238   396 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.341969   394 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.343385   397 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.344019   397 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.344619 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.344798 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:37.345417 28656 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:37.345808 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:37.346812   372 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.336606 32569 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.313786   388 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.335125 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.319008   371 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.354439 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:37.368837 29254 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.369176 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.353392 32667 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:37.370568 32667 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.370958 32667 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.371388 28656 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:37.372521 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.351724   302 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.363030 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.366395 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.349179 32425 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:37.374009 32410 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.373554 29252 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:37.363948 28654 raft_consensus.cc:2410] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:12:37.378328 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 45893.7us
I20260709 13:12:37.376833 28655 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:37.363674   393 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
I20260709 13:12:37.353070 32586 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:37.355491   398 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.351536 32569 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.387789   397 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.388654 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.400820 28654 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:37.389627 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:37.401772 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:37.391858   302 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.409952   302 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.410876   398 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.412158 29254 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:37.392791 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.390887   352 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.413023 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.414655   352 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.412720   302 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.394160 32410 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.348966 32693 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:37.367173   307 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.416786 32410 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:37.417332 32693 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:37.417810 32693 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.398077 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:37.421761   396 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:37.423440 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 101589us
I20260709 13:12:37.382401 32374 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:37.425300 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 68425.1us
I20260709 13:12:37.425947 32374 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.428160   346 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:37.428853 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.429514 28573 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:37.430488   396 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.430967   396 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.428898   346 consensus_queue.cc:1243] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:37.433708 28650 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:37.375954   371 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.434960 28647 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:37.384856 32586 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:37.440734 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.441129 32586 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.441747 29253 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:37.442224 32586 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:37.442723 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47245.8us
I20260709 13:12:37.444038 32563 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:37.444597 32563 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:37.445519 32563 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.449061 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1876) took 1004 ms. Trace:
I20260709 13:12:37.449505 28721 rpcz_store.cc:276] 0709 13:12:36.444535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.444705 (+   170us) service_pool.cc:224] Handling call
0709 13:12:36.465142 (+ 20437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.607957 (+142815us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:36.659622 (+ 51665us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.994339 (+334717us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:36.994411 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:36.994466 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.448771 (+454305us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001ba154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:37.448831 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.448961 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54381,"prepare.queue_time_us":43476,"prepare.run_cpu_time_us":7312,"prepare.run_wall_time_us":138654,"raft.queue_time_us":73926,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14685,"spinlock_wait_cycles":327908608,"thread_start_us":125980,"threads_started":1,"wal-append.queue_time_us":434119}
I20260709 13:12:37.453884 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:37.438154 28621 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:37.458346 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:37.494916 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 56868.9us
I20260709 13:12:37.499990 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.506227 29257 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:37.507454 28576 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:37.456754 32443 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:37.498399   397 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:37.513389 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 134310us
I20260709 13:12:37.500844 32592 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:37.515530 29252 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:37.503345   395 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.500686   396 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.517863 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:37.521070 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.506939 32519 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:37.520424 32582 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 13:12:37.520045 32592 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.521200   346 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.545733 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.547613 28576 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:37.517123   397 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.551595 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:37.525087   345 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:12:37.566238 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:37.570050 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 889) took 1183 ms. Trace:
I20260709 13:12:37.516605 32443 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.546541 32592 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.574081 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:37.577207 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:37.572283 28648 rpcz_store.cc:276] 0709 13:12:36.376362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.404850 (+ 28488us) service_pool.cc:224] Handling call
0709 13:12:36.410340 (+  5490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.207378 (+797038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.559112 (+351734us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540027ea54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:37.559383 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592934144}
I20260709 13:12:37.553514   397 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:37.582449 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:37.583452 32595 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.591544 32741 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:37.573148 32485 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.593950 32485 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.570364   355 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.596681   355 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.599102   355 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.544564 32582 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.601519 32582 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.602414   392 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:37.602905   392 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.603320   392 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:37.570058   373 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:37.614022 29224 leader_election.cc:336] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.598s (SENT)
I20260709 13:12:37.616387   398 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.631090 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.631693 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.631976 28655 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:37.588240   389 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:37.632400 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:37.583828   396 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:37.699432 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 67106.2us
I20260709 13:12:37.553854   346 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.697857 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.706719 28729 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:37.707333 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:37.717147 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.717381 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:37.718065 28656 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:37.718205 28725 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:37.725025 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.702292   389 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.725926 28729 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:37.702059 32595 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:37.730027   406 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:12:37.730753 32443 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:37.733834 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.729622 28726 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:37.627350 32758 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:12:37.747483 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:37.749646 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.704950   390 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:37.738763 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:37.740229 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 133679us
I20260709 13:12:37.744299 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.753960 28729 raft_consensus.cc:2368] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:37.749459 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:37.761029 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:37.736722   389 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:37.760854 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.771811 32485 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.746974   343 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.773380   343 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.755363   390 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.755028 32595 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.783566 32595 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:37.783792 29224 leader_election.cc:336] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.759s (SENT)
W20260709 13:12:37.784523   402 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
W20260709 13:12:37.784977 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.785089 32582 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:37.777218   390 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.788132 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:37.789569 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.790136 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.790287 28729 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:37.790704 28724 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:37.791205 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.791630 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:37.791972 28726 raft_consensus.cc:2410] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:37.792315 28727 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:37.789474 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.785939 32582 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.793735 28722 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:37.797711 28725 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:37.755647 32586 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:37.756021 32443 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:37.804077 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:37.781069   340 consensus_meta.cc:287] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.001s
I20260709 13:12:37.768581 32640 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.798041 32485 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.817502 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.823105 32485 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.825428 32485 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.827092 32582 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:37.834329 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.811923 32741 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:37.841652 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.844993 32485 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.865099 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:37.850996   390 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.852005 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:37.869581 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:37.869841 28573 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:37.869676 28648 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:37.820600 32640 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.853128 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.874140 28721 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:37.853947 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.800509   355 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:12:37.871361 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:37.873101 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 66045.4us
I20260709 13:12:37.848356 32667 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.875082 28722 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:37.810515 32530 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:12:37.879856 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.860966   372 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.813198 32443 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.816111   340 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.885200 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.822162 32586 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.831996 32758 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:12:37.891120 28581 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:37.893539 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.890074 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.896984 28722 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:37.897579 29255 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:37.895334 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:37.884209   370 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.670s	user 0.013s	sys 0.000s
I20260709 13:12:37.900578 28579 raft_consensus.cc:2368] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13.
I20260709 13:12:37.891502 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.901629 28580 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:37.904556 29251 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:37.906002 28721 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:12:37.906414 32459 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.004s
I20260709 13:12:37.906652 32640 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.906914 32459 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.908025   390 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.909209   346 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.908932 32693 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.908946 32741 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.911194 32667 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.913558 32710 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:37.890337   372 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.914016 32710 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:37.872560 32485 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.914909 32710 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.915732   372 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.916229 32710 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:37.916608 32485 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.918501 28725 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:12:37.918593 28653 raft_consensus.cc:2368] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:12:37.922607 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.917316   370 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.927238 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.932701 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.933426 28725 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:37.937511   394 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:37.938737   397 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.940248 28656 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:37.937558   392 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.942948 28647 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:37.944429   392 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.946681 32586 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:37.945181 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.949880 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:37.950889 28577 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:37.944769 32443 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.957505 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.957773 28726 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:37.962409   343 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.967579   340 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.924535 32459 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:37.913573   371 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:37.961267 32582 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.973924 32582 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.976640 32582 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.978004 32693 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.983206 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:37.983949 29259 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.983851 32459 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:37.986706 32459 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:37.970088 32374 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.997195 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:37.945461   397 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:37.994467 28725 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:37.972798   371 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:37.982437   388 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.000s
I20260709 13:12:37.993225 29259 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:38.005373 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.005702 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:37.970192   370 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:38.010583 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.011807 29251 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.007972 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.012428 29252 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:38.013593 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 85116.5us
I20260709 13:12:38.015910 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.016924 28725 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:38.017535 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.018296 29257 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.020364 32425 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:38.021129 29253 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:38.022054 32709 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.018990 32431 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.020795 32425 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.023358 32425 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:38.027880 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.031106 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:38.031594 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.031795 28573 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.034871 28696 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.036449 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.022979 32592 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:38.045035 29257 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:38.036923   355 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:38.042604 29251 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:38.051811 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:38.052675 28650 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.055596 29253 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:12:38.056490 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.057821 28572 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:38.058501 28696 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.058570 28721 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:38.058907 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:38.056010 29224 leader_election.cc:336] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.879s (SENT)
I20260709 13:12:38.061381 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.062737 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.063441 29253 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:38.064282 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.060250 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.064882 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:38.066025 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.066802 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.067327 28696 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.066368 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.073786 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.068253 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.074498 29259 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:38.074800 28656 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:38.064875 29253 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:38.076538 28573 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:38.076918 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.076927 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:38.077816 29251 raft_consensus.cc:2368] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:38.078229 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.076475 28650 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:38.078828 28648 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:38.080020 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.081178 29257 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:38.082976 29255 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:38.086179 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.087595 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.059355   370 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.093593   417 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:38.094483 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.095592   412 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:38.095903 28545 leader_election.cc:400] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:38.097653 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.011371   388 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.098192 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.099186   302 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:38.099597   302 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.099969   302 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.102952 32459 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.103492 32530 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:38.105370 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.107896 28651 raft_consensus.cc:2368] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11.
I20260709 13:12:38.108495 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.061220   355 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:38.123061 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:38.090086 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:38.132319 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 55490.7us
I20260709 13:12:38.075088 32582 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:38.144084 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.144968 28727 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:38.078554   397 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:38.144086 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.060187 32640 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:12:38.146430 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.147243 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.061003 32709 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 13:12:38.148639 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 58646.8us
I20260709 13:12:38.149363   376 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:38.149435   412 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:38.149927   355 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.152158 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:38.152635 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.144136 32374 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.170159 28724 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.157758 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.146396 32639 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.090957 32595 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:38.149379 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.100106   388 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.107610   370 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.163659 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.133131 32693 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:38.121996 32758 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:38.165647   376 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.157243 28647 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:38.091599   343 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:12:38.162204   397 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.178982 28725 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:38.179730 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.164376 32563 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:38.184023 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.144548   390 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.181696   370 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.183983 32693 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.187719   389 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.182435 32639 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:38.177192 32374 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.180684 32709 consensus_queue.cc:1243] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:38.209041 28727 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:38.202016 32744 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:38.180343   412 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:38.207587   397 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.195067   376 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.224053 28574 raft_consensus.cc:2368] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10.
W20260709 13:12:38.207439 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 120337us
I20260709 13:12:38.203047 32431 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:38.210172   390 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.221541 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.212918 32693 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.220253 32582 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:38.218497 32374 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.223479 32595 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:38.235534 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.251272 32639 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:38.255236   425 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:38.255707 32425 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.258965 29258 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:38.229486   416 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:38.264348 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 208431us
I20260709 13:12:38.232825   390 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.229853 32592 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.266868 28725 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:38.232414 32431 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.297456 32425 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.276818   416 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.301927   302 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:38.303035 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.304358   302 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.304538   416 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.307435 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.308126 28722 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:38.223097 32744 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.309394 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.309574 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.309945 28722 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.310395   307 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:38.310498 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.310808   307 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:38.311211   307 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.311883   389 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.312672   366 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:38.315673 32744 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.320114   370 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.287546 32431 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.320564 32582 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:38.321120   354 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.287s	user 0.015s	sys 0.000s
I20260709 13:12:38.330879 28724 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:38.338753 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.344709 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.345745 28724 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.346889 28725 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:38.278590 32640 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:38.293555 32374 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:38.358570 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 206489us
I20260709 13:12:38.359704 32374 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.320114 32693 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:38.366362 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.376295 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2482) took 1016 ms. Trace:
I20260709 13:12:38.376879 28725 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:38.371558 28722 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:38.378742 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.379107 28622 leader_election.cc:400] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:38.379578 28622 leader_election.cc:403] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:38.344770   307 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.376721 28651 rpcz_store.cc:276] 0709 13:12:37.360098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.361024 (+   926us) service_pool.cc:224] Handling call
0709 13:12:38.374095 (+1013071us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540023e454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:38.376207 (+  2112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654970752}
I20260709 13:12:38.285343   412 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:38.389129 32374 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.386765 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.367110 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.392685 28722 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.360980 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:38.398342   307 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.363099 32693 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.400242   390 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:38.382057 32431 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:12:38.408500 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47597us
I20260709 13:12:38.365533 32744 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:12:38.412621 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.372653   366 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:12:38.415477 28724 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:38.417049 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.377456 32595 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.416306 32640 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.432723   390 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.433231 32640 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:38.433730 32640 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.434106   370 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.435312   397 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.436609 28656 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:38.437178 28651 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:38.415390 32431 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:38.438063 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:38.438606 28651 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:38.438601 32431 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:38.442461 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:38.424779 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2670) took 1068 ms. Trace:
I20260709 13:12:38.443535 28579 rpcz_store.cc:276] 0709 13:12:37.356492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.356657 (+   165us) service_pool.cc:224] Handling call
0709 13:12:38.422834 (+1066177us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54001a9d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:38.424692 (+  1858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200105856}
W20260709 13:12:38.426578   401 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.687s	user 0.007s	sys 0.000s
W20260709 13:12:38.445245 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 78194.6us
I20260709 13:12:38.430276   376 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.408377   307 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:38.411073   436 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:38.424804 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.443251 28649 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:38.446123 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.426277 32683 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:38.448318 28621 leader_election.cc:400] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13.
I20260709 13:12:38.451233 28621 leader_election.cc:403] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:38.452486 28651 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:38.453261   371 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13.
I20260709 13:12:38.453359 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.454427 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:38.450747   436 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:38.454457 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.448261 28722 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:38.456094 28652 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:38.452872 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:38.457218 28649 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:38.460146 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.461182 32425 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:38.453540   307 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.461805 32425 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:38.462682 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.463220   307 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.462932 32425 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.455930 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:38.465255 28651 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.464830 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.469368 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:38.469426 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.477165 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:38.478048 28724 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.449107   392 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:38.486838 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:38.488477 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.452049 32683 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:38.452869   445 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:38.492549 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.499310 28651 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:38.529616 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.480820 32410 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.465584   436 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.530265 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:38.530472 28695 leader_election.cc:336] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.546s (SENT)
I20260709 13:12:38.539822 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:38.538442 29253 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.541421 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:38.543270 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.543896 29256 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.545112 29224 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.483362   307 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:38.546480 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:38.549693 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.549911 28652 raft_consensus.cc:2410] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:38.546994 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.528786   430 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:38.496973   397 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.478868   435 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:12:38.549106 28724 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:38.544543   371 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:38.529445   392 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.557350   430 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:38.559463 32410 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:38.569579 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61026.4us
I20260709 13:12:38.558338   307 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:38.578054 28655 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:38.578243   376 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.572034 32410 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.580296 28655 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:12:38.580646 28655 pending_rounds.cc:85] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 5
I20260709 13:12:38.581092 32410 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.580879 28655 pending_rounds.cc:107] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:12:38.583235 28655 raft_consensus.cc:2889] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:38.586874 29256 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:38.588575 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:38.589069   431 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:38.589668   397 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:38.563163   418 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:12:38.590255   397 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:38.590711   418 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:38.592298   443 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:38.570600   430 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:38.580670   441 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:12:38.609140   438 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:12:38.617503 28649 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:38.566854   371 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.563237 32683 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.591118   418 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:38.611454   431 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:38.591207   397 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.636142 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:38.646481 29253 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:38.641191 32683 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.635422   431 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:38.658654 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:38.656415 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:38.663308 32640 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:38.665498   444 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:12:38.653764   445 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:38.673756 32640 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:38.674544   371 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.657891   449 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.675694 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.676005   449 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:38.676424 29257 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:38.676630   449 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.673853   445 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.678897 32425 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:38.679682 32425 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:38.680706 32425 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.681871   392 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.683005 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.618050   307 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:38.686592 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.672289   436 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.659487   418 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.688738   418 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.689450   436 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.692715 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.693457 28655 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:38.696825 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:38.697556 28655 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:38.698447 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:38.699036 28655 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.700824 32710 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:38.701386 32710 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:38.702431 32710 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.703636 32710 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.662451   453 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:38.716174   453 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:38.717274   431 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.718777   431 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.726996 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.727824 29260 raft_consensus.cc:2368] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:38.727059 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.729168 29257 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:38.744031 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.745781 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.745947 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.746202 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.746551 29260 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.746474 28580 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:38.750161 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.754364 32564 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.762872 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.765301 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.766350 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:38.767469 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.749640 32374 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9.
I20260709 13:12:38.769446 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:38.784101 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.784674 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.784931 28649 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:38.746978   352 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:38.785521   352 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.786674 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.787815   352 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:38.770161 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.788630 28574 raft_consensus.cc:2368] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:38.785430 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.789475 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.790181 28574 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:38.790719 29252 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:38.790891 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:38.791601 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:38.791965   343 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:38.770745   453 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.792447   343 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:38.793442   343 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.794462   343 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.795776 28575 raft_consensus.cc:2410] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:38.797505 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.798360 28729 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:38.798899 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:38.799731 28575 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.801833   370 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.792052 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.803997 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:38.804742 28574 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:38.805613   435 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:38.805575 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.806142   435 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:38.807060   435 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.807868 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:38.808266   435 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.807085 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:38.808988 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:38.810346 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:38.773990 28573 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:38.810839 32519 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:38.811447 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.812983 28575 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:38.777420 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.815038 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:38.779757 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:38.781977   430 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.747412   353 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.728263   388 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:38.782737   449 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.809238 28574 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:38.816187 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:38.770196 28577 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:38.814888   414 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.778090 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:38.863930 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.869514 29260 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
W20260709 13:12:38.869583 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.930953 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:38.918941 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 103961us
I20260709 13:12:38.869776 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:38.869908 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:38.931841 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 62162.8us
I20260709 13:12:38.919914 28726 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:38.893918 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.933629 28573 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
W20260709 13:12:38.887720 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 139599us
I20260709 13:12:38.895725 28579 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.901070 28574 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:38.912189 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.935401 29253 raft_consensus.cc:2368] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:38.913759 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:38.869887 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.936972 28576 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:38.898563 29259 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.918264 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:38.896067 28575 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:38.911099 28578 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:38.899848 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:38.938720 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.871097 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.935907 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.940564 28547 leader_election.cc:400] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:38.940966 28547 leader_election.cc:403] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:38.932439 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:38.942708 28576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2482) took 1077 ms. Trace:
I20260709 13:12:38.933126 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:38.948774 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2497) took 1156 ms. Trace:
I20260709 13:12:38.949391 28578 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:38.943235 28576 rpcz_store.cc:276] 0709 13:12:37.865768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.865927 (+   159us) service_pool.cc:224] Handling call
0709 13:12:38.816750 (+950823us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1eee 0000000000375939 00007f4a2cd651e0 00007f4a2ce2e0c4 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:12:38.942647 (+125897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11313024}
I20260709 13:12:38.956943 29259 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:38.887473 32667 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:38.960639 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:38.949213 28653 rpcz_store.cc:276] 0709 13:12:37.771076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.817142 (+ 46066us) service_pool.cc:224] Handling call
0709 13:12:38.913242 (+1096100us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b5400259254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:38.927455 (+ 14213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227100928}
W20260709 13:12:38.963421 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 147291us
I20260709 13:12:38.966547 29252 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:38.866977   436 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.866776   432 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:38.899850   449 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:38.867154   376 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.897563   430 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:38.867458 32519 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:38.972071 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:38.962293   392 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:38.898147   388 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.971522 28546 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:38.943069   365 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:38.867408   418 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:38.978852   370 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:38.950296   439 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:38.950476 32374 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:38.980674 28655 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:38.943645 32430 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:38.958114   395 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:39.032577   395 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:39.033061   395 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.965979   371 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.895110   434 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:38.963201 32667 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:38.958061   352 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:39.007481 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.948592   390 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:12:38.948890   302 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:39.018213 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:38.950001   355 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:12:38.897889   353 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:38.966336 32683 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:12:38.993798   376 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.032085 28727 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:39.031877   389 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:38.995474 32592 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:38.996479 32519 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:39.054252 32519 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.055598 32519 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:39.034658 28655 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:39.058154   376 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:39.060060   388 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:39.044229 29224 leader_election.cc:400] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10.
I20260709 13:12:39.045790 28581 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:12:39.062225 32443 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:39.041431 32430 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.066902 32430 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:39.039521 32667 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:39.067451 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 1897) took 1019 ms. Trace:
I20260709 13:12:39.067880 28728 rpcz_store.cc:276] 0709 13:12:38.048504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.048607 (+   103us) service_pool.cc:224] Handling call
0709 13:12:39.067238 (+1018631us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54001275d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:39.067383 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098376960}
I20260709 13:12:39.048343   385 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:39.070927 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.073236   397 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:39.073830   397 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.037026 32374 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:39.028172 32431 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:39.035369   439 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:39.075393 32374 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.076243   397 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:39.075878   439 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.051587   352 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:39.078171 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 918) took 1023 ms. Trace:
I20260709 13:12:39.077996   352 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.078569 28656 rpcz_store.cc:276] 0709 13:12:38.054235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.097352 (+ 43117us) service_pool.cc:224] Handling call
0709 13:12:39.077963 (+980611us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540006d1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:39.078102 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777607552}
I20260709 13:12:39.037811 32710 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:39.082497 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:39.014829   392 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:39.090140 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 129586us
I20260709 13:12:39.096890 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.026470   418 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.102846 28580 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:39.101824 28579 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:39.104478 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.110652 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:39.113128 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:39.113577 28656 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:39.115028 28725 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:39.115828   465 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:39.110491 32710 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.117563 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:39.118168   418 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:39.102360   371 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.118800 32710 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:39.119382 32710 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:39.119102   371 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.119730 32710 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.120098 32710 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:39.073848 32592 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.121610 32592 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.122440 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 914) took 1069 ms. Trace:
I20260709 13:12:39.122844 28647 rpcz_store.cc:276] 0709 13:12:38.053264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.053394 (+   130us) service_pool.cc:224] Handling call
0709 13:12:39.122276 (+1068882us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b540001d6d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:39.122379 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206345472}
I20260709 13:12:39.076861   397 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:39.125952 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:39.133694 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 193339us
I20260709 13:12:39.115480 28729 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:39.118320 28648 raft_consensus.cc:2368] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10.
I20260709 13:12:39.134526 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.139454 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:39.110406   426 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.955s	user 0.005s	sys 0.000s
I20260709 13:12:39.044504   412 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:12:39.160508 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.164448 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:39.172224 32667 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.175626 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.151021   465 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:39.151227   417 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:39.222295 29252 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:39.227522 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:39.151312   388 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:39.245312 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:39.246644 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:39.254886 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:39.255885 28696 leader_election.cc:400] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:39.256148 28727 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:39.256385 28696 leader_election.cc:403] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:39.258826 28723 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:39.257910 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:39.263928 28725 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:39.265550 28695 leader_election.cc:400] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:12:39.180816 32430 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:39.156114   371 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:39.240532   431 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:12:39.182976 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 100557us
W20260709 13:12:39.279181   446 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.675s	user 0.003s	sys 0.000s
W20260709 13:12:39.280349   455 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:39.285145 29223 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:39.285545   392 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:39.292573   353 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:39.296016 28695 leader_election.cc:403] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:39.308195 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:39.310774 28725 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:39.275959   417 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:39.322077 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.175765 32683 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:39.181916 32569 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:12:39.304029 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:39.302393 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 126841us
W20260709 13:12:39.328516 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 215465us
I20260709 13:12:39.346449 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.303016   365 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:39.309535 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 44193.6us
W20260709 13:12:39.301138 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 45431.1us
I20260709 13:12:39.347762 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:39.183154 32425 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:39.320827   453 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:39.319289   355 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:39.319275 32519 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:12:39.376927 29251 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:39.378114 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:39.354403 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:39.344568 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 273707us
I20260709 13:12:39.379287 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:39.361295 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:39.362675 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.365538 32592 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:39.374701   466 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:12:39.375682   453 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:39.376077 29256 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:39.379988 29251 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:39.382745 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.345582 32683 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:39.391606 28575 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:39.392119 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.393718 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.386356 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.399227 28651 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:39.399361 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.399494 28695 leader_election.cc:400] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:39.399794 28651 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:39.400357 28695 leader_election.cc:403] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:39.400276 28655 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:39.401558 28574 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:39.402702 28655 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:12:39.403060 28655 pending_rounds.cc:85] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 6
I20260709 13:12:39.403324 28655 pending_rounds.cc:107] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:12:39.403579 28655 raft_consensus.cc:2889] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:39.350086   417 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:12:39.403445 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 95352.7us
I20260709 13:12:39.405200 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:39.357765   431 consensus_queue.cc:1243] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:39.396401 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.381623   392 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:39.400976 28651 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.420105 28651 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:39.420445 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.417382 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.403084 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:39.420478 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:39.425616 28648 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:39.421602 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:39.429217 28581 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:39.387373   385 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:39.387658   397 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:39.435341 28579 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:39.401335 32683 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:39.441778 32595 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:39.442517   343 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.404006   371 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:39.444459 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.404352   436 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:39.407682   376 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
W20260709 13:12:39.454353 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49247.3us
I20260709 13:12:39.362149 32425 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.470218 28651 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:12:39.434062   434 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:39.474812 28651 pending_rounds.cc:85] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 5
W20260709 13:12:39.477306 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49086.2us
I20260709 13:12:39.416443   370 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:12:39.481338 28651 pending_rounds.cc:107] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:12:39.436404   385 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:39.481933 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.443986   417 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:39.434484   431 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:39.487877 28651 raft_consensus.cc:2889] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:39.382330   365 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.492708 29254 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:39.498508 32564 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:39.499600 32564 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:39.503314 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47314.5us
I20260709 13:12:39.504366 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:39.503360   487 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:12:39.473588 32563 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:39.508904 32563 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.509492 32563 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:39.475994 32519 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:39.390173 28578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
 from {username='slave'} at 127.0.0.1:49014
W20260709 13:12:39.527417 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 218170us
I20260709 13:12:39.527770 28578 raft_consensus.cc:606] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Received request to transfer leadership to TS d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.528348 28578 raft_consensus.cc:614] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:39.472908   302 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:39.446584 32640 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:12:39.477474 32667 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:39.508904   487 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:39.543637   416 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:39.474335   343 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.476929 32569 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:12:39.496258   385 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:39.486801   389 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 13:12:39.578502 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 72682.6us
I20260709 13:12:39.531649   434 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:39.583593 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 187281us
W20260709 13:12:39.635998 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.550547   416 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:39.547103   475 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:39.587739   397 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:39.635586 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:39.638453 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.528421   453 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.550509   302 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.665517 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:39.656561 32592 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:39.674508 32710 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.014s
I20260709 13:12:39.690289 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:39.691344 28581 raft_consensus.cc:606] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:39.680356   464 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
W20260709 13:12:39.705343   395 consensus_meta.cc:287] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.672s	user 0.006s	sys 0.006s
I20260709 13:12:39.686831   485 raft_consensus.cc:2764] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:12:39.711169 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.711913 28575 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
W20260709 13:12:39.714105 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.714277 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 980) took 1029 ms. Trace:
I20260709 13:12:39.704919   434 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.714677 28572 rpcz_store.cc:276] 0709 13:12:38.685370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.685517 (+   147us) service_pool.cc:224] Handling call
0709 13:12:38.689423 (+  3906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.689792 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.689821 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:39.071525 (+381704us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b180048b740. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24cf72a6 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a
0709 13:12:39.280161 (+208636us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b2c000014c8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:12:39.280671 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.476513 (+195842us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:39.476573 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.476671 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.714066 (+237395us) raft_consensus.cc:1685] finished
0709 13:12:39.714085 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.714212 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3758,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":15291,"spinlock_wait_cycles":12768896,"thread_start_us":195343,"threads_started":1,"wal-append.queue_time_us":311399}
I20260709 13:12:39.653594   417 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.718544 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:39.725865 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54192.1us
I20260709 13:12:39.728288 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.729903 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.694940 32710 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.707315   482 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:39.739077 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.699007   416 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:39.733101   474 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:12:39.748559   475 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:39.756441 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.731997 32425 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:39.761749 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:39.763355   486 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:12:39.765396   445 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:39.766031 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:39.781721 28572 raft_consensus.cc:606] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.741688   392 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:39.782176 28572 raft_consensus.cc:614] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:39.749825   485 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.747498   482 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:39.768493   373 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:39.757870   416 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:39.786890 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.787956 28650 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:12:39.721356   395 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.737349   355 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:39.708655   397 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.791348 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.741989 32592 raft_consensus.cc:2764] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:12:39.758241   371 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:39.772089   476 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:12:39.774485   475 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:39.789779 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.796356 28650 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:39.793356 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:39.793409 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.793850 28649 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 6. Current term is 8. Ops: []
I20260709 13:12:39.794076 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:39.797516 28655 raft_consensus.cc:2368] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:39.781418   445 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:39.797809 28652 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:39.784669   488 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:39.795620 28729 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:39.787427   482 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:39.786350   373 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:39.803459 28648 raft_consensus.cc:2368] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:39.803876 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:39.804723 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:39.804723 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 169206us
I20260709 13:12:39.806803 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:39.806310 28655 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:39.791147   355 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.808446 29224 leader_election.cc:400] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10.
I20260709 13:12:39.810525 29224 leader_election.cc:403] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:39.814049 28650 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:39.813347 28653 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:39.800398   449 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:39.821961   490 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.111s	user 0.001s	sys 0.001s
W20260709 13:12:39.821907   496 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:12:39.824440   392 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.812778   494 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:12:39.812919   355 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:39.821081 28650 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:39.787007   485 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:39.834893 32710 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:39.835086   485 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:39.837121 28650 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:39.855592 28649 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:39.859189   343 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:39.875804 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:39.864384 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 57519.3us
I20260709 13:12:39.864547   503 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10.
I20260709 13:12:39.874234 28652 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:39.875871 28655 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:39.861406   373 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.882388 29224 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.924777 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.926213 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.928282 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:39.928930 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:39.929780 28730 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:39.930851 28695 leader_election.cc:400] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:39.934484 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.916531   485 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:39.935621   485 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:39.936062   485 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:39.940385 28650 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:39.928131 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:39.942123 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.944303 28575 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:39.944474 28695 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:39.948285 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.946878 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:39.953490 28580 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:39.954030 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.955108 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:39.955513 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:39.955688 28729 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:39.956883 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.957355 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:39.957661 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.957934 28730 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:39.962031   376 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:39.962739   376 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:39.963763   376 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.964205   436 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:39.965116   371 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:39.965369 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:39.965565   371 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:39.965950   371 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:39.945328 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.967996 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.968353 29253 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:39.965147 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.970369 28572 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:39.881630   465 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.969409 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:39.968173 28727 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:39.972677 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:39.975852 28722 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:39.918231   494 consensus_queue.cc:1243] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:39.984727 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:39.987102 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.989364 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:39.989522 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:39.947427 32595 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:39.994985 28721 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:39.991818 28729 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:39.872771   449 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:39.955972   450 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:39.995903 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:39.997233 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:39.968612   370 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.003175 29253 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:40.003859 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:40.004546 28652 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:39.951427 32640 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:12:39.967274   435 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:12:40.011907 29224 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:39.995996   488 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:39.989939   491 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:39.995054   473 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:39.889389   445 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.002962   450 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:40.028232   487 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:40.007246   390 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:40.008450   370 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:39.993460   465 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.003878   504 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:40.040860 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:40.003562 32374 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:40.003937 32564 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:40.023660   488 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.024806   469 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.004067   302 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:12:40.048661 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 51540.4us
W20260709 13:12:40.048398 32563 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.006s
W20260709 13:12:40.058298 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 43956.4us
I20260709 13:12:40.034787   436 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:12:40.038607   487 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:40.046407   503 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:12:40.041045 32595 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:12:40.037808   450 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:40.058229 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:40.059168 28651 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:40.051381   510 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:12:40.021245   352 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:12:40.042681   395 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.046492   491 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:40.069912 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:40.049860   488 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:40.064834   487 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.064692   494 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:40.078673 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 83656.5us
I20260709 13:12:40.073267   352 consensus_queue.cc:1243] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:40.074752 32640 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:40.051432   350 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:12:40.091615   482 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:40.096951   501 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.267s	user 0.011s	sys 0.030s
I20260709 13:12:40.099154 32519 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:40.099746 32519 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:40.059712   469 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.066807   468 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:40.064180 32563 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.083021   491 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:40.068089   370 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.093943 32640 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:40.137681 32640 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:40.139115   506 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:12:40.143834 28580 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:40.144459 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:40.149765   355 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.167861   355 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.170344   469 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.171846   465 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:40.172788   385 consensus_meta.cc:287] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:12:40.173283   385 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.175489   385 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:40.177467 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:40.149657 32683 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.006s
I20260709 13:12:40.190085 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:40.193112 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:40.204389 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:40.210906 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:40.211745 28580 raft_consensus.cc:2368] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11.
I20260709 13:12:40.155772   376 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:40.216441 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:40.217566 29224 leader_election.cc:400] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11.
I20260709 13:12:40.217995 29224 leader_election.cc:403] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:40.201834   385 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.197198 32563 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.211654 32374 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.241364 28729 raft_consensus.cc:1217] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-11.6]   Dedup: 5.4->[8.5-11.6]
I20260709 13:12:40.243438 28729 pending_rounds.cc:85] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 4
I20260709 13:12:40.244441 28729 pending_rounds.cc:107] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:12:40.209335 32595 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:40.245604 28729 raft_consensus.cc:2889] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:40.220703   449 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:40.207126 32683 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.238056   510 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:40.230979   482 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:40.208158   488 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:40.290262 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44941.4us
I20260709 13:12:40.203173   439 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:12:40.245710 32374 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:40.260886   493 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.565s	user 0.003s	sys 0.001s
I20260709 13:12:40.249552 32595 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.327250 29257 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:40.338770 32595 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.338673 32519 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.339608   470 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:40.240892   385 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.256836   450 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:40.348459   416 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.002s
I20260709 13:12:40.229640   491 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:40.381680 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:40.383279 28647 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:40.386281   521 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:40.386996   521 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.375419 32519 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.407358 28579 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:40.383718   449 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.361462   485 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.412783 28578 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:40.417946 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:40.421169 28647 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:40.414783   449 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.429100   449 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:40.429502   528 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:12:40.433343   450 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:40.437983   385 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:40.438158 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2146) took 1040 ms. Trace:
I20260709 13:12:40.439067 28647 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:40.439160 32374 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.438643 28656 rpcz_store.cc:276] 0709 13:12:39.398174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.398337 (+   163us) service_pool.cc:224] Handling call
0709 13:12:39.416373 (+ 18036us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:39.506415 (+ 90042us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:39.506853 (+   438us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.600742 (+ 93889us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:39.601461 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 13:12:39.601610 (+   149us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:39.674913 (+ 73303us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.681101 (+  6188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.681225 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.259937 (+578712us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:40.437927 (+177990us) raft_consensus.cc:1685] finished
0709 13:12:40.437952 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.438097 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3177,"prepare.queue_time_us":51506,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":123984,"raft.run_cpu_time_us":518,"raft.run_wall_time_us":13375,"spinlock_wait_cycles":12826880,"thread_start_us":217457,"threads_started":3,"wal-append.queue_time_us":149076}
I20260709 13:12:40.440491 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:40.441834   521 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.442387 28647 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:40.412724   470 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:12:40.446156 32640 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:40.444445   371 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:40.496084 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:40.450994 28652 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:40.498188 28652 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:40.451311   524 log.cc:927] Time spent T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:12:40.495249 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:40.503732 28574 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:40.496723 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:40.509630 28579 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:40.509631 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:40.514596 28652 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:12:40.515321 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.531491 28580 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:40.518312   416 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:40.535091 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:40.535981 28579 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:40.538295   488 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:40.546326 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b905a9410ce147d093be203901159c35"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:40.547103 28579 raft_consensus.cc:606] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:40.547573 28579 raft_consensus.cc:614] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:40.543577   510 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11.
I20260709 13:12:40.547230 32683 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:40.541558   416 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:40.541375   487 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.590415 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:40.591607 28579 raft_consensus.cc:606] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:40.570432   518 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:12:40.605846   416 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:40.611744   371 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:40.612531   371 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:40.604825 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:12:40.626113 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 105206us
I20260709 13:12:40.629034 28653 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:40.613080   371 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.623461   436 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:40.631522 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:40.632274 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:40.639505 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:40.639971 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:40.629153 32640 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:40.633764   436 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:40.649406 28574 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:40.651032   544 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:40.651669   544 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.652382   485 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.653493   436 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:40.654700   436 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:40.654001   544 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.649317 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:40.663498 28652 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:40.659145 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:40.663046   538 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:12:40.682235 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:40.683518 28652 raft_consensus.cc:2368] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11.
I20260709 13:12:40.686188 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:40.689257   551 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:40.691802 28652 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:40.693218 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:40.701785   418 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:40.702390   418 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:40.703799   412 raft_consensus.cc:993] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:12:40.703462   418 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.704430   412 raft_consensus.cc:1081] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:12:40.714109 32667 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:40.714577   556 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.674095   544 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.718329 32430 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:12:40.725930 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 92174.8us
I20260709 13:12:40.704944   418 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:40.717968   539 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:12:40.729180 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:40.741377 32667 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:40.742100 32667 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:40.742898 32667 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.744058 32667 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:40.756031 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:40.757648 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:40.759047 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:40.759616 28722 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:40.760380 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:40.762163 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:40.721719   542 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:12:40.776378 28725 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:40.773597 28722 raft_consensus.cc:2368] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
W20260709 13:12:40.775964 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 46822.6us
I20260709 13:12:40.784973   551 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:40.726429   544 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.787056 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:40.788617 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:40.797197 28722 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:40.798453 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.800313 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:40.805447 28725 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:40.715374   556 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.801445   355 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.814947   395 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:40.816468   482 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.817369   548 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:40.817389 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.818332 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:40.818554   449 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:40.726060   412 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:12:40.769870   530 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:40.903859   434 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.904925 32425 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:40.771464   487 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:40.910703 28722 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
W20260709 13:12:40.913267 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 169761us
W20260709 13:12:40.918561 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 100288us
W20260709 13:12:40.911584   539 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:12:40.925985 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:40.930328 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:40.931154 32640 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:40.931573   504 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:40.938865 29223 leader_election.cc:400] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
I20260709 13:12:40.939393 29223 leader_election.cc:403] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:40.916687   355 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:40.925499   449 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:40.919443 32425 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:40.952689 28725 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:40.960310 28721 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:40.961506 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2508) took 1159 ms. Trace:
I20260709 13:12:40.927273 28650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:12:40.963857 28650 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:40.964370 28650 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:40.961910 28649 rpcz_store.cc:276] 0709 13:12:39.804347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.804473 (+   126us) service_pool.cc:224] Handling call
0709 13:12:40.961342 (+1156869us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b54003a93d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:40.961452 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79852800}
I20260709 13:12:40.917263   482 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.913909   395 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.786243   551 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.946863   475 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:40.946142   371 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:40.949859   453 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:40.916320   548 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.957718   449 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.972641   450 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:41.007292   450 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.007112 32425 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.007800 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:41.008603 28574 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:41.010212   556 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.011166 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:40.936414   435 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:12:41.013304   449 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:40.953426   385 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.017408   385 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.922274   434 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.004364   548 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.021034   355 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:40.952847 32683 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:12:41.038331   482 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:40.958791 32758 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.008805 32425 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:40.918480   530 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.032299 28650 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:41.039680   554 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:12:40.993741   514 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:41.054507 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 100616us
I20260709 13:12:41.058867 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:41.046860   475 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:41.075551 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 119755us
W20260709 13:12:41.079840 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.068007   544 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.066246   560 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.054723 32592 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.101583 28650 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.051365 32758 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.127214 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:41.129384 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1277) took 1776 ms. Trace:
I20260709 13:12:41.129796 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.132308   487 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:41.133057 28725 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:41.135700 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2499) took 1349 ms. Trace:
I20260709 13:12:41.136106 28647 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:41.136109 28648 rpcz_store.cc:276] 0709 13:12:39.786110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.786265 (+   155us) service_pool.cc:224] Handling call
0709 13:12:41.135462 (+1349197us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b540018f954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:41.135630 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13163264}
I20260709 13:12:41.121284   436 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.132380 29257 rpcz_store.cc:276] 0709 13:12:39.352672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.361707 (+  9035us) service_pool.cc:224] Handling call
0709 13:12:39.374990 (+ 13283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.328857 (+953867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.128937 (+800080us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b5400610dd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:41.129318 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147386752}
I20260709 13:12:41.186028   468 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.186959   468 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.199000 32758 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.200309   453 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
W20260709 13:12:41.202301 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 704683us
I20260709 13:12:41.207819   449 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.070273   514 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.210873   514 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.212170 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2537) took 1284 ms. Trace:
I20260709 13:12:41.213696   395 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.215001   434 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.216092   436 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.218418   436 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.219179   468 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:41.225927 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.224666 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:41.117726   385 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:41.219321   566 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:12:41.238561 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.212745 28728 rpcz_store.cc:276] 0709 13:12:39.927839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.929027 (+  1188us) service_pool.cc:224] Handling call
0709 13:12:39.929315 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.929531 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:39.983991 (+ 54460us) log.cc:844] Serialized 14 byte log entry
0709 13:12:40.587214 (+603223us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b18004935a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:41.211409 (+624195us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18004935a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287
0709 13:12:41.211670 (+   261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:41.211742 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:41.211822 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.211922 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.212093 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65580,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":33977,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7070,"spinlock_wait_cycles":6521472,"thread_start_us":159393,"threads_started":2,"wal-append.queue_time_us":136346}
I20260709 13:12:41.241122 28725 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:41.243587   450 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.244005 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:41.138952 28656 raft_consensus.cc:2368] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:41.244309 28728 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:41.245568 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:41.245165 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.258671 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.257913 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.135233 32592 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.202847   475 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:41.272099 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.280131 28649 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:41.269088   453 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.285470   453 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.286068   530 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:41.288362   453 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:41.289521 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45599.5us
I20260709 13:12:41.290176   557 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:41.291198 28695 leader_election.cc:400] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:41.296145 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1518) took 1347 ms. Trace:
I20260709 13:12:41.296231 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.297439 28728 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:41.297055 29255 rpcz_store.cc:276] 0709 13:12:39.948994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.949857 (+   863us) service_pool.cc:224] Handling call
0709 13:12:39.950200 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:40.021262 (+ 71062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.021294 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:40.021784 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:12:40.047920 (+ 26136us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:40.047961 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.295610 (+1247649us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54006bf154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:41.295676 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.295737 (+    61us) raft_consensus.cc:1685] finished
0709 13:12:41.295756 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.296032 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9154,"raft.queue_time_us":3734,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":7944,"spinlock_wait_cycles":155463424,"thread_start_us":873,"threads_started":1,"wal-append.queue_time_us":23109,"wal-append.run_cpu_time_us":2331,"wal-append.run_wall_time_us":1065750}
I20260709 13:12:41.256554   392 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.304533 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:41.311748   453 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:41.139571   560 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.312180   453 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.312562   453 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:41.314107   560 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.302306   392 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.335709   392 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.336539 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.337338 28728 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:41.347693 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:41.348448 28574 raft_consensus.cc:2368] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
I20260709 13:12:41.358330 28579 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:41.327359   453 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.344585   564 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:41.370885 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.383924 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1201) took 1202 ms. Trace:
I20260709 13:12:41.384538 28721 rpcz_store.cc:276] 0709 13:12:40.181869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.182078 (+   209us) service_pool.cc:224] Handling call
0709 13:12:40.208437 (+ 26359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:40.967374 (+758937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.383541 (+416167us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400280fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:41.383833 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728247040}
W20260709 13:12:41.462180   579 log.cc:927] Time spent T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:41.463946   449 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.386366   564 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.597774   519 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:41.598448   519 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.600773   519 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.601537   519 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.602212   544 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:41.602835   544 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.607542 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:41.605116   519 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.610031   544 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.614234   453 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.612862   519 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:41.616148 32425 consensus_meta.cc:287] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.565s	user 0.018s	sys 0.007s
I20260709 13:12:41.600471 32592 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.619403   373 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:41.620493   564 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.620760 29255 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:41.619424   431 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.622310 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:41.622835   431 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.624312 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:41.627326 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.628161 29252 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:41.619529   510 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.629210   510 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.629818 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1000) took 1337 ms. Trace:
I20260709 13:12:41.630115 28578 rpcz_store.cc:276] 0709 13:12:40.292072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.292223 (+   151us) service_pool.cc:224] Handling call
0709 13:12:40.307190 (+ 14967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.413516 (+106326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.629606 (+1216090us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001a9d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:41.629737 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242348288}
I20260709 13:12:41.631521   510 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:41.621716 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.631549 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 925) took 2687 ms. Trace:
I20260709 13:12:41.632467 29257 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:41.628046   350 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:41.633785   350 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:41.632687 28654 rpcz_store.cc:276] 0709 13:12:38.944267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.948761 (+  4494us) service_pool.cc:224] Handling call
0709 13:12:38.971811 (+ 23050us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.049851 (+ 78040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.049905 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:39.072180 (+ 22275us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.555575 (+483395us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b180011b180. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:12:39.609067 (+ 53492us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:39.695395 (+ 86328us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.698296 (+  2901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.386577 (+688281us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b180011b180. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24cf72a6 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419
0709 13:12:41.631247 (+1244670us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b540018f454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:41.631297 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.631344 (+    47us) raft_consensus.cc:1685] finished
0709 13:12:41.631356 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.631477 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2698,"prepare.queue_time_us":62309,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":2892,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":6096,"spinlock_wait_cycles":189242880,"thread_start_us":97717,"threads_started":2,"wal-append.queue_time_us":653302,"wal-append.run_cpu_time_us":2943,"wal-append.run_wall_time_us":1098288}
I20260709 13:12:41.634722   350 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.636065   350 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.637115   431 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.637338 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1926) took 1445 ms. Trace:
I20260709 13:12:41.638067 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.639439 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.638001 28730 rpcz_store.cc:276] 0709 13:12:40.192346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.192511 (+   165us) service_pool.cc:224] Handling call
0709 13:12:40.192905 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:40.248432 (+ 55527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.248464 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:40.249028 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 13:12:41.200166 (+951138us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b48001c0158. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2cd3faa1 00007f4a2cd36b37 00007f4a2cd369ca 00007f4a2ce2e26f 00007f4a2ce2df37 00007f4a2ce4255c 00007f4a2ce42508 00007f4a2ce42488 00007f4a2ce42443 00007f4a2ce416ec 00007f4a2bd6ba96
0709 13:12:41.302523 (+102357us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b1800495640. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:12:41.596325 (+293802us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:41.596489 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.596578 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.637084 (+ 40506us) raft_consensus.cc:1685] finished
0709 13:12:41.637108 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.637265 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101798,"raft.queue_time_us":56226,"raft.run_cpu_time_us":1822,"raft.run_wall_time_us":929980,"spinlock_wait_cycles":53008640,"thread_start_us":137533,"threads_started":1,"wal-append.queue_time_us":1365253}
I20260709 13:12:41.641866 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.642259 32710 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:41.642516 29253 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.642892 32710 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.645380 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.646149 29255 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:41.647866 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.649748 29252 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:41.649887 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.650866 29254 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:41.651654   526 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.652374 32710 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.652308   526 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.653286   416 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:41.653954   416 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.654865   526 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:41.656302   416 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:41.662616 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.664193 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.665055 29252 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:41.666175 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:41.668004 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 368383us
I20260709 13:12:41.671417 29253 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:41.673588   416 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.667847   453 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.674274   416 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.675380   453 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.677436   416 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:41.677487   453 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:41.679677 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.680157   376 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:41.704320 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.705070 29254 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:41.668277   510 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:41.682300 29255 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:41.685935 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.686563 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.686158 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.689162 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.713924 29256 raft_consensus.cc:2368] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:41.689845 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.716042 28729 raft_consensus.cc:2410] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:41.690510 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.689997 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.699393 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.700384 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.717367 29258 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:41.701162   561 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:41.717901 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.718819 29254 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:41.718204   561 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.722077 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.722882 29259 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:41.714236 28723 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:12:41.699482   530 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.728521 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:41.699462   526 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.741413   526 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.744247   526 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.713492 32374 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:41.745954 32374 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.748389 32374 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.749553 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.705785   416 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.753427   416 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.732789 29253 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:41.739393 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:41.740370   561 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.740536 32640 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:41.755219 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.756354 28696 leader_election.cc:400] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:41.764741 28696 leader_election.cc:403] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:41.761466 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.766288 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:41.769934 28696 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:41.774091 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.772861   343 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:41.772609 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:41.715057   376 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.763696 32640 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:41.725320   510 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.763114   530 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.768252   526 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:41.771356   556 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:41.784551 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.773301   548 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:41.771116   435 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.786170 29253 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:41.786554   435 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.788183 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:41.789425 32374 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.790218 32374 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.792402 32374 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.789347   557 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:41.793105   557 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.788836   435 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:41.793558   557 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.793551   548 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:41.793648 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.773048   494 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.801219 29252 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:41.778625   343 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:41.783154 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:41.802809 29255 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:41.785348   434 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:41.781970 32640 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:41.807569 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.809778 29253 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:41.810477 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.808424   376 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.816769 29254 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:41.817716 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.818218 29254 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:41.819049 29254 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:41.806282   343 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:41.828857 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45759.7us
I20260709 13:12:41.832515 29255 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:41.829721 29253 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:41.812737   434 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.830726   561 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:41.836799   431 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:41.837076   561 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:41.837575   561 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:41.837723   431 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:41.838173   431 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:41.838497   561 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.839038   431 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.840004   561 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:41.840250   431 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:41.832111   498 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:41.845911   434 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:41.846225   530 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:41.830825 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:41.804183 32374 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.858214 32374 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.858749 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:41.859088   395 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:41.860468   395 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:41.860891   395 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.861255   395 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.862114 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:41.862830 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:41.834159 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.863667 29252 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:41.863444 28648 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:41.800519   494 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.870754 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:41.871486 28648 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:41.872394 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:41.799278   548 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.867321 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2165) took 1324 ms. Trace:
I20260709 13:12:41.868939 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:41.869691 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:41.870074 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.891878 28647 rpcz_store.cc:276] 0709 13:12:40.543097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.553856 (+ 10759us) service_pool.cc:224] Handling call
0709 13:12:41.135615 (+581759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.137190 (+  1575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.867152 (+729962us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540018f950. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:41.867269 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289832832}
I20260709 13:12:41.892457 28651 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 6.
I20260709 13:12:41.893564 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.894683 29253 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:41.874607 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.874881 28547 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:41.875134 32592 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:41.835599 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:41.891225   475 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:12:41.897954   416 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:41.898561 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63037.4us
I20260709 13:12:41.877071 28622 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:41.900190 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:41.900398 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:41.887650   392 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:41.901199   530 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:41.901538   392 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:41.902108   392 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.902791   530 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:41.905629 32425 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:41.907239 29224 leader_election.cc:400] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11.
I20260709 13:12:41.908254 29224 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:41.909416   519 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:41.909734 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:41.910096   519 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:41.910660   519 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.911731 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:41.912683   498 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:41.858673   465 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:12:41.860430 32374 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.914275   494 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.915887 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:41.916003   498 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:41.916432   469 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:41.901484   544 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:41.916997 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:41.920992 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.921562   544 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:41.886161   510 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:41.923349 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:41.917171   475 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:12:41.888983 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:41.871259 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:41.926427 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 55283us
I20260709 13:12:41.923341 29256 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:41.924358   556 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:41.928745 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:41.924134 32640 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:41.955468 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:41.917536 32374 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:41.961313 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:41.920709 28726 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:41.930351 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:41.934026 29224 leader_election.cc:400] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
I20260709 13:12:41.982409 28647 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
W20260709 13:12:41.982597 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 48769.5us
I20260709 13:12:41.931203   376 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:41.927716 32425 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:41.930491   371 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:41.927908   544 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:41.912807   519 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:41.928825 28622 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:41.985749 28722 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:41.953703   465 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:42.012311   465 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.992060 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:41.995977   587 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:12:42.000123   397 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.928073   548 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:41.994418   371 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:41.960525 32374 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:42.018743 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 89987.7us
I20260709 13:12:42.019757 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:41.983646   436 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.988346   416 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:42.024787   548 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:42.020422   371 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.020228   397 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.020569 32374 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.025452   557 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.026213   436 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.027612   465 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:42.029592 28722 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:42.030535 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.034332 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:42.034533 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.035161 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:42.035440 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.035859 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:41.987967   376 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:42.036755 29259 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:42.021157   373 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:42.044018 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:42.045367 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 153922us
I20260709 13:12:42.021351   518 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:42.025303 32640 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.072925 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.074724 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:42.074510 28725 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:42.059921 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.078488 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:42.056371 28721 raft_consensus.cc:2410] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:42.059304 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:42.081851 28723 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:42.047968   519 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:42.081485 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.085788 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:42.086807 28647 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:42.048182   517 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:42.099449 29253 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:42.071904   376 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.072089   373 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:42.115051 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 240272us
I20260709 13:12:42.081446   544 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:42.046928   434 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.111377 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:42.104557 32595 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:42.117925   564 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:42.123616 32710 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:12:42.138933   343 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.140661 28728 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:42.078789   518 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.120675   373 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.163023 28727 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:42.167881 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 183516us
I20260709 13:12:42.169094 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:42.170837 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:42.182142 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:42.132802 32595 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:42.193504 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:42.205308 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.209986 28580 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
W20260709 13:12:42.214453 28621 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.558s (SENT) [suppressed 7 similar messages]
I20260709 13:12:42.229732 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.244927 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.118919   392 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.273247 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:42.165973   465 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:42.307387 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.310993 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.312722 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.190737   510 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.195767   431 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.267395 32595 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.331658 28654 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:42.361553 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 283128us
I20260709 13:12:42.362627 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:42.334089   517 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:42.347384 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 262546us
I20260709 13:12:42.366771 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.371304 28574 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 7: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:42.371984 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:42.368561 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:42.377744 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:42.334314   355 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:42.384816 28648 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:42.381956 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.317387   395 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.377556 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:42.337024   469 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:42.354396   556 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.390920 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.396385 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:42.360409   439 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:42.406968 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.413335 28725 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:42.369423   431 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:42.420634   431 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:42.421268   431 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.418669 28580 raft_consensus.cc:2410] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:12:42.430143 28578 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:42.385617   544 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:42.397171   355 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.440852 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.441939 28725 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:42.444288 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.446254 28651 raft_consensus.cc:2368] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10.
I20260709 13:12:42.446182 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:42.456728 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 345399us
I20260709 13:12:42.406663   343 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.412626 32640 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.462875 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:42.415344   557 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.404904   397 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.413086   449 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.468297 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.482563 28575 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:42.471200 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 351380us
I20260709 13:12:42.439940   439 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:42.419719   610 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.484150 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:42.396553 32563 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:12:42.486706 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.487533 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.495390 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:42.490001 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 216878us
I20260709 13:12:42.498062 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.494820   564 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:42.505260   564 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.505637   564 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:42.470422 32640 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:42.435873   556 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:42.491283   593 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.358s	user 0.001s	sys 0.001s
W20260709 13:12:42.511433 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 116651us
I20260709 13:12:42.489018   439 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:42.527560 28580 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:42.550767 28575 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:42.553898 28575 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:42.560190 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.595147 28580 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:42.562084 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.562280 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.565574 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.596807 28577 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:42.597259 28577 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:42.509691   434 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.548239   557 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:12:42.518127 32640 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.580243 28721 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:42.583276 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:42.549153   601 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
W20260709 13:12:42.611258 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 173129us
I20260709 13:12:42.519098   518 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.622921 28725 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:42.623481 28580 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:42.620639 28577 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.647699 28577 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:42.627156 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 127086us
I20260709 13:12:42.640571 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:42.659967 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 445517us
W20260709 13:12:42.663472 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 97624.8us
I20260709 13:12:42.545504   551 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:12:42.621893   392 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.669062 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.634433   434 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:42.673599   595 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:12:42.673779   596 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 13:12:42.674587   612 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:12:42.493686   517 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.710170   556 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:42.700763   608 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.189s	user 0.002s	sys 0.000s
W20260709 13:12:42.713459 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.672142 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:42.725581 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53540.8us
W20260709 13:12:42.689709   376 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.001s
I20260709 13:12:42.690448   616 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:42.654820   412 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:12:42.698642   609 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:12:42.701288   434 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.737075   610 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.704587   355 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.741437 32595 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:42.742939   564 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.745066 32595 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:42.728001 28577 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:42.747256   564 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.730664   376 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.735134   439 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.728811   616 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:42.748332   616 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:42.749851   439 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.751855   376 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.731786   395 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.735749   436 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.682119 32425 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:42.738081 32374 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.668s	user 0.013s	sys 0.000s
I20260709 13:12:42.738987   434 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:42.762331   439 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.761927 32374 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.762836   439 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:42.763612   597 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:42.764029   597 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:42.703183   431 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.727532   498 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:42.764962   373 consensus_meta.cc:287] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 13:12:42.765522   373 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:42.766646 28724 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:42.768038 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:42.769567 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:42.770411 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:42.764693 32374 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:42.770339 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.771072 29258 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.761855 32425 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.730154 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:42.781826 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 51723.9us
I20260709 13:12:42.784498 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:42.776474 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:42.787900 29253 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:42.798071 28722 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:42.809993 28730 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:42.783496   439 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:42.789958   564 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.830691 29254 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:42.791167   611 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:42.848479 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56132.8us
I20260709 13:12:42.849220 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:42.850270 28730 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:42.854839 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:42.855999 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:42.857087 29254 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
W20260709 13:12:42.838053 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.791807   498 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:42.862170 28723 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:42.863835 28722 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260709 13:12:42.866822 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:42.791509   613 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:12:42.880539 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.869068 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.882917 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.883934 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.764907   597 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.885565 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:42.886861 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:42.887295 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1528) took 1190 ms. Trace:
I20260709 13:12:42.856344   436 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:42.894866 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.892201 29251 rpcz_store.cc:276] 0709 13:12:41.696635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.696775 (+   140us) service_pool.cc:224] Handling call
0709 13:12:41.709600 (+ 12825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:41.736979 (+ 27379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.737032 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:41.745238 (+  8206us) log.cc:844] Serialized 26 byte log entry
0709 13:12:42.015249 (+270011us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b1800329920. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:12:42.348551 (+333302us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:42.420378 (+ 71827us) log.cc:844] Serialized 14 byte log entry
0709 13:12:42.766088 (+345710us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b1800329920. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:12:42.882261 (+116173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.886927 (+  4666us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:42.887002 (+    75us) raft_consensus.cc:1685] finished
0709 13:12:42.887028 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.887217 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26972,"prepare.queue_time_us":35774,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":154432,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":10343,"spinlock_wait_cycles":79317120,"thread_start_us":449052,"threads_started":2,"wal-append.queue_time_us":671079}
I20260709 13:12:42.895512 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:42.909204 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:42.914194 28730 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:42.917163 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:42.920218 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.921451 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.915287 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:42.898707   519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.004s	sys 0.014s
I20260709 13:12:42.882510   453 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.931648 29251 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:42.854154   564 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.932251 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:42.931964 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.933461 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.894459   370 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.897693 32595 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:42.937997 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.944396 28580 raft_consensus.cc:2368] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
W20260709 13:12:42.945962 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 79229.7us
I20260709 13:12:42.950030 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:42.952123 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.953510 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:42.954424 28572 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:42.873606   626 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:12:42.859633   611 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.960922 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.962668 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:42.965785 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:42.927246   350 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:42.894060   434 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:12:42.982916 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:42.983600 29259 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:42.985491 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:42.977106 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.977419 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:42.932426   519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.004s	sys 0.014s
I20260709 13:12:42.979171 28579 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:42.976971 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:42.987417 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:42.980787 28696 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:42.901060   436 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:42.959328   494 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:42.935631   574 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:12:43.017158 28723 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:42.959110   629 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:42.976580   613 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:42.938999   376 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:12:42.988243   519 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:42.983506 32595 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:42.991925   619 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:42.931950   617 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:12:42.987828   518 raft_consensus.cc:2764] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:12:43.044540 29259 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:43.013695   373 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.013294   526 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:42.959929   370 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:43.047748   632 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:43.047603   519 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.034521   556 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:43.048256   617 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:43.047811 32595 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.058881 32425 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:43.063022   617 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:43.066583   617 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.067955   617 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:43.060628 29258 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:12:43.068068   370 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.063190   556 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.069199 29252 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:12:43.069550   556 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.063105 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.065650   494 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:43.016551   557 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:43.074911   494 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.045836   431 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.054075   436 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.037340   629 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:43.080577 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 54808us
I20260709 13:12:43.033368   613 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:43.045984 32640 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.079629   498 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:43.118055 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 130711us
I20260709 13:12:43.121035 28728 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:43.121536 28695 leader_election.cc:400] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:12:43.122677 28695 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.124046 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:43.125463 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.127367   436 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:43.124558   376 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:43.128033   436 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.128435   436 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.128633   498 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.135706   370 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:43.136297   370 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.141286 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.143536 32640 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.144150 32640 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:43.145112   526 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.147145   370 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.149185   629 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.140103   376 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.152815   376 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:43.154691   371 consensus_meta.cc:287] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.105s	user 0.014s	sys 0.000s
I20260709 13:12:43.154932   376 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.155145   371 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.157817   371 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:43.160316 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.163542 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.165688   613 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.167232   613 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.167668   475 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:43.168243   475 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:43.170125   605 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.170786   605 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.158396   436 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.181212 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:43.184468 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:43.168726   475 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.191859 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:43.202903 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 222179us
I20260709 13:12:43.208756 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:43.141525   616 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.186272   376 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:12:43.194943   397 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.195518   611 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.204034   607 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:43.224936 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:43.231751 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1940) took 1155 ms. Trace:
I20260709 13:12:43.232061 28724 rpcz_store.cc:276] 0709 13:12:42.076027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.076220 (+   193us) service_pool.cc:224] Handling call
0709 13:12:42.090037 (+ 13817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.767041 (+677004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.231554 (+464513us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54001ba654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:43.231705 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555545472}
I20260709 13:12:43.210786   392 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:43.238540 28726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 1920) took 3261 ms (client timeout 1795 ms). Trace:
I20260709 13:12:43.211860   610 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:43.239212 28726 rpcz_store.cc:269] 0709 13:12:39.971900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.972355 (+   455us) service_pool.cc:224] Handling call
0709 13:12:43.233296 (+3260941us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400234bd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:43.233413 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4425124736}
I20260709 13:12:43.247845 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.250062 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:43.252170 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:43.253295 28721 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.253405 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:43.301928 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 46660.5us
W20260709 13:12:43.241057   598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.004s	sys 0.008s
I20260709 13:12:43.229790   605 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.315728   574 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:43.316309   645 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:12:43.239425   397 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.316995   576 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:43.317472   576 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:43.318296   576 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.318944   397 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.319418   576 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.303045   610 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.238324 32595 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:43.340452 32595 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.341796   557 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:43.343310   371 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:43.343520 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 965774us
I20260709 13:12:43.346227 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:43.346871 28649 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.347285 32592 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:43.347625 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.348269 28647 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:43.347930 32592 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.348628   564 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.346912 28650 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:43.349509 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:43.350327 28647 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 7: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:43.350436 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.351117 28648 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:43.351210 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:43.351954 28655 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.352128 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.352771 28653 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:12:43.256678   392 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.355607   392 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:43.325201   646 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:12:43.356377 28651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2535) took 1282 ms (client timeout 1570 ms). Trace:
I20260709 13:12:43.328567   436 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.302847   592 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:43.342901 32595 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.331526   616 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:43.370868 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:43.371258 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.240023   434 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:12:43.372614   434 consensus_queue.cc:1243] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:43.329700   556 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.373634 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.375008 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1934) took 1346 ms. Trace:
I20260709 13:12:43.375558   556 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.334836   416 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:43.376402   416 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:43.377300   592 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:43.378387 28650 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:43.378903 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.375412 28727 rpcz_store.cc:276] 0709 13:12:42.028376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.028491 (+   115us) service_pool.cc:224] Handling call
0709 13:12:42.028834 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.163770 (+134936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.374761 (+1210991us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002d9e54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:43.374923 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307873536}
W20260709 13:12:43.313810   598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.005s	sys 0.008s
I20260709 13:12:43.238637   607 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.338093   475 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.348021 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.327360   630 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:12:43.311597   365 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:12:43.384754 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:43.307510 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 101233us
W20260709 13:12:43.356823 28651 rpcz_store.cc:269] 0709 13:12:42.074274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.074430 (+   156us) service_pool.cc:224] Handling call
0709 13:12:43.356162 (+1281732us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540006e0d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:43.356298 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852082560}
I20260709 13:12:43.386410 29254 pending_rounds.cc:85] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 7
I20260709 13:12:43.386775 29254 pending_rounds.cc:107] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:12:43.387053 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.388080   397 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:43.388723   397 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.375639 32592 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.389776 28647 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: [9.9-10.10]
W20260709 13:12:43.390780   603 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.984s	user 0.004s	sys 0.001s
I20260709 13:12:43.361840 28655 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:43.391227   397 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.329762   650 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:43.371490 28726 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.367405   561 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.376421 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.396311 28656 raft_consensus.cc:2410] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:12:43.379011 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.397055 28654 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:43.397200 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.378305 28578 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:43.371579 28648 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.380270 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.383198 28649 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:43.387034 29254 raft_consensus.cc:2889] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.377449   416 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.401996 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.403203 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:43.408929 29259 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.410316   630 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:43.393219   650 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:43.411118   630 consensus_queue.cc:1243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:43.411671   630 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:43.412350   630 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:43.411751   650 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.413242   626 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:43.413587   469 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:43.413868   626 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:43.413332   630 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.414119   469 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:43.381362   519 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:43.405674 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2563) took 1469 ms. Trace:
I20260709 13:12:43.405949 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:43.423307 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.431306 29259 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:43.414814   626 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.414899   630 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:43.424856 28729 rpcz_store.cc:276] 0709 13:12:41.936564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.936685 (+   121us) service_pool.cc:224] Handling call
0709 13:12:41.937059 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:41.954159 (+ 17100us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:41.954188 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:41.954803 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:12:42.167299 (+212496us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:42.167354 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.167423 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:43.390014 (+1222591us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:43.391952 (+  1938us) raft_consensus.cc:1685] finished
0709 13:12:43.391978 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.405589 (+ 13611us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16540,"raft.queue_time_us":19132,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2588,"spinlock_wait_cycles":11447040,"thread_start_us":174791,"threads_started":1,"wal-append.queue_time_us":371214}
I20260709 13:12:43.433696 28696 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:43.445789 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.395426   610 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:43.402668   465 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:43.463366 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.466650 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.467495 28655 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:43.444900 32592 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:43.468670 32592 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.469156 32592 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.469647   598 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:43.451920   397 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 13:12:43.466972   653 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:12:43.442580   629 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:43.441883   650 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.460846   557 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:43.464805   365 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.484275 29224 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.406454   561 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.489216   443 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:43.494728   475 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:43.495817   634 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.444s	user 0.002s	sys 0.000s
I20260709 13:12:43.496269 32592 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.501560 28650 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.502929   416 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.507325 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.509420 28581 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:43.478227   626 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.444931   519 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.480736   629 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:43.415031   469 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:43.513300 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 59488us
I20260709 13:12:43.452901   544 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:12:43.519754   445 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.519332   615 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:43.522351 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.522540   607 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.523429 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1300) took 1714 ms. Trace:
I20260709 13:12:43.525363 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.526129 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.433885   592 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.523083 28573 raft_consensus.cc:2376] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10. Re-sending same reply.
I20260709 13:12:43.546965 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.547647 28573 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:43.548542 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.549140   376 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:43.549288   597 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:43.549733   376 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.550616 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.512012   365 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.551815   376 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.553457 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:43.554342 28655 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:43.533356 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.523873 29255 rpcz_store.cc:276] 0709 13:12:41.808982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.924870 (+115888us) service_pool.cc:224] Handling call
0709 13:12:41.925182 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.091143 (+165961us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:42.115067 (+ 23924us) log.cc:844] Serialized 14 byte log entry
0709 13:12:42.767389 (+652322us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b1800166900. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a 00007f4a27e20a2a
0709 13:12:43.125241 (+357852us) log.cc:844] Serialized 14 byte log entry
0709 13:12:43.165392 (+ 40151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:43.165439 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:43.165488 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.523194 (+357706us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400327b54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:43.523257 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.523365 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77239,"prepare.queue_time_us":28350,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":43114,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":10642,"spinlock_wait_cycles":385902336,"thread_start_us":352813,"threads_started":1,"wal-append.queue_time_us":1090248}
I20260709 13:12:43.534106 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.555796 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.556072 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.557281 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.558032 28575 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.533560 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.532910 28651 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.536561   622 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:43.563409 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.563915 29254 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:43.511416   494 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.512996   557 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:43.538930   629 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.553639   365 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.557335 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.534508   544 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:43.535944   519 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:43.560118 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.560655 28695 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.581241 28651 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.533033   561 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.537531   636 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:12:43.568270 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:43.586354 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.587602 28648 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:12:43.589689 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.600394 28651 raft_consensus.cc:2368] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14.
I20260709 13:12:43.571071   469 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.595427 28575 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:12:43.597965 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:43.604588 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.605639 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:43.616653 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.616079 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:43.618369 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:43.662284 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47891.1us
I20260709 13:12:43.663651 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:43.665673 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47408.8us
I20260709 13:12:43.666972 28695 leader_election.cc:400] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10.
I20260709 13:12:43.668169 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:43.669781 28650 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:43.671460   487 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.597992   629 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.570073   613 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:12:43.603667   556 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:43.621210   622 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:43.572320   494 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.621244   434 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:43.683283   526 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:43.660286   373 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:43.681900 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:43.705206   637 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:43.706683   616 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:43.707581   580 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:43.709208 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45661.7us
I20260709 13:12:43.709254   487 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:43.690485   592 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:43.714231   644 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:43.715893   557 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:43.716609   663 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
I20260709 13:12:43.659662   621 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:43.660625   518 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:43.589056   544 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.588753   548 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:12:43.741968   637 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:43.732506 28577 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:43.735333 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.700182 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:43.736191 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:43.801689 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 66432.9us
I20260709 13:12:43.741663 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.803630 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.742552 28651 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:43.701990   556 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:43.730542   494 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.765190 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:43.819744 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55000.3us
I20260709 13:12:43.741650   373 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:43.821593   373 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.822774 32592 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:43.731590 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.769938 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.770867 28648 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:43.779794 28650 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:43.780422 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.828155 28647 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:43.780591 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.829384 28654 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:43.784857 28578 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:43.789552 28649 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:43.766315   621 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:43.756795   616 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.790160   518 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:43.792994   544 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:43.875604 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:43.799065 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.881763 28579 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
W20260709 13:12:43.697068   624 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:12:43.889891   637 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.891945   637 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:43.893602   669 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:43.808614 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:43.894668 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 86163.1us
I20260709 13:12:43.896314 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.813346 28724 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:43.814863 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:43.817059 28652 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:43.898109   636 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:43.818570 28575 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:43.898765   636 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:43.862816 28576 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:43.899307   636 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:43.898180 28574 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:12:43.902696 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.903273   625 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:43.905920 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.906490   625 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:43.907572 28546 leader_election.cc:400] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14.
I20260709 13:12:43.907588   625 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:43.873598 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 205521us
I20260709 13:12:43.908002   551 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:43.908396   551 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:43.908573 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.767158   592 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:43.909278   551 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.876276 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:43.909821   592 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:43.910544 28580 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:43.910808   551 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.834149   621 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:43.876686 28653 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:43.758673   580 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.815815   626 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:43.833395   556 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:43.884287   518 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:43.802614 32758 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.908010 28546 leader_election.cc:403] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:43.916613 28724 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:43.868937 28477 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 5, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 5 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:43.919148 28621 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.922394 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:43.925698 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.933362 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.933743 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:43.926759 32592 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:43.934964 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:43.933310 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:43.927874 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65568.2us
I20260709 13:12:43.938864 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.940289 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.941510 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.943358 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:43.945343 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:43.943038 29259 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:43.950476 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.937860 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:43.951269 29259 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:43.952227 28477 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.963172 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.963984 29259 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:43.953604 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.965296 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:43.966158 29255 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 9: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
W20260709 13:12:43.956952 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49524.6us
I20260709 13:12:43.970647 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:43.970979 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:43.971688 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:43.958786 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:43.958626 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.955682 29256 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:43.973793 29255 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:43.975337 29256 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:43.976357 29255 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:43.952009   657 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:43.979172 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:43.979962 29257 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.987732 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.991869 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:43.993242 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:43.994686 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 56581.9us
I20260709 13:12:43.952036   658 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:12:43.952474   548 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:43.952499   416 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:43.953737   649 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:43.978531   397 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:44.011775 28477 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.013366 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:44.013981   657 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:44.014101 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:44.014974   652 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.017927   616 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:43.998232   629 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.968613   352 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14.
I20260709 13:12:43.956070   519 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:12:44.009534 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:43.967633   625 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:12:44.036978 28477 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.021637   548 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:44.049301 28479 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 276) took 18206 ms (client timeout 15000 ms). Trace:
I20260709 13:12:43.951876 32758 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:44.025466   649 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:44.034504   576 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:44.029649   397 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:44.065709 29255 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:44.033346   416 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:44.065855 29259 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:44.066339 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:44.030856 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:44.068535 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.067502 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:44.062757 28477 catalog_manager.cc:5697] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:44.076300 29256 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:44.078583 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:44.074021 29257 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:44.055226   548 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:44.079509 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.080792 29260 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:44.066054   649 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:44.087389 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56610.9us
I20260709 13:12:44.092063 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:44.086073 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.066535   576 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.074021   397 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.124131 28622 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:44.079665   629 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.038296   652 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:44.105073   526 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:44.142253 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 62831.2us
I20260709 13:12:44.077781   436 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:44.091719   606 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:44.090994   658 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:44.107183   352 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:44.077600   611 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:12:44.114898   580 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:44.128916   576 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.146250   436 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:44.185521   615 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:44.187161   618 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:44.135984   544 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.170513   475 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.159471 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:44.125661   625 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
W20260709 13:12:44.200336   603 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:12:44.174476   352 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.176060   469 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:44.230404 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 71062.7us
I20260709 13:12:44.148844   412 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:12:44.053648 28479 rpcz_store.cc:269] 0709 13:12:25.842849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.844742 (+  1893us) service_pool.cc:224] Handling call
0709 13:12:44.049160 (+18204418us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:36.661411 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:36.694756 (+ 33345us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:36.694820 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:12:36.694836 (+    16us) tablet.cc:662] Decoding operations
0709 13:12:37.021533 (+326697us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:37.038522 (+ 16989us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:37.045767 (+  7245us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:12:37.309616 (+263849us) tablet.cc:701] Row locks acquired
0709 13:12:37.309687 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:12:37.309894 (+   207us) write_op.cc:270] Start()
0709 13:12:37.310065 (+   171us) write_op.cc:276] Timestamp: P: 1783602757309823 usec, L: 0
0709 13:12:37.310109 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:12:37.310943 (+   834us) log.cc:844] Serialized 7750 byte log entry
0709 13:12:37.935978 (+625035us) op_driver.cc:464] REPLICATION: finished
0709 13:12:38.101353 (+165375us) write_op.cc:301] APPLY: starting
0709 13:12:38.101489 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:38.284971 (+183482us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:38.321556 (+ 36585us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:38.725844 (+404288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:38.726243 (+   399us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:12:38.726288 (+    45us) write_op.cc:312] APPLY: finished
0709 13:12:38.726802 (+   514us) log.cc:844] Serialized 180 byte log entry
0709 13:12:38.726989 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:38.727182 (+   193us) write_op.cc:454] Released schema lock
0709 13:12:38.727265 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:38.727681 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:38.727707 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":873036,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":121141,"apply.run_cpu_time_us":36971,"apply.run_wall_time_us":648091,"cfile_cache_hit":78,"cfile_cache_hit_bytes":81471,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":1322,"lbm_reads_lt_1ms":12,"num_ops":20,"prepare.queue_time_us":261786,"prepare.run_cpu_time_us":69666,"prepare.run_wall_time_us":956227,"raft.queue_time_us":112046,"raft.run_cpu_time_us":12653,"raft.run_wall_time_us":78883,"replication_time_us":625568,"thread_start_us":497166,"threads_started":4,"wal-append.queue_time_us":306386,"wal-append.run_cpu_time_us":11855,"wal-append.run_wall_time_us":2138212}]]}
I20260709 13:12:44.263037 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:44.265715 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:44.267239 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:44.273276 28724 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:44.288026 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.253830   544 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:44.261461   352 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:44.355273 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 67345.2us
I20260709 13:12:44.163865   657 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:44.278198   606 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:44.277962   475 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:44.359804 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:44.216759   416 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:44.369355 28477 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 5, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 5 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:44.356915   557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.022s	sys 0.038s
W20260709 13:12:44.371286   376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.019s	sys 0.042s
I20260709 13:12:44.276175   365 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:12:44.282636 32592 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:12:44.397588 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1305) took 1436 ms. Trace:
I20260709 13:12:44.406139 29251 rpcz_store.cc:276] 0709 13:12:42.961466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.961612 (+   146us) service_pool.cc:224] Handling call
0709 13:12:42.961954 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:43.014150 (+ 52196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:43.014190 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:43.026390 (+ 12200us) log.cc:844] Serialized 26 byte log entry
0709 13:12:43.729426 (+703036us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b1800206020. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:12:44.083133 (+353707us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:44.083190 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.083289 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:44.397172 (+313883us) raft_consensus.cc:1685] finished
0709 13:12:44.397204 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:44.397514 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31813,"raft.queue_time_us":72916,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10987,"spinlock_wait_cycles":3660544,"thread_start_us":353465,"threads_started":1,"wal-append.queue_time_us":1321491}
I20260709 13:12:44.407456 32592 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:44.407949 32592 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:44.401858   436 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:44.410104   618 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.410753   618 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:44.408839 32592 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:44.387617   487 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:44.402007 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1527) took 2715 ms. Trace:
I20260709 13:12:44.294245   519 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
W20260709 13:12:44.385106   557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.023s	sys 0.038s
W20260709 13:12:44.385851   603 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:12:44.377992   475 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.422968 29260 rpcz_store.cc:276] 0709 13:12:41.686682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.687134 (+   452us) service_pool.cc:224] Handling call
0709 13:12:41.710076 (+ 22942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:44.106354 (+2396278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.401634 (+295280us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b540003edd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:44.401879 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5450856704}
I20260709 13:12:44.375363   606 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:44.381901   544 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:44.391839   376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.020s	sys 0.043s
I20260709 13:12:44.293946   658 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
W20260709 13:12:44.436342   673 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:12:44.439898 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 436818us
W20260709 13:12:44.402027   373 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:12:44.427316   487 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.415259 32563 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:44.446628 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.416308 32592 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:44.443874   607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.017s	sys 0.033s
I20260709 13:12:44.390481   498 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:12:44.412982   618 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:44.438937   606 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.439409   475 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:44.486353   580 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.487025   580 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:44.487778 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.488775   622 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.489235   613 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:44.490972 29260 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:44.452003   487 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:44.450863 32563 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:44.509766 32563 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:44.511009 32563 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:44.511575   352 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:44.446156   544 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:44.451817   373 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:44.514007   551 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.003s
I20260709 13:12:44.513958   544 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:44.515309   373 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:44.516023 28727 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:44.530309   621 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:12:44.530994   621 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:44.532473 29258 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:44.534971   621 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:44.497320 32758 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:44.524682   556 consensus_meta.cc:287] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.000s
W20260709 13:12:44.483628   607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.017s	sys 0.034s
I20260709 13:12:44.539940   652 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:44.611434 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 378749us
I20260709 13:12:44.592972   630 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:44.586639   556 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:44.621783   637 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.729s	user 0.013s	sys 0.001s
I20260709 13:12:44.678524 28726 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:44.693228 29254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.005s	sys 0.008s
W20260709 13:12:44.694013 29254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.005s	sys 0.009s
W20260709 13:12:44.695147 29253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.025s	sys 0.010s
W20260709 13:12:44.695674 29253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.025s	sys 0.010s
I20260709 13:12:44.786615 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:44.616255   619 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:12:44.789034 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:44.800535 28729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.019s
W20260709 13:12:44.813587 28729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.003s	sys 0.019s
I20260709 13:12:44.631621   397 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:44.832556 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 43646.3us
I20260709 13:12:44.826293 28723 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:44.838311 28652 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:44.839208 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.844305 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.845742 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:44.796749   613 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:44.886534 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:44.796871   373 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:44.801926   352 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:44.848261   649 consensus_meta.cc:287] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.000s
W20260709 13:12:44.848727   636 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.943s	user 0.011s	sys 0.011s
I20260709 13:12:44.849835   526 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:44.901520   498 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:44.906513 28622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.016s	sys 0.016s
I20260709 13:12:44.849992   519 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.847646   607 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:44.933530 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:44.945608 28547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.025s	sys 0.062s
W20260709 13:12:44.946244 28547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.025s	sys 0.062s
I20260709 13:12:44.910696   392 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:44.946748 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 694723us
W20260709 13:12:44.892097   518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.020s	sys 0.037s
W20260709 13:12:44.953088 28574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.039s
I20260709 13:12:44.894140   613 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:44.895998 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46425.4us
W20260709 13:12:44.917562 28622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.017s	sys 0.016s
W20260709 13:12:44.957724 28574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.003s	sys 0.040s
I20260709 13:12:44.965807 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:44.916674   443 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.966655 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:44.954486 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:44.954761 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:44.966431 28721 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:44.971419 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:44.974030 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:44.975431 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:44.980759 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:44.982896 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:44.984570 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:44.985396 28648 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.007679 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:44.937726   526 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:12:44.957451   518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.020s	sys 0.037s
I20260709 13:12:45.030668 28654 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:44.907929   649 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:44.910861   636 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:45.085557 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:45.094301 28648 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:45.095072 28649 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:44.916893   498 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.031243   652 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:12:44.958909   607 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.044463   693 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:12:45.110148   693 consensus_queue.cc:1243] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:45.143879 28726 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:45.033991   443 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.018826   392 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:45.135854   682 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.459s	user 0.000s	sys 0.001s
I20260709 13:12:45.127430   556 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.116379   607 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:45.225646   689 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:12:45.227425   690 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:12:45.228682 28576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2746) took 1120 ms. Trace:
I20260709 13:12:45.229342 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1565) took 1361 ms. Trace:
I20260709 13:12:45.229759 29252 rpcz_store.cc:276] 0709 13:12:43.867623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.868283 (+   660us) service_pool.cc:224] Handling call
0709 13:12:43.868637 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:43.952854 (+ 84217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:43.952893 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:43.953458 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.173187 (+219729us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b1800472b40. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:12:44.669035 (+495848us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:44.669080 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.669151 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.229069 (+559918us) raft_consensus.cc:1685] finished
0709 13:12:45.229090 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.229288 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63466,"raft.queue_time_us":109883,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7743,"spinlock_wait_cycles":26729216,"thread_start_us":495546,"threads_started":1,"wal-append.queue_time_us":1033563}
I20260709 13:12:45.237315   709 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:45.237972   709 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.243645 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1285) took 1314 ms. Trace:
I20260709 13:12:45.244103 29254 rpcz_store.cc:276] 0709 13:12:43.928991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.929754 (+   763us) service_pool.cc:224] Handling call
0709 13:12:43.930228 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:43.994071 (+ 63843us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:43.994115 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:44.008498 (+ 14383us) log.cc:844] Serialized 52 byte log entry
0709 13:12:44.694681 (+686183us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:44.694743 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.694847 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.243372 (+548525us) raft_consensus.cc:1685] finished
0709 13:12:45.243393 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.243564 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63298,"raft.queue_time_us":70397,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":15187,"thread_start_us":632575,"threads_started":1,"wal-append.queue_time_us":1064942}
W20260709 13:12:45.247532 32592 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.000s
I20260709 13:12:45.229096 28576 rpcz_store.cc:276] 0709 13:12:44.108684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.109345 (+   661us) service_pool.cc:224] Handling call
0709 13:12:44.121351 (+ 12006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.181338 (+ 59987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.181387 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:44.182019 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.636494 (+454475us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:44.636552 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.636653 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.228449 (+591796us) raft_consensus.cc:1685] finished
0709 13:12:45.228473 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.228621 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48613,"raft.queue_time_us":60944,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":454080,"threads_started":1,"wal-append.queue_time_us":771833}
W20260709 13:12:45.205174   677 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.403s	user 0.000s	sys 0.002s
W20260709 13:12:45.257401   681 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 13:12:45.257558   397 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.259555   443 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:45.261292   498 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:45.195818   526 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:45.263253   636 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:45.209295   576 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.994s	user 0.011s	sys 0.003s
W20260709 13:12:45.302464 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 315483us
I20260709 13:12:45.306989 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:45.199746   692 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:45.324716 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:45.326836 28651 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
W20260709 13:12:45.305509   548 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.167s	user 0.010s	sys 0.003s
I20260709 13:12:45.202625   392 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.348385 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:45.355460 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:45.356454 29254 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 9: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:45.348177   658 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:45.359020 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:45.349086   714 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.351231   397 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:45.379828 32563 consensus_meta.cc:287] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.868s	user 0.009s	sys 0.001s
I20260709 13:12:45.385290   714 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:45.358714   475 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.000s
I20260709 13:12:45.354266   548 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:45.347200   498 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:12:45.326128   576 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.349676   692 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.354070   636 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:45.389557   475 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.483506   376 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.484225   376 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:45.388957   714 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:45.403844   548 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:45.487252 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:45.488143 28726 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:45.404208 28722 raft_consensus.cc:2368] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
W20260709 13:12:45.491925 28722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2577) took 1507 ms (client timeout 1574 ms). Trace:
I20260709 13:12:45.407562   649 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.411906   576 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.413132   392 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.416466   607 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.417200 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1966) took 1511 ms. Trace:
I20260709 13:12:45.497967   576 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.421062   711 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.417685   613 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:45.499369   711 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.499508   613 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:45.500241   561 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:45.429359 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2749) took 1005 ms. Trace:
W20260709 13:12:45.503726 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 386294us
I20260709 13:12:45.444607 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:45.444882 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:45.505239   475 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.505743 29254 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:45.507099 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:45.446666 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:45.447049   658 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:45.508749   392 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:45.452306   412 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:45.510119 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:45.510064   412 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.510936 29254 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:45.453920 28580 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:45.425534   692 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.509363   392 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:45.492504 28722 rpcz_store.cc:269] 0709 13:12:43.984468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.984610 (+   142us) service_pool.cc:224] Handling call
0709 13:12:45.491587 (+1506977us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002da354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:45.491792 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3136980736}
I20260709 13:12:45.501770 28574 rpcz_store.cc:276] 0709 13:12:44.424288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.425239 (+   951us) service_pool.cc:224] Handling call
0709 13:12:44.427757 (+  2518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.429298 (+  1541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.429344 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:44.429944 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.965475 (+535531us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:44.965515 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.965580 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.428997 (+463417us) raft_consensus.cc:1685] finished
0709 13:12:45.429080 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.429273 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1083,"raft.queue_time_us":86632,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":535037,"threads_started":1,"wal-append.queue_time_us":996036}
I20260709 13:12:45.513135 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:45.461392 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:45.461508 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:45.454262 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:45.452837 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:45.469252 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 121011us
I20260709 13:12:45.498836 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:45.462366 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1243) took 1762 ms. Trace:
I20260709 13:12:45.453368 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:45.458195 28579 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:12:45.550812 28579 pending_rounds.cc:85] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 9
I20260709 13:12:45.551193 28579 pending_rounds.cc:107] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:12:45.551627 28579 raft_consensus.cc:2889] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:45.548506 29254 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:45.498088 28728 rpcz_store.cc:276] 0709 13:12:43.905706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.905851 (+   145us) service_pool.cc:224] Handling call
0709 13:12:43.906170 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:43.906490 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:43.906516 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:43.906997 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.289071 (+382074us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:44.289110 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.289178 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.416897 (+1127719us) raft_consensus.cc:1685] finished
0709 13:12:45.416927 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.417122 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3111,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":381680,"threads_started":1,"wal-append.queue_time_us":707454}
I20260709 13:12:45.470264 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:45.532806 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 71388.6us
I20260709 13:12:45.464823 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:45.512787   412 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.554358 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:45.549702 28723 rpcz_store.cc:276] 0709 13:12:43.699587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.703802 (+  4215us) service_pool.cc:224] Handling call
0709 13:12:43.704095 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:44.837504 (+1133409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.462130 (+624626us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000d57d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:45.462308 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303265152}
I20260709 13:12:45.579460 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:45.581770 28728 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:45.478569 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:45.532331 28578 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:45.531919 28580 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:45.523823 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:45.565693 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 66919.4us
W20260709 13:12:45.425873   487 consensus_meta.cc:287] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.920s	user 0.010s	sys 0.002s
I20260709 13:12:45.500681   561 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:45.587853 28650 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:45.472236   687 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.565s	user 0.006s	sys 0.008s
I20260709 13:12:45.519914   613 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:45.546952 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:45.457026   675 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.874s	user 0.014s	sys 0.007s
I20260709 13:12:45.458701   373 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:45.473232   676 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.841s	user 0.007s	sys 0.000s
I20260709 13:12:45.594683 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:45.664419 28578 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:45.665598 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:45.596449 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:45.458909   693 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:45.471366   720 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.455796   691 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.463835   618 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.462306   652 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.459022   688 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:45.459132   699 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:45.462450   717 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:45.456362   597 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.634987 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:45.462713   701 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.455557   629 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:45.636193 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:45.544145   392 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:45.463716   698 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:45.640127   561 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.532624   443 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:45.451601   619 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:45.463162   551 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:45.660669 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 76279.2us
I20260709 13:12:45.577328   574 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:45.586452   498 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:45.498626   576 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:45.425058   636 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.637074   548 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:45.642306   412 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:45.663414   449 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:45.683916   544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.012s	sys 0.016s
I20260709 13:12:45.638513   613 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:45.602461   487 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.643642   713 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:12:45.752750   676 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:12:45.774252   544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.209s	user 0.012s	sys 0.016s
I20260709 13:12:45.797453   580 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:45.799592   576 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:45.802553   636 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.679272   693 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.805378   693 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.701195   721 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:45.745194   711 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:45.684150   691 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:45.756215   684 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:45.758105   619 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:45.762655   637 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:12:45.759298   622 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:45.782464   713 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:45.784310   709 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:45.788195   679 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.885s	user 0.007s	sys 0.004s
I20260709 13:12:45.701665   717 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.755268   698 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.702196   699 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:45.813352   713 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:45.837394   719 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:12:45.842324   698 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.844475   699 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:45.847823   717 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.854111   711 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:45.854729   711 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:45.855773   711 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.860985   713 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.862874   713 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.698493   652 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.873307   652 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.878491   711 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:45.811123   721 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:45.887112   721 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.668336 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:45.970041 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:45.975168 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:45.749673 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 114789us
I20260709 13:12:45.978479 28722 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 12: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:45.958256 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2740) took 2152 ms. Trace:
I20260709 13:12:45.980628 28573 rpcz_store.cc:276] 0709 13:12:43.805527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.825692 (+ 20165us) service_pool.cc:224] Handling call
0709 13:12:43.826116 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:43.826578 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:43.826616 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:43.827249 (+   633us) log.cc:844] Serialized 52 byte log entry
0709 13:12:44.239576 (+412327us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:44.587490 (+347914us) log.cc:844] Serialized 14 byte log entry
0709 13:12:44.589476 (+  1986us) log.cc:844] Serialized 14 byte log entry
0709 13:12:44.591922 (+  2446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.592030 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:44.847220 (+255190us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800432700. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:45.447160 (+599940us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800432700. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a2bcea58f 00007f4a24d29571 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd
0709 13:12:45.787413 (+340253us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:45.957306 (+169893us) raft_consensus.cc:1685] finished
0709 13:12:45.957356 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.957882 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":844024,"prepare.queue_time_us":870672,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":79,"raft.queue_time_us":30418,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":10253,"spinlock_wait_cycles":84185344,"thread_start_us":734639,"threads_started":2,"wal-append.queue_time_us":766084}
I20260709 13:12:45.987512 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:45.988802 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:45.670208   373 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.766292   498 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.984748 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:46.056126   498 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.056685 28573 raft_consensus.cc:2368] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10.
I20260709 13:12:45.761642   551 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.063580   551 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.063680   683 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:45.792403   574 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.065269   574 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.067930   684 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:46.068843 28574 raft_consensus.cc:2410] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:45.750774   629 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.774953   548 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.076318   629 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.701926   597 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.078512   548 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.081717 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1241) took 2382 ms. Trace:
I20260709 13:12:46.082445 28727 rpcz_store.cc:276] 0709 13:12:43.698971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.701927 (+  2956us) service_pool.cc:224] Handling call
0709 13:12:43.702247 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:44.516421 (+814174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.080948 (+1564527us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54002346d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:46.081466 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871083392}
I20260709 13:12:45.791229   613 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.695617   618 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:46.091591   658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.037s	sys 0.116s
I20260709 13:12:45.702046   688 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.091668 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1318) took 2059 ms. Trace:
I20260709 13:12:46.092834 29258 rpcz_store.cc:276] 0709 13:12:44.032310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.032724 (+   414us) service_pool.cc:224] Handling call
0709 13:12:44.035594 (+  2870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:44.532985 (+497391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.091092 (+1558107us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54006432d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:46.091465 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142048000}
I20260709 13:12:46.094584 28579 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:46.095155   688 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:45.750560   701 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.097550   597 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.098166   701 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:45.682294   720 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:45.744472 32595 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.017088 32592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.015s
W20260709 13:12:46.021243   657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.014s	sys 0.006s
I20260709 13:12:46.023290 29259 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:45.701432   397 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:45.757954   443 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.135573   720 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.025584 32563 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.137439   526 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:46.137739 32563 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.138372   526 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.025702   622 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:46.026386 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 471915us
I20260709 13:12:46.027498   449 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.064991   683 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.143486   449 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:46.028869   373 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.029958 28721 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:46.031770   619 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:46.032583   694 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:46.145572   694 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.146572   734 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.148087   694 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.147672   734 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.033901 32758 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:46.149907 32758 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:46.150368 32758 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:46.152026 32758 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.036940   376 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:46.152711 28620 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.014s	sys 0.064s
I20260709 13:12:46.153355   376 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:46.154142   376 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.039499 28578 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:46.043010   412 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:46.157559 32592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.008s	sys 0.015s
I20260709 13:12:46.159519   412 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.160382   475 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.046916   691 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.048362 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2580) took 1969 ms. Trace:
I20260709 13:12:46.161432 28730 rpcz_store.cc:276] 0709 13:12:44.078445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.078857 (+   412us) service_pool.cc:224] Handling call
0709 13:12:44.105515 (+ 26658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:44.252470 (+146955us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:44.678881 (+426411us) log.cc:844] Serialized 14 byte log entry
0709 13:12:44.948910 (+270029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:44.948976 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:44.949056 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.451360 (+502304us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b1800414a00. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a2bcea58f 00007f4a24d29571 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd
0709 13:12:46.047711 (+596351us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002341d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:46.047793 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.048112 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58093,"prepare.queue_time_us":838381,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":3730,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":56702,"spinlock_wait_cycles":344113920,"thread_start_us":695343,"threads_started":2,"wal-append.queue_time_us":676251}
I20260709 13:12:46.048251   616 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:46.165654   734 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.050678   621 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.054570 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2582) took 1908 ms. Trace:
I20260709 13:12:46.054973 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1283) took 2131 ms. Trace:
I20260709 13:12:45.771481   561 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.064251 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1299) took 1083 ms. Trace:
I20260709 13:12:46.100571 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.099226   487 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:46.092231   658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.037s	sys 0.116s
W20260709 13:12:45.779340   606 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.227s	user 0.015s	sys 0.000s
I20260709 13:12:46.092231   618 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.132680   397 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.133213 32595 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:46.133800   657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.015s	sys 0.006s
I20260709 13:12:46.154357   683 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:46.052338 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1300) took 1063 ms. Trace:
W20260709 13:12:46.153373 28620 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.014s	sys 0.064s
I20260709 13:12:46.156705   376 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:46.188308 28574 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:46.193765 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.197199   619 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.197870 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.201473 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.172804   443 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.159451 32592 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.211731 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.176632 32563 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.218053 32592 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.218966 32595 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:46.214785   526 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.206211 29256 rpcz_store.cc:276] 0709 13:12:44.988912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.001151 (+ 12239us) service_pool.cc:224] Handling call
0709 13:12:45.001593 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.028693 (+ 27100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.028740 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.474529 (+445789us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b2c00012a88. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:12:45.475513 (+   984us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.755696 (+280183us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:45.755742 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.755817 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.051617 (+295800us) raft_consensus.cc:1685] finished
0709 13:12:46.051669 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.052045 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29123,"raft.queue_time_us":131562,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":51006,"spinlock_wait_cycles":18221312,"thread_start_us":279802,"threads_started":1,"wal-append.queue_time_us":350935}
I20260709 13:12:46.203020   475 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.220815 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.240741   619 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.229125   621 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.248317   619 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.174402 29255 rpcz_store.cc:276] 0709 13:12:44.981248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.981447 (+   199us) service_pool.cc:224] Handling call
0709 13:12:44.981858 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:45.190894 (+209036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:45.190931 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:45.191516 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:12:45.558688 (+367172us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:45.558747 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.558850 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.014049 (+455199us) raft_consensus.cc:1685] finished
0709 13:12:46.014100 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.064049 (+ 49949us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143538,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2556,"thread_start_us":575251,"threads_started":2,"wal-append.queue_time_us":505590}
I20260709 13:12:46.248977   621 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:46.169967 29253 rpcz_store.cc:276] 0709 13:12:43.923416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.923941 (+   525us) service_pool.cc:224] Handling call
0709 13:12:43.924246 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:43.993514 (+ 69268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:43.993548 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:44.023116 (+ 29568us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.696205 (+673089us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:45.301596 (+605391us) log.cc:844] Serialized 14 byte log entry
0709 13:12:45.301977 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.302067 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.471571 (+169504us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:45.990228 (+518657us) raft_consensus.cc:1685] finished
0709 13:12:46.006001 (+ 15773us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.054570 (+ 48569us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71170,"prepare.queue_time_us":586875,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":71116,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":44329,"spinlock_wait_cycles":11927296,"thread_start_us":1084954,"threads_started":2,"wal-append.queue_time_us":763601}
I20260709 13:12:46.255614   392 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.169744 28729 rpcz_store.cc:276] 0709 13:12:44.145671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.154314 (+  8643us) service_pool.cc:224] Handling call
0709 13:12:44.154834 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.215344 (+ 60510us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:44.215376 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:44.215839 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.814176 (+598337us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:44.814218 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:46.053633 (+1239415us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b54001caf54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:46.053732 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:46.053836 (+   104us) raft_consensus.cc:1685] finished
0709 13:12:46.053851 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:46.054333 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2077,"raft.queue_time_us":55312,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":5268,"spinlock_wait_cycles":116086144,"thread_start_us":538571,"threads_started":1,"wal-append.queue_time_us":940830}
I20260709 13:12:46.220963 32592 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.233489   606 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.233625 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.259248 28728 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:46.259812   606 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.259593   574 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.261077 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.237051   445 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:46.262162 28652 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:46.262925   574 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.262673   445 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.265475   445 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.267132   574 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.267793   618 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.267983   574 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.268577   618 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.272202   574 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.273566   365 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.223875 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.274768   352 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:46.274616   365 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.277459 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:46.300021   592 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:46.300926   592 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:46.302847 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 57460.9us
I20260709 13:12:46.304006   592 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:46.305263 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 753039us
I20260709 13:12:46.305514 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.306317   734 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:46.307319   734 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.309509 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.309619 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.310599 29256 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:46.312908   734 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:46.313750 29259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1326) took 1359 ms (client timeout 1535 ms). Trace:
I20260709 13:12:46.306315 28727 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
W20260709 13:12:46.314200 29259 rpcz_store.cc:269] 0709 13:12:44.954419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.954556 (+   137us) service_pool.cc:224] Handling call
0709 13:12:46.313472 (+1358916us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54005b1dd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:46.313651 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420442496}
I20260709 13:12:46.227854   469 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:46.316253 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:46.316473   469 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:46.316946 32758 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:46.317248 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 851343us
I20260709 13:12:46.317888   469 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.319362   469 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.278884   365 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.280004 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:46.321313   629 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.321762   629 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.322147   629 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.322546   622 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:46.322264   373 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:46.304625 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:46.323390   373 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.324606 28648 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.316964 28730 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:46.325630 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:46.322278   694 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:12:46.325402   644 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.327128   644 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.327514   644 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.329121   475 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.332175 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.275068 29255 pending_rounds.cc:85] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 6
I20260709 13:12:46.281673 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:46.289301 28653 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:46.272418   618 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.293344 28650 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:46.225697   397 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:46.296252 28651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 979) took 1301 ms (client timeout 1501 ms). Trace:
I20260709 13:12:46.262265 28726 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:46.275964   352 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.281221   443 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:46.332175 28649 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:46.332949 29255 pending_rounds.cc:107] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:12:46.345562 29258 raft_consensus.cc:2410] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:46.355340 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.356407 28723 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:46.357542 28647 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.357429   443 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.360222   443 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.344333 29255 raft_consensus.cc:2889] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:46.361573 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.363155   613 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.363375 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:46.355448 29260 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:12:46.365856 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 377769us
I20260709 13:12:46.356469 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:46.338346 28651 rpcz_store.cc:269] 0709 13:12:44.979854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.982591 (+  2737us) service_pool.cc:224] Handling call
0709 13:12:46.280289 (+1297698us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540027ea54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:46.280753 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788786560}
I20260709 13:12:46.371492 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.380491 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.382899 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.383711 29258 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:46.388443   392 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.390295 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:46.378369   397 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.391448 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:46.392359   691 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.392988   691 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.393692 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.395128   615 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:46.395642   615 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:46.396070   615 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.397394 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.397964 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:46.398402 28652 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:46.381773 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.398614 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.399410 28656 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:46.405539 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.406440 28649 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:46.406361 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.407750 29254 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:46.391239   397 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.393610 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:46.415977 32563 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:46.416649 32563 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:46.418052 32563 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.419768   397 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.421144   352 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.422284 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:46.422487 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:46.423133 28651 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.423957 28656 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:46.424934 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.425789 28656 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:46.426353 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:46.426568 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.427723 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.428368 28656 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:46.429436 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:46.430123 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:46.430773 29258 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.432603 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.433241   621 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:46.433458 28649 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:46.433570 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.433996   373 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.435716 28647 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:46.439777 28648 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:46.439869 28653 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:12:46.416685   711 consensus_meta.cc:287] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.012s
I20260709 13:12:46.445225 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.450155 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.452870 28650 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:46.435859 32563 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.440124   574 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.467000 29224 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:46.432711   629 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.455099 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.477713 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.452426   443 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:46.481976 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:46.465710   412 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.475054 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.487177 28730 raft_consensus.cc:2368] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:46.468786   574 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.443138   445 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:12:46.479563   397 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:46.499164 29260 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
W20260709 13:12:46.503698 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.504377 28729 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:46.489948   498 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.506394 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:46.507586   498 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.509400 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.509776 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.491402   621 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:46.492867   574 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.508925 28621 leader_election.cc:400] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10.
I20260709 13:12:46.517134 28621 leader_election.cc:403] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.518471 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.521304 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.524489 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.500201   711 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:46.526906 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.529142 28727 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:46.530105   397 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.534724 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.535888 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.536397 28574 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:46.536917 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.537489 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:46.538571 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.539535 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.540104 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.538493 28576 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:46.541093 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.541913 28573 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:46.542488 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.543586 29251 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:12:46.536273 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.544339 28579 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11.
I20260709 13:12:46.524868   487 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:46.544746 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.536669 28580 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:46.543586 28575 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:46.537513 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.550388 28574 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:46.554960 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:46.555797 28578 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.520006   621 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:46.561167 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:46.532806   397 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.563493 28649 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:46.563299 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 133483us
I20260709 13:12:46.566036 28650 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:12:46.563561 29251 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:46.569885   691 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.573374 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:46.565543 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.575883 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.561451   621 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:46.589469 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.592250 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.592988 28726 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:46.593160 29257 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:46.593719   629 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.594269 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.580457 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.582510 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.583729 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:46.585342 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.586117 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.588201 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.599834 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:46.606863 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:46.588939 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:46.574210   720 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10.
I20260709 13:12:46.617600 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.605255 28655 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:46.621457 28650 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:46.624460 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:46.625308 28647 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:46.626946 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:46.627610 28726 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.634233   618 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:46.634939   618 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.635296   618 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.638756   412 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:46.639423   412 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:46.641379   750 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:12:46.648736 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.618119 29260 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.658880 29256 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
W20260709 13:12:46.659605 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.668399 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 79594.8us
I20260709 13:12:46.677667 28651 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:46.684468 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.685487 28572 raft_consensus.cc:2393] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 7: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:46.688591 28574 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.690135 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:46.691834 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.695452 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:46.581406   711 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.679698   606 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:46.700529 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 192041us
I20260709 13:12:46.707348   658 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:46.722141 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.724452 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:46.729322 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.729735   445 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:46.730365   445 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.731792   621 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.737587 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:46.738313 28724 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.738504   711 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:46.726987 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.742884 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:46.747027 29258 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:46.708459   606 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:46.746873 29259 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:46.754498 28726 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:12:46.749779 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.757838 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.764421 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.775398 28574 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:46.728340   658 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.772619 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.785439 28721 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:46.776351 28722 raft_consensus.cc:2368] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:46.784893 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:46.770421   606 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.773806   711 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.804880 28578 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:46.783198   658 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.758002   526 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:46.810200 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:46.810628 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:46.807009 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 105268us
I20260709 13:12:46.812101 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.812836 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:46.811306 29259 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 7.
I20260709 13:12:46.823556 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.824086 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.826112 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.822798   469 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:46.856181 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 66917.7us
I20260709 13:12:46.861124   683 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:46.861637   683 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.861989   683 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.863737   574 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.849419 29252 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
W20260709 13:12:46.865324 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 52632us
I20260709 13:12:46.866252 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.868284 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:46.877164 28724 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:46.820547   607 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.879105 29257 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:46.879155 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:46.881734 28577 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:46.824975   519 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:46.874410   644 consensus_meta.cc:287] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.010s
I20260709 13:12:46.885860 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:46.826581 32758 consensus_meta.cc:287] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.007s
I20260709 13:12:46.886837 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:46.902411 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 162302us
I20260709 13:12:46.905735 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.884707   607 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.918489 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:46.920369 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.896000   443 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:46.917869 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 58292.4us
I20260709 13:12:46.932940   574 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.932610 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:46.935133   526 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:46.936936   526 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:46.937513   526 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:46.937721   412 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:46.938589   526 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.940395   412 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:46.915006   607 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.933177 29252 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:46.895565   519 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:46.914956   580 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.949390 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.940971 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:46.981902 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:46.950551 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:12:47.016407 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.019271 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.021356 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:47.022173 29257 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.023896 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:46.970620   758 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:12:46.902911   644 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:46.951910   719 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:46.949688 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:47.020390   412 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:47.027581 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 77962.7us
W20260709 13:12:46.985088   749 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.524s	user 0.003s	sys 0.000s
I20260709 13:12:47.030962 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:46.950623   443 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:46.980705   748 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.475s	user 0.002s	sys 0.000s
I20260709 13:12:46.969831   621 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:46.978516   752 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.519s	user 0.003s	sys 0.000s
I20260709 13:12:46.981297   637 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:46.986903   416 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:47.040493 29255 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
W20260709 13:12:47.005738   751 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.545s	user 0.006s	sys 0.000s
I20260709 13:12:47.041582 29259 pending_rounds.cc:85] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 10
I20260709 13:12:47.047636 29259 pending_rounds.cc:107] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:12:47.047945 29259 raft_consensus.cc:2889] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:47.050787 29260 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:47.051702 29253 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:46.952309   683 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.032536 29254 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
W20260709 13:12:46.969831   727 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:47.043478 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:46.960000   519 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:46.962519   580 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:47.004712   615 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 13:12:46.970307   607 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.040037 32592 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:47.042280 32563 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.037837   443 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.029932   657 raft_consensus.cc:2764] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:12:47.047502   469 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:47.053445 29251 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:47.066290 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.077451 28578 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:47.077651 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.078708 28579 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:47.046332   412 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:47.068917 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:47.069268 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.069941 29255 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:47.037456 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:47.045241   416 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:47.083739 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.089203 28577 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:47.087682 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.085561 28547 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:47.083134 32592 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:47.095110 32592 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.095731   683 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.096393 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.096565 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.097470   629 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.096506 29255 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:47.110860   607 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.115026   644 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.115202   606 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.083912   469 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:47.116860   469 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.117466 29252 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:47.119985   445 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.070518   580 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:47.126462 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 238172us
I20260709 13:12:47.073580   574 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:12:47.140940 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 206287us
W20260709 13:12:47.141469 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 56000.5us
I20260709 13:12:47.142529 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.137112 29257 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:47.067474   637 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.150681 29258 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:47.152341 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:47.150317 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:47.073376   615 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:47.161796 28653 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:47.159211 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:47.084292   618 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:47.172375 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:47.162358   619 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:12:47.174778 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.154271   519 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:47.177544   519 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.179008 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.179407   574 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:47.179870   519 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.180822 28580 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:47.181778   416 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.182924   416 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.185181 28581 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:47.187512   637 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.190033   618 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.195230   443 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.153821 32563 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:47.197862 32563 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.198320 32563 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:47.149168   691 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:47.170253 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:47.201623 28653 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.229799 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:47.230697 29252 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:47.199970   469 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.125295   412 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:47.233870 29258 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:47.234086   443 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:47.234898 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:47.235816 29256 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:47.238161 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:47.238492 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:47.232929   469 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.248757 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:47.250257 28651 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:47.156510   658 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:47.238008   752 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:12:47.214529   526 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:47.259102   526 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.259513   526 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:47.261293 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:47.255625 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:47.237510   352 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:12:47.257417 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:47.266793 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.238193   691 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:47.273651 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.215685   619 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 13:12:47.279947 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 193291us
I20260709 13:12:47.306739 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:47.262732   443 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.268734   469 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:47.311582 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:47.314316 32758 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.317482 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:47.329603 28725 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.318645 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:47.333575   691 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:47.321174   711 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:12:47.335368   711 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:47.336381 29254 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:47.321324   772 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:47.339453   772 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:47.340746   772 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:47.346576   615 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.278916   721 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:12:47.348939   770 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:47.349742   615 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:12:47.312530 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55235.5us
I20260709 13:12:47.355587 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:47.366365 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.367522   637 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.367980 28653 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:47.368310 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:47.370819   526 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:47.373474 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:47.372395   637 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.398128 28581 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:47.402138 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:47.398711 28581 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:47.354432 28695 connection.cc:256] RPC call timeout handler was delayed by -1.0263339640000595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 13:12:47.406622 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:47.321382   469 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:47.417168 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:47.324177   606 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.415525 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.424916 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:47.425839 28653 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
W20260709 13:12:47.428949 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51438.9us
I20260709 13:12:47.430136 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.415184   519 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:47.433434   519 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.434072 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:47.434386 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:47.434514 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:47.434985 28649 raft_consensus.cc:2368] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
I20260709 13:12:47.435645 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:47.433423 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:47.436336 28647 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.435112 28722 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:47.437268 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:47.435177 28651 raft_consensus.cc:2376] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11. Re-sending same reply.
I20260709 13:12:47.439431 28579 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:47.327275   443 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.436226 28655 raft_consensus.cc:2376] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10. Re-sending same reply.
I20260709 13:12:47.438272 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:47.445854 28725 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:47.376358   615 consensus_queue.cc:1243] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:47.448127 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:47.456943 28574 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.440223 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:47.453712 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.422295 32758 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.428637   711 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:47.382462   580 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.435470   770 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:47.473245 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:47.481528 29258 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:47.484395 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:47.485255 28651 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:47.486183 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:47.464207   720 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.493453 28647 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:47.469048   637 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:47.468621   769 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.489429 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:47.488004 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:47.500087 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:47.501168 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:47.504931 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:47.506423 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 183666us
I20260709 13:12:47.491092 28581 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.514462 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:47.518797   766 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.516465   469 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.519476   766 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.521582   766 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.522042 32592 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.522217   526 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:47.523310   768 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:47.523854   768 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:47.524005 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.524385   768 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.525743 28574 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:47.524288 28581 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.528084   487 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:47.529165   445 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.477420   770 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.530310   745 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.530872   745 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.533967 28581 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:12:47.534354 28581 pending_rounds.cc:85] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 9
I20260709 13:12:47.534655 28581 pending_rounds.cc:107] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:12:47.534889 28581 raft_consensus.cc:2889] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:47.537354   773 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:47.538036   773 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:47.538574   773 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:47.543274 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 190665us
I20260709 13:12:47.544838 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:47.546267 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 172935us
I20260709 13:12:47.547317 28620 leader_election.cc:400] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:47.548029   774 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.548382 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.552429 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:47.553215   580 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.553653 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:47.559551 29258 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:47.474725   621 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:12:47.556262   519 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.562258 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.560998 28572 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.555059   658 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.553907   443 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:47.536598 32563 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.518980   637 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:47.565591 28696 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:47.567296 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 76609.6us
I20260709 13:12:47.532930   745 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.596220 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.571722 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:47.571271 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:47.602836 29256 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.603178 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:47.604815 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:12:47.563058   352 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:12:47.548851   774 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:47.602418 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:47.610003 28654 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 12: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:47.611039   637 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.612136 32563 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.607160   691 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:47.613073   691 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:47.613354 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65120us
I20260709 13:12:47.615249 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.613497   691 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.608377 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:47.567181   766 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:47.564302   373 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.615697 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:47.568096   526 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:47.606513   412 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:47.562690   779 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:12:47.606884   629 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:47.747351 28572 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:47.703490 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:47.753134 29252 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:47.637639 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:47.661645 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46516.8us
W20260709 13:12:47.756107 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52713.9us
I20260709 13:12:47.660876 28724 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
W20260709 13:12:47.759709 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 232878us
I20260709 13:12:47.664058 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:47.767230 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 103251us
W20260709 13:12:47.773419 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 162610us
W20260709 13:12:47.666023   777 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:12:47.677582   618 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:47.732246   658 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:47.691318 32563 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:47.677654   616 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:47.723739   720 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:47.754190   526 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.774641   606 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:47.785681 28696 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:47.775785 28621 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:47.754462   412 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.786692 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:47.786180 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 285074us
I20260709 13:12:47.655987   721 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.660609   416 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:47.676496   770 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:47.800665   616 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:47.774451 32592 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:12:47.786692   574 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:47.829293 29224 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.789428 29256 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:47.789163   658 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:47.791790 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 154825us
I20260709 13:12:47.822314   606 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.638592   785 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:47.839604 28546 leader_election.cc:400] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
I20260709 13:12:47.840122 28546 leader_election.cc:403] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:47.765967   519 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:47.788997 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:47.843067 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 57451us
I20260709 13:12:47.700628 28475 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:47.759327   629 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:47.791280 29223 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:47.844627   615 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
W20260709 13:12:47.844928 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53732.7us
I20260709 13:12:47.821267   412 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:47.821842 28729 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:47.665164   780 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:47.787413   618 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:47.832265 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.821884   526 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:47.820935 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 212624us
W20260709 13:12:47.886947 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 54756.5us
I20260709 13:12:47.887284 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:47.870087   607 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:47.867831   711 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:47.885367   691 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:47.888583   711 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.872404 28475 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.847232   629 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.894439   691 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.830331 32563 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.841991   606 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:47.926005 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 150291us
W20260709 13:12:47.932137 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 77673.8us
I20260709 13:12:47.931396 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.885584   785 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:47.929883 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1328) took 1370 ms. Trace:
I20260709 13:12:47.845322   644 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:47.933494 29256 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:12:47.933796 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85899.6us
I20260709 13:12:47.883375   775 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:47.934531 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:47.935161 29259 rpcz_store.cc:276] 0709 13:12:46.559503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.027387 (+467884us) service_pool.cc:224] Handling call
0709 13:12:47.041346 (+ 13959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:47.063006 (+ 21660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:47.063044 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:47.081914 (+ 18870us) log.cc:844] Serialized 26 byte log entry
0709 13:12:47.440821 (+358907us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:47.440880 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.440963 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:47.929668 (+488705us) raft_consensus.cc:1685] finished
0709 13:12:47.929688 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:47.929822 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":293724,"threads_started":1,"wal-append.queue_time_us":433379}
I20260709 13:12:47.895020   711 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:47.892966   745 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:47.895049   691 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.847018   769 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:48.034425 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 99903.9us
I20260709 13:12:47.981943 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.036716 28696 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:48.037416 28572 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
W20260709 13:12:48.014912 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 83603.9us
I20260709 13:12:48.013396 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.041429 28574 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:47.937999   580 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:48.015919 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:47.937386   519 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:47.937404   644 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:47.937403   785 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:47.939337   607 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:47.989323   779 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:47.990665   574 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:48.089193 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.053436   644 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.093290 28475 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 8, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 8 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:48.110394   797 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:12:48.044445   469 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 13:12:48.134387   793 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 13:12:48.135906   794 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:12:48.057852   745 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:48.262776   745 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.265796 32563 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.248649   772 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:48.094252   658 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:48.269541   772 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:48.270143   772 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.271744   658 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.273326 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:48.273985 28649 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:48.053278   785 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:48.275329 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:48.054993   580 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:47.939441   618 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.282507 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:48.282829 28655 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:48.284013 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:48.284624 28650 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.286334   574 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.017048   775 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.290894   775 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.054736   621 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:48.060871 28580 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:48.050982   770 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:48.293218   770 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:48.293634 28477 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 389) took 24633 ms (client timeout 15000 ms). Trace:
I20260709 13:12:48.018272   720 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:48.235955 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 254697us
I20260709 13:12:48.051393 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:48.246101 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:48.257507 28475 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:48.259656   773 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.006s
I20260709 13:12:48.259371   607 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.245251   619 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:12:48.248935   768 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.007s
I20260709 13:12:48.293733   770 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:48.298048 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52057.9us
I20260709 13:12:48.169535   519 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.296236   580 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:48.303552   644 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:48.304427 29252 consensus_meta.cc:287] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.001s
I20260709 13:12:48.306070 28650 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:48.348366 29252 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:48.309346 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:48.344926 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 293305us
I20260709 13:12:48.311120 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:48.313136 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:48.349581 28648 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:48.270466   795 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:48.251436   790 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.218s	user 0.005s	sys 0.001s
I20260709 13:12:48.325699   619 consensus_queue.cc:1243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:48.326520 28475 catalog_manager.cc:5697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 11, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 11 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:48.327798   789 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:48.294190 28477 rpcz_store.cc:269] 0709 13:12:23.660506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.687185 (+1026679us) service_pool.cc:224] Handling call
0709 13:12:48.293381 (+23606196us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:45.188526 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:45.246126 (+ 57600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:45.246159 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:12:45.246171 (+    12us) tablet.cc:662] Decoding operations
0709 13:12:45.246910 (+   739us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:45.246960 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:45.246983 (+    23us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:12:45.247550 (+   567us) tablet.cc:701] Row locks acquired
0709 13:12:45.247571 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:45.247729 (+   158us) write_op.cc:270] Start()
0709 13:12:45.247845 (+   116us) write_op.cc:276] Timestamp: P: 1783602765247674 usec, L: 0
0709 13:12:45.247860 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:12:45.256487 (+  8627us) log.cc:844] Serialized 2439 byte log entry
0709 13:12:45.910153 (+653666us) op_driver.cc:464] REPLICATION: finished
0709 13:12:45.914642 (+  4489us) write_op.cc:301] APPLY: starting
0709 13:12:45.914775 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:46.224775 (+310000us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b18003e96e0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a27b550ec 00007f4a27ba1c0a 00007f4a27ba14f7 00007f4a27ba1490 00007f4a27b4c754 00007f4a2b86cf13 00007f4a2b86d532 00007f4a2b8b4b93 00007f4a2b761de3
0709 13:12:46.390427 (+165652us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:46.390484 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:46.623405 (+232921us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:46.623775 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:12:46.623840 (+    65us) write_op.cc:312] APPLY: finished
0709 13:12:46.624359 (+   519us) log.cc:844] Serialized 65 byte log entry
0709 13:12:46.624617 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:46.624844 (+   227us) write_op.cc:454] Released schema lock
0709 13:12:46.624911 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:46.625807 (+   896us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:46.625850 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2555706,"reported_tablets":40,"spinlock_wait_cycles":36608,"child_traces":[["op",{"apply.queue_time_us":3961,"apply.run_cpu_time_us":19973,"apply.run_wall_time_us":710942,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29195,"num_ops":6,"prepare.queue_time_us":642717,"prepare.run_cpu_time_us":150642,"prepare.run_wall_time_us":643069,"raft.queue_time_us":49284,"raft.run_cpu_time_us":1154,"raft.run_wall_time_us":5680,"replication_time_us":662102,"spinlock_wait_cycles":232111360,"thread_start_us":875546,"threads_started":4,"wal-append.queue_time_us":542594,"wal-append.run_cpu_time_us":8851,"wal-append.run_wall_time_us":1808972}]]}
I20260709 13:12:48.239388   691 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:48.346154 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.307265 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:48.315900 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 271076us
I20260709 13:12:48.328641   773 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:48.321501   621 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:48.322633   412 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:48.329339 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 292712us
I20260709 13:12:48.360497 28475 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 10, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 10 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.364720 28654 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:48.344079   802 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:48.392942 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:48.321421   720 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:48.396821 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:48.394809 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:48.400293 28475 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 9, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 9 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.405071 28655 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:48.405884 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:48.409701 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:48.387727   621 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.408283 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:48.337448   768 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.420022 28620 leader_election.cc:400] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:48.424767 28475 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 7, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 7 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.396852   814 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:48.387913   691 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.359220   795 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.413640   711 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:48.412437   621 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.417958 32563 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:48.422966   487 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:48.387801   789 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:48.454229   412 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:48.411844   805 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:12:48.436297 28475 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 9, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 9 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.456946   785 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.457118   606 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:48.458336   629 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.006s
I20260709 13:12:48.458712   644 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:48.458745 32563 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:48.460830   795 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.443724   619 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:12:48.449244   487 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:48.515530   789 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:48.515811   487 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:48.468098 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:48.521327 28652 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:48.471108   773 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:48.438293   416 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:48.424029   745 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 13:12:48.500496 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 191222us
I20260709 13:12:48.505788   629 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:48.527015   616 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:48.501557   526 consensus_meta.cc:287] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.009s
I20260709 13:12:48.531112   606 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.528455   526 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.536031   526 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.542155   789 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:48.501910 28475 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 8, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 8 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:48.546739   789 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:48.508528 32563 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:48.506254 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 103408us
I20260709 13:12:48.542675   773 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:48.542970 28695 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11.
I20260709 13:12:48.541759   416 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:48.579758   416 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.583717   803 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.584327   803 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.586841   803 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.576174 28724 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:48.515149   618 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.602771   691 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.604476   720 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:48.608193 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.608455 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.608978   443 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:48.609716 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:48.612249   787 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:48.609750   443 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.618031   443 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:48.619995   443 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:48.620469 28573 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:48.549379 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:48.626410 28574 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:48.569902 28652 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:12:48.570458 28695 leader_election.cc:403] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:48.574972   629 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:48.623313 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:48.633846 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 84604.6us
I20260709 13:12:48.632561 28653 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:48.576140 28649 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:48.577648   789 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.547797 28475 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 7, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 7 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:48.594282 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.596565   644 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.598640 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:48.545924   772 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.599581   445 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:48.600169 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:48.600224   613 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:48.601464 29252 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:48.601797   768 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:48.635264 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 218248us
W20260709 13:12:48.636160 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 203363us
I20260709 13:12:48.634929 28620 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:48.649559 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 106774us
I20260709 13:12:48.672674 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:48.673309 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:48.650032 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:48.674281 29258 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:48.641479 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:48.654598 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:48.675670 29260 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 8: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:48.649897 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:48.661741 29253 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.641906 28475 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 9, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 9 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:48.620512   443 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.684882   613 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.687899 28573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:48.649405   773 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11.
I20260709 13:12:48.689492   772 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.691004   811 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:48.638031   806 raft_consensus.cc:2764] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:12:48.693399 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.696380 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:48.687498 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52645.3us
I20260709 13:12:48.717146 28650 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:48.698920 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:48.719472 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:48.719686 28573 raft_consensus.cc:606] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:12:48.699762 28696 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:48.720927   711 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:48.721525   711 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:48.722007   711 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.724440 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.724781   637 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:48.725064 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.725288 28726 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.725800 28729 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:48.726073   526 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:48.726593   526 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:48.727530   526 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.730553 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.731604 28721 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:48.701593 29253 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
W20260709 13:12:48.702351 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 66245.3us
I20260709 13:12:48.655231   392 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:48.689360   768 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:48.691643   629 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.733623 28647 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.733872   629 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.736089   629 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.737144 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:48.737865 28650 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:48.738472 28652 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:12:48.739029 28650 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: [9.9-11.11]
I20260709 13:12:48.739995 28654 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 13:12:48.741586 28653 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:48.714656 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:48.715453 29258 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:48.741405 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:48.742600   823 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.707015 28475 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 12, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 12 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.743484 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:48.741902   711 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.743899 28475 catalog_manager.cc:5697] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 8, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 8 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:48.748498 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.745309   823 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:48.747409 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.751160 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.754047 28730 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:48.754073 28647 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:12:48.755419 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.757402 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.758111 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.759531 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.741955 28726 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:48.748792 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.747786 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.747416   711 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:48.761569 28724 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:48.761629 28721 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.762467 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:48.761045 29253 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:48.761927 29258 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:12:48.750847 28475 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 9, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 9 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.766333 29260 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:48.699702   580 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:48.770195 28729 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:48.765540 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:48.766889 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:48.705430   373 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:48.703096   805 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:48.777519 28649 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:48.682035   810 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:12:48.671237   644 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.771155 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:48.782513 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:48.782701 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.782262 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.685387   445 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.792479 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:48.793361 29260 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:48.789614 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.794472 28574 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:48.796906 28574 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:48.765869   768 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:48.799064 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.777771   373 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:48.804615 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.795827 28475 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 9, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 9 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:48.814795 28475 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 8, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 8 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:48.770531   811 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:48.773970   789 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:48.816469 29256 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:48.817248 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.817847 28574 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:48.766551   619 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:12:48.788720   773 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.832363 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:48.832618 28723 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:48.833118 29260 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.828255 28724 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
W20260709 13:12:48.837059 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.795579 32563 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.840693 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.778343   606 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:12:48.859021 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:48.864214 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:48.860270 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 89206.5us
I20260709 13:12:48.813870   373 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.782927   772 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:12:48.872135 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.784983   580 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.872829 28475 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 10 to 11, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 11 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.871667 29224 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:48.874540 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:48.894297 28724 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:48.895447   809 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.896054   809 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.896814   487 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.898350   809 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.898940   487 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:48.899175   768 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.877825   804 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:48.905242 29259 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:48.863099 32563 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.908180 32563 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:48.891398   721 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:12:48.910914   580 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:48.912062   613 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:48.875267   519 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:48.911978   811 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.914352   644 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:48.914695 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.891100 28475 catalog_manager.cc:5697] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 9, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 9 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:48.879428 28574 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
W20260709 13:12:48.927095 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.922528 28475 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 11, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 11 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:48.937399 29260 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
W20260709 13:12:48.938378 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63999.5us
I20260709 13:12:48.938939 28574 pending_rounds.cc:85] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 9
I20260709 13:12:48.939236 28574 pending_rounds.cc:107] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:12:48.939491 28574 raft_consensus.cc:2889] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:48.939643 28578 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:12:48.939855 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.941960 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:48.942013 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:48.940532 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 69025.8us
I20260709 13:12:48.941545 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:48.792833   805 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.946734 28475 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:48.948521 28721 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:48.945817 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:48.825037   621 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:48.953895 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:48.955889 28572 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:48.956213 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:48.946642 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:48.957661 28578 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:12:48.958379 28581 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:48.949962 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:48.960029 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.960253 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:48.969790 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:48.969183 28475 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 9, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 9 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.948151   412 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:48.971973 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:48.975819 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:48.954962   644 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:48.978946 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:48.979332 28475 catalog_manager.cc:5697] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:12:48.983422 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.980425 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.984820 28572 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:48.959921 32563 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:48.998142 28578 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:49.022470 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:48.968931   824 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:49.029186   835 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:12:49.032558   830 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:12:48.954905   613 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:12:48.968375   469 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:48.978291   445 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:49.047879 28475 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 8 to 9, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 9 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:48.976362   519 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:48.982484   644 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:49.035104   777 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.068s	user 0.006s	sys 0.000s
I20260709 13:12:49.021356   412 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:49.023967   619 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:49.040618   824 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:49.056792 28475 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 6, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 6 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:49.043643 28620 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.851s (SENT) [suppressed 7 similar messages]
I20260709 13:12:49.060194   836 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:49.040495 32563 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:49.056958   469 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:49.058115   644 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.093992   469 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:49.094992   373 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.097609   785 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:49.097829   519 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.099007 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.099682   616 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.100662 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.081285 28722 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:49.065368   443 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:49.083176   829 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:12:49.089282 32563 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:49.080549   824 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:49.087070 28475 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 8, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 8 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:49.112340 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.113344 28726 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:49.113067 28475 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 7, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 7 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:49.092895   805 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:49.110073   770 consensus_meta.cc:287] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.000s
W20260709 13:12:49.133386 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.137037 28655 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:49.129179   412 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:49.140982 28475 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:49.158351 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52975.1us
I20260709 13:12:49.199671 28577 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:49.201953 28576 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:49.147913   373 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:49.203800 28655 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:49.204768 28572 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:49.184234   618 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 13:12:49.262802 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49036.4us
I20260709 13:12:49.131052   770 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.263860 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:49.264715 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 221089us
I20260709 13:12:49.268388 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:49.269834 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:49.272913 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 303175us
I20260709 13:12:49.213526   721 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.273787 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:49.216570   621 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:49.274068 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:49.277797 28725 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:49.280539 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:49.282779   802 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.285089   802 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:49.286026   720 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:49.286584   720 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:49.287657 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:49.269886   629 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:49.289974 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:49.292888   826 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:49.294062 32592 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:49.290385   373 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:12:49.295742   443 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.296268   443 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.297158 32758 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.278398   809 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.278827   469 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:49.308327 28654 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:49.308393 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:49.306505 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:49.310874 28651 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:49.287333   785 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.312023   785 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:49.309942 32758 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.273397   775 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:12:49.307325 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:49.288550   795 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:49.314826 29255 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:49.317351 32758 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:49.318711 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:49.320156   773 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:49.324359   443 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:49.325253 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.326102 28730 raft_consensus.cc:2410] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:12:49.326318 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.290601   800 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:49.327078   795 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:49.331037 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:49.334017 28652 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:49.280000   721 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.335165   795 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:49.350620   773 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:12:49.351181   789 consensus_meta.cc:287] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.512s	user 0.000s	sys 0.009s
I20260709 13:12:49.327302   519 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:49.352432 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 80766.4us
I20260709 13:12:49.386291 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:49.290321   720 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:49.394716 28728 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:49.397469   859 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:49.398102   859 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:49.399047   859 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:49.404215 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 47735.3us
I20260709 13:12:49.406946 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:49.408072 28726 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:49.353231   773 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:49.411716 28649 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:12:49.403137   373 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:12:49.395466   770 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:49.409330   720 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:49.413717   526 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:12:49.446463   768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.032s	sys 0.034s
I20260709 13:12:49.417572   806 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:12:49.459967   373 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:49.460501   373 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:49.410887   644 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.395954   519 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:49.464710 29260 raft_consensus.cc:2410] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:12:49.456632   768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.032s	sys 0.034s
I20260709 13:12:49.416970   392 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:12:49.477679 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.479339   519 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:49.481612 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.482643   644 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:49.456550   770 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:12:49.487762 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:49.488670   770 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:49.489108   770 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:49.490036   770 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.491369   770 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.466531   580 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.492370   580 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.494944 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:49.495067 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:49.495632 28728 raft_consensus.cc:2376] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9. Re-sending same reply.
I20260709 13:12:49.496881 29259 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:49.497488   862 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.500036 29223 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:49.501216   773 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:49.501837   487 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:49.502128   629 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.502449   487 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:49.502646   773 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:49.502674   629 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.503505   487 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.505057   629 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:49.505954 28650 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:49.453917   526 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:49.474858 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.506716 28574 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:12:49.519268   526 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.520467   526 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:49.508268 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:49.509095 28728 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:49.521615 28728 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:49.522495 28728 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.523473 28728 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.524011   580 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:49.508944 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:49.510418 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:49.526682 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:49.530058 28650 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: [9.9-11.11]
I20260709 13:12:49.510560 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:49.511425   789 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:49.446983   858 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:12:49.496557   824 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.539382 29251 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:49.517429   809 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:49.518085 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.536461   775 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:49.537416   858 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:49.547809   392 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:49.548188   836 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:49.548508 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.548934   392 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:49.549329   392 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:49.550076   392 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:49.551313   392 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:49.553200 28580 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:49.538116 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:49.538314   862 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:49.463050   373 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:49.540352   580 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.556957 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:49.573706 28722 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.548780   836 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:49.557758 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:49.558336 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:49.553941 28573 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:49.582298 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:49.585045 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 51033.2us
I20260709 13:12:49.620613 28647 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:12:49.723811 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 164770us
I20260709 13:12:49.718889 28722 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:49.724718 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.619607 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:49.618268 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:49.731410 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.746038 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 127901us
I20260709 13:12:49.747006 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:49.553743   721 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:49.743692 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:49.749984 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:49.750125 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 130620us
I20260709 13:12:49.756881 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.766989 28728 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:12:49.767472 28728 pending_rounds.cc:85] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 10
I20260709 13:12:49.767758 28728 pending_rounds.cc:107] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:12:49.768110 28728 raft_consensus.cc:2889] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.714634   804 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.543278   618 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.211s
I20260709 13:12:49.743609   616 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.756011   373 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:49.585844   775 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.192s
I20260709 13:12:49.783700 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:49.767815   800 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:49.759202   809 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.772890   848 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:12:49.786155   814 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:12:49.775906   863 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:49.650269   580 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.796362   800 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.795450   745 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:49.787429   616 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:49.810416 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 67595.1us
I20260709 13:12:49.782401   804 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.804351   848 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:49.811786   800 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:49.839984 28575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:49.840683 28575 raft_consensus.cc:606] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:49.809540   629 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:12:49.810909   867 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:49.799613   769 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:12:49.846036 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 94131.4us
I20260709 13:12:49.853950 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:49.832274   745 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:49.863412   616 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:49.863570   580 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:49.866091   804 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:49.868680   745 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.871181 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1355) took 1243 ms. Trace:
I20260709 13:12:49.856907   824 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:49.837157   871 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:12:49.877731   871 raft_consensus.cc:2764] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:12:49.871742 29257 rpcz_store.cc:276] 0709 13:12:48.627418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.637085 (+  9667us) service_pool.cc:224] Handling call
0709 13:12:48.641398 (+  4313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.767966 (+126568us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:48.945558 (+177592us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.945781 (+   223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:48.945838 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:48.945902 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.870853 (+924951us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400327b54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:49.870923 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.871104 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16545,"prepare.queue_time_us":281819,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3431,"raft.queue_time_us":739,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7439,"spinlock_wait_cycles":290501504,"thread_start_us":151875,"threads_started":1}
I20260709 13:12:49.889254 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1602) took 1128 ms. Trace:
I20260709 13:12:49.889775 29251 rpcz_store.cc:276] 0709 13:12:48.760409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.968297 (+207888us) service_pool.cc:224] Handling call
0709 13:12:48.968583 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.539803 (+571220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.888928 (+349125us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54006b8ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:49.889166 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312251264}
W20260709 13:12:49.915910 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 358186us
I20260709 13:12:49.840444   848 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:49.919078 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 160301us
I20260709 13:12:49.920177 28696 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:49.925444 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 71574.8us
I20260709 13:12:49.929636 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:49.932605 28574 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:12:49.930034   795 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.004s
I20260709 13:12:49.953389 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:49.938411   392 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:12:49.956074   773 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:49.969806   868 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:12:49.972064   526 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:49.931371   867 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:49.973507   867 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:49.972750   526 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.974701   867 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:49.982695 28650 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:49.985033 28650 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:49.995469 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:49.998453 29257 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:50.005625 28724 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:49.986049   805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.019s	sys 0.020s
I20260709 13:12:50.009742 28656 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:12:50.017546 29257 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:50.018568 29260 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:50.018725 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:50.019153 28649 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:12:50.008932   805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.020s	sys 0.021s
I20260709 13:12:49.990371 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:49.962191   870 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:12:50.019984 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:50.030761 29251 raft_consensus.cc:2368] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
I20260709 13:12:50.025570 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:49.957223   866 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:50.032886 28574 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:12:50.025725   770 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.529s	user 0.014s	sys 0.000s
I20260709 13:12:50.039431   526 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:49.984899   871 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:12:49.956512   795 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.032749   618 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:49.949172   800 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.021507   629 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:12:50.025731   373 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:12:50.061189 28726 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:50.062557   871 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:50.063040   871 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:50.064075   871 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.086606 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.066965   800 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:50.068245   373 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:50.096524 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:50.070488 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:50.074062   795 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.075134 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 1996) took 1351 ms. Trace:
I20260709 13:12:50.075587   770 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:50.077394 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:50.101882 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:50.099125 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:50.104204 29224 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.077914 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:50.079329 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:50.080103   836 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.080946   858 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:50.108150 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:50.082474 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:50.083108 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:50.108968 28576 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:50.098003 28725 rpcz_store.cc:276] 0709 13:12:48.723434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.724363 (+   929us) service_pool.cc:224] Handling call
0709 13:12:48.724616 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.278201 (+553585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.074918 (+796717us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54000d61d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:50.075076 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271660800}
I20260709 13:12:50.106936 28574 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.110554   858 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:50.114800   858 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.116178   858 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.116427 32563 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.117062 32563 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.119140 32563 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:50.085696   871 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:50.121752 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:50.122859 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.123029   836 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:50.128145 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.100522   580 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.095860   373 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:50.110857   443 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:50.107827   613 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.110999   621 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:50.209678 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 213637us
I20260709 13:12:50.203722   580 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.202219   443 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.213622 28725 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:50.202152   691 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.203701   397 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.201767   745 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:50.219604 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.220913 28722 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:12:50.234202 28722 pending_rounds.cc:85] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 7
I20260709 13:12:50.234578 28722 pending_rounds.cc:107] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:12:50.234879 28722 raft_consensus.cc:2889] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:50.235260 28722 pending_rounds.cc:107] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:12:50.235586 28722 raft_consensus.cc:2889] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:50.215749 32592 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.223955 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:50.218225 28730 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:50.236552 28574 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:50.213610   800 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.247138 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:50.217101   443 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:50.204851   613 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.253717   880 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.257624   880 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.259814   880 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.228415   629 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.251107 32563 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:50.235064   691 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:50.302583 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.245963 32592 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.305670   807 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.245426   397 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.306349   691 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:50.306317   807 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.307101   691 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:50.308467   397 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.309608 28729 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:50.309648 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:50.306986 32592 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.296837   770 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.313463   580 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:50.313100   621 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:50.313695   770 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.316085   904 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:50.294971   373 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.319002   613 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:50.295944 32563 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.320823 32563 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:50.321735   889 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:12:50.288070   891 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:50.323329   891 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:50.323776   891 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:50.287632   629 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.327519   629 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.316641   770 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:50.243844   745 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.332751   745 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:50.333134   855 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.045s	user 0.000s	sys 0.014s
I20260709 13:12:50.253824   800 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:50.353056   854 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.069s	user 0.006s	sys 0.008s
I20260709 13:12:50.353796   800 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:50.359206   853 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.075s	user 0.004s	sys 0.016s
I20260709 13:12:50.362340 32758 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.363113 32758 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.365399 32758 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:50.302631 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.365784   621 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.366245 32758 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.366376   621 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.366854 32758 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.368692 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.368934   792 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.369364 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.368624   895 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.368681   621 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:50.370143   895 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.371150 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.372149 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.372398   895 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:50.373888 28647 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:12:50.374017 32758 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:50.375715   800 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:50.377979 32563 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:50.365694 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.384776 32563 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.385885   800 consensus_queue.cc:1243] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:50.386370   766 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:50.386718   766 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:50.387547 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.387480   766 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.388552   766 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.392329   849 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:50.395520   789 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:50.365319   810 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:50.396552   810 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.398702   810 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:50.369545   792 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.400552   373 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.402168   792 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:50.405356 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:50.405977 28578 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:50.410758 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:50.413335 28578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:50.414001 28578 raft_consensus.cc:606] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.414506 28578 raft_consensus.cc:614] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:50.415863 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.420156 29257 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:50.422101 29256 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:50.436081 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:50.436442 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:50.438692 29258 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:50.308851   807 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.441522 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.442262 28696 leader_election.cc:400] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
I20260709 13:12:50.442346 29253 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:50.442855 28696 leader_election.cc:403] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:12:50.448071 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 310088us
I20260709 13:12:50.448624 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.449278 29255 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:50.452225 29260 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:50.451725 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.457194 29252 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:50.459683 28696 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:50.460477 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.465620 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.461328 29255 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:50.437407   580 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.487238 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.484633 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.491047 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.492120 28726 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:50.451525   858 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:50.455557   863 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:50.451656   818 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 7. Current term is 8.
I20260709 13:12:50.455642   770 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.506454 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.503544 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.508395 29253 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:50.503772 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.514214 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.505183 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.515630 28730 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:50.506193 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:50.509737 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.501858   658 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:50.510598 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.524056 28654 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:50.526151 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:50.526927 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:50.508158   863 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.529125 29258 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:50.529435   863 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.529650   469 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:50.533699 28652 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:50.498473   580 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.536897   580 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:50.504527   800 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:12:50.538128   800 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:50.538522   800 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:50.539458   800 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.540724   800 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:50.455562   862 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:12:50.578758   862 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:50.579159   862 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:50.580036   862 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.438493   814 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:12:50.502391   795 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:12:50.497360   866 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:50.533550 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.542511   805 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:50.547770   658 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:50.556696 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:50.558964 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.586462 28581 raft_consensus.cc:606] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:50.566560 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.586812 28581 raft_consensus.cc:614] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:50.566879 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:50.568444 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.546002 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.596566 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.598950 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:50.581976   866 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.602581 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.541498   770 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.534266   881 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:12:50.608093 29258 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:50.614485 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:50.606385 29251 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:50.616496 29252 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:12:50.610061 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:50.588325   805 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:50.626269 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 366455us
I20260709 13:12:50.634498 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.605767   807 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:50.611479   866 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:50.600692   879 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:50.613085   769 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:50.628571   826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.335s	user 0.011s	sys 0.019s
W20260709 13:12:50.680814   826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.011s	sys 0.020s
I20260709 13:12:50.685283   877 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:12:50.687391   857 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:50.625422   905 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:50.688781   905 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.605923   806 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:12:50.689175   905 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:50.628103   580 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:50.693382   580 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.693794   580 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.628424   785 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:12:50.700515   770 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.647116 32563 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:12:50.702340   443 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.703783 29256 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:50.705091   848 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:50.636113 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.001s	sys 0.009s
W20260709 13:12:50.706773 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.001s	sys 0.009s
W20260709 13:12:50.707095 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 594231us
W20260709 13:12:50.651090 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 397947us
I20260709 13:12:50.708258 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:50.678143 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 43797.3us
I20260709 13:12:50.709030 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:50.709625 28581 raft_consensus.cc:606] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.709956 28581 raft_consensus.cc:614] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:50.601481   644 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:12:50.679345 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.679138   519 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.680125 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.637123   891 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.700624 28727 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:50.706360   862 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:50.629889   805 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:50.709956 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:50.647954   802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.006s	sys 0.005s
I20260709 13:12:50.678176   880 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:50.712741 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.704736   871 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:50.716769 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:50.718513 28727 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:50.722153 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.731415 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:50.732642 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.737412 28581 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:50.733583 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:50.676980   769 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:50.704917   443 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:50.741952 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:50.741875 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:50.719992   795 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.724030   807 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.748433 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.754024 29224 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.733035   871 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:50.740885 32758 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.738860   804 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.745951   769 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:50.775933 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:50.741101   857 consensus_queue.cc:1243] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:50.744113   770 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:50.732327 32563 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:12:50.697165   658 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.724129   519 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.732503   904 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:12:50.745862   879 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.749224   618 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:50.827852 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52013us
I20260709 13:12:50.816123   613 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:50.830258   469 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:50.826435   878 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:50.814733   848 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:50.825377 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50126.4us
I20260709 13:12:50.802842   770 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:50.780303   809 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:50.770812   616 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:50.814951   840 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:50.840781   775 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:50.841364   885 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:12:50.848591   863 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.766454   795 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.814528   894 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:50.834147   877 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.850664 28648 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:50.772186   807 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.798182   392 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:12:50.917196 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:50.917815 28573 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:50.806547   766 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:12:50.853631   526 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.925634   526 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.926867   848 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.927449   848 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.845515   891 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:50.835929   580 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.837738   871 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.838338   905 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.803103   721 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:12:50.750373   373 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:50.872852 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:50.864585   826 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:50.885829 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.900254 28725 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:50.900362 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:50.901968 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:50.902820 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:50.909384 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:50.909693 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.874100   613 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.915405 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:50.916335 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:50.882424   469 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.923476   805 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.912561 28727 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.923383 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.938784 28726 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:51.005272 28656 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:50.881487   879 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:50.995167 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:50.998600 29253 raft_consensus.cc:2368] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:50.898182   775 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.012387 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:51.018011 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:51.026521 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:51.001183 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 86895us
I20260709 13:12:50.968981   862 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.923583   769 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.031546 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.983505   373 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:51.038288 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:50.931170   877 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.041603 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:50.999502   613 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:50.969123   894 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.033660 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.053910 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:51.054371 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:51.062469 28724 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:51.067982 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:51.053804   928 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:12:51.041610   691 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:51.046371   373 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.001341   826 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:50.969336   770 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.087703   877 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.069476   881 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.069741   891 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:51.089668   937 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:51.089730   621 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:51.089735 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.073436   894 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.091194   469 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.092084   909 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:51.096050   927 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 13:12:51.097031   920 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:12:51.101826   931 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:51.103538   580 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.104771   795 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.072779   487 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:51.042353   862 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.090540   866 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.160888   894 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.139755   877 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:51.162081   769 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.161921   877 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.141299   881 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.166697 28547 leader_election.cc:400] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:51.167039 28547 leader_election.cc:403] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:51.167593 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:51.169346 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:51.170105 29253 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:51.173265 28653 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:51.175161 28721 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:51.128022 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:51.130234 28578 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:51.105463   691 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:51.134840 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45236.9us
I20260709 13:12:51.106227   848 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.118839   867 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.141180 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:51.126530 28725 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:51.157169   519 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.158644   826 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:51.158712   934 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:12:51.148242   766 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.131440   891 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.191636 28653 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:12:51.142267   792 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:51.187737 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.176229 28729 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.281910 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:51.424216 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:51.430570 28723 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:51.427603 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:51.430554 28577 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 5.
W20260709 13:12:51.416968   927 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:12:51.442489 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.353462   469 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.413075   857 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.255690   881 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:51.469142 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:51.470904 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.424331   805 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.435220   691 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.149348   909 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.482756 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:51.430209   866 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.479774 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:51.441310   879 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:51.265699   814 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.210s
I20260709 13:12:51.489224 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:51.445111   775 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.434542   766 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.435123   867 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.147856   937 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.489269   792 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.532068 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:51.474088   894 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.537976   616 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.539637   867 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:51.502874   877 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.485343   857 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.489074   487 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:12:51.528568   711 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.545241 28725 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:51.530745   580 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:12:51.549970   936 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 13:12:51.530493   637 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:12:51.583985   943 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:12:51.576709   862 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.600550 28729 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:51.601521 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:51.602451 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:51.580204   877 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:12:51.604346 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 72324.2us
I20260709 13:12:51.605803 29224 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.622501 29224 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.629554   766 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.621055   891 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.621208   711 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:51.633443   937 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.638885 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.641040 28728 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:12:51.641479 28728 pending_rounds.cc:85] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 10
I20260709 13:12:51.641698 28728 pending_rounds.cc:107] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:12:51.641911 28728 raft_consensus.cc:2889] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:51.625506   373 consensus_meta.cc:287] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.004s
I20260709 13:12:51.643998   373 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.620672   857 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:51.645349 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:51.649518   905 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.649763 28728 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:51.646358   373 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.651522   373 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.652030   373 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.654392   373 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.656409 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:51.659720   942 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:12:51.661643   871 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.661868 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.663097   904 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:51.645526   613 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 13:12:51.663650   904 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.663892   613 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.665925   904 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.666507   904 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:51.667107   904 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.648466   469 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9.
I20260709 13:12:51.646843 28724 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:51.643080 32758 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:51.674127   937 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.677062   848 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:51.675899   945 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:51.672849   613 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.683228   895 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.685228   895 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.685686   800 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:51.686156   800 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:51.681202   945 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.686965   800 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.687970   800 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.688134 28722 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:51.692651   615 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:51.693204   615 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:51.694093   615 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.695592   615 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.675519   691 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.703629   691 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.703698   770 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.704495 28574 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:51.688740   945 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:51.711066 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:51.716717   807 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.752270 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:51.762583 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:51.768348 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.772943 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:51.773906 28648 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:51.802435 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:51.807952 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2261) took 1093 ms. Trace:
I20260709 13:12:51.808400 28656 rpcz_store.cc:276] 0709 13:12:50.714713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.714825 (+   112us) service_pool.cc:224] Handling call
0709 13:12:50.730942 (+ 16117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.005737 (+274795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.807674 (+801937us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540001c2d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:51.807861 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630151040}
I20260709 13:12:51.797369   800 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:51.810606 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.797221   807 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.820848   807 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.821926 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:51.817777   909 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.820976 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:51.819859 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:51.835537 29257 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:12:51.837020 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:51.837850 29260 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:51.839761   840 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:51.833354 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:51.847695 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.861670 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:51.864161 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:51.873347 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:51.855262   745 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:51.840605   840 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.884127 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:51.853094   905 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:51.870432   810 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:12:51.882081 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.819885   800 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.861157   937 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.872068   766 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.860509   519 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:12:51.889501 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:51.876318   880 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:51.902293 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:51.924890 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:51.883774   745 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.926506   745 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:51.927047   948 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:51.927873   948 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.931813   948 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.934412   745 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.939771 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:51.941144 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.886539   810 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:51.949226 28547 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.951025   904 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:51.890151   905 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:51.958599   745 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.959290   871 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.960062   871 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.924438   880 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:51.957979   905 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.964327 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2264) took 1096 ms. Trace:
I20260709 13:12:51.964983 28647 rpcz_store.cc:276] 0709 13:12:50.867645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.867791 (+   146us) service_pool.cc:224] Handling call
0709 13:12:50.868282 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:50.970850 (+102568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:50.970896 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:50.981212 (+ 10316us) log.cc:844] Serialized 26 byte log entry
0709 13:12:51.061840 (+ 80628us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:51.061886 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.953729 (+891843us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54003b1854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:51.953796 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:51.953858 (+    62us) raft_consensus.cc:1685] finished
0709 13:12:51.953879 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.964232 (+ 10353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17921,"raft.queue_time_us":5483,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7889,"spinlock_wait_cycles":234703744,"thread_start_us":35149,"threads_started":1,"wal-append.queue_time_us":134669}
I20260709 13:12:51.966979   880 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:51.938005   807 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:51.974417 32563 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.975265 32563 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:51.977821 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:51.979522 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:51.982620 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:51.954669   909 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:52.034452 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.035336 29253 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:52.035602 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.035866 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:52.036427 29255 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:52.036587 29256 raft_consensus.cc:2368] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:52.037122 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:52.038957 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.039206 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.039886 29253 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:52.041375 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:51.983635   621 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:52.046454 29257 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:51.985035   745 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.030382   859 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:52.065493 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.024085   644 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:52.062423 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.063208 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.059139 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.047498   800 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.068159   863 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:52.072321 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.073364 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.074836 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:52.075460 32563 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.076371 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:52.077729 28572 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:52.094877   526 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:52.095976   840 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.081223   859 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.047394   621 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:52.100286 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.100576   621 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:52.102442 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:52.103039 28576 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.103379 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:52.104334   968 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:52.091662 28573 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
W20260709 13:12:52.107280   963 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:12:52.107875 28573 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:52.108319   966 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:52.019760   810 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.116420   745 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:52.117377   836 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:52.112425   880 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.125715   871 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.127893   859 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.128551   895 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:52.129038 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:52.120499 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:52.144657 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.150954 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1334) took 1443 ms. Trace:
I20260709 13:12:52.190011 28576 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
W20260709 13:12:52.190536 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 329863us
I20260709 13:12:52.203315 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:12:52.207481 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 339035us
I20260709 13:12:52.237300 28723 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.235658 28726 rpcz_store.cc:276] 0709 13:12:50.707500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.720765 (+ 13265us) service_pool.cc:224] Handling call
0709 13:12:50.721078 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.005637 (+284559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.150723 (+1145086us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001b8854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:52.150895 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499662080}
W20260709 13:12:52.239001 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 118634us
I20260709 13:12:52.239182 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.205919 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:52.213443 28728 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:52.235226 29255 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
W20260709 13:12:52.265166 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 44079.9us
I20260709 13:12:52.267897 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:52.268363 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:52.237537 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:52.204205   863 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:52.268477 28728 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:52.265666 28726 raft_consensus.cc:2410] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:52.146660   836 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.218542   526 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:52.326574 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.354502 29260 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:12:52.233493   807 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:52.274709   613 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.233290   770 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:52.327466 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 90032.2us
I20260709 13:12:52.278612   895 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:52.328982 28578 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:52.238929   658 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:52.332893 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2634) took 1142 ms. Trace:
I20260709 13:12:52.399502 28725 rpcz_store.cc:276] 0709 13:12:51.190680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.432608 (+241928us) service_pool.cc:224] Handling call
0709 13:12:52.288233 (+855625us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b54001caf54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:52.332820 (+ 44587us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148235136}
W20260709 13:12:52.334112 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67345.3us
I20260709 13:12:52.286033 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.328336 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:52.335474 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.339082 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:52.335006   519 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:52.357378 28727 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:52.238087   913 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.327844 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:52.395857 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.403330 28574 raft_consensus.cc:2368] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:52.355867 28723 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:12:52.405196 28575 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:52.411897 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.359133   948 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:52.355360   616 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:12:52.338187   711 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:52.360517   526 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.388844   807 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.421083   911 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.399268   770 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.408027   658 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.448429 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.447214   972 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:52.449718   974 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:12:52.450632   905 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:52.451223 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.451540   807 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:52.439584   766 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:52.453573   967 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:52.426640   871 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:52.454563   836 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:52.427981   948 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.457216 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:52.439893 28728 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:52.417546   913 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:52.467972 29258 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.016s	sys 0.033s
I20260709 13:12:52.469565 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:52.467377 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:52.454560   880 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.344444   863 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:52.482704 29258 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.016s	sys 0.033s
I20260709 13:12:52.502002 28727 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:12:52.457438   711 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:52.502947 28727 pending_rounds.cc:85] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 6
I20260709 13:12:52.462658   905 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:52.505282 28727 pending_rounds.cc:107] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:12:52.471639   766 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.505751 28727 raft_consensus.cc:2889] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:52.507576 28576 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:12:52.481202   658 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:52.475914   691 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:52.464076   972 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.514597   711 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.519327   644 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:52.509378   766 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:52.486428   871 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.514974 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2018) took 2510 ms. Trace:
I20260709 13:12:52.515494   863 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:52.515880   971 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:12:52.504238   615 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:52.533519 28727 rpcz_store.cc:276] 0709 13:12:50.004212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.004357 (+   145us) service_pool.cc:224] Handling call
0709 13:12:50.010956 (+  6599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.700530 (+689574us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54001dac20. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8ddc0 00007f4a27e181c0 00007f4a27e19231 00007f4a27e15d8f 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c
0709 13:12:50.885967 (+185437us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001dac20. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d9406f 00007f4a27e0cf60 00007f4a27e0e7de 00007f4a27e18b49 00007f4a27e19416 00007f4a27e15d8f 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62
0709 13:12:52.356900 (+1470933us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b580071ded0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d720aa 00007f4a27df4447 00007f4a27e0cfe7 00007f4a27e0e7de 00007f4a27e18b49 00007f4a27e19416 00007f4a27e15d8f 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4
0709 13:12:52.514596 (+157696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.514894 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3914836992}
W20260709 13:12:52.522377   772 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:12:52.526561   644 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:52.570719   863 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.571528   863 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.524235   691 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.575471   691 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.549257   905 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.577744   905 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:52.585695   977 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:12:52.546938   615 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.601965 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.558132   913 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.598534   911 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.600456   615 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:52.635449 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 399350us
I20260709 13:12:52.563884   621 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:52.646436 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 440575us
I20260709 13:12:52.636855   526 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.638056 28696 leader_election.cc:400] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:52.660507 28696 leader_election.cc:403] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:52.657835   972 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:52.646653   770 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.668628 29258 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:52.664924 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.635499   911 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.666344 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.670488 29223 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:52.671936 28724 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:52.658171   863 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:52.666779 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:52.676210 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.677771 28724 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:52.679590 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.653473   616 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:12:52.680352 28726 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:52.637483   644 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.683072 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:52.685436 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 357640us
I20260709 13:12:52.686139 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:52.686350 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.687490 29259 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:52.690079 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.690924 28724 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:52.672279   770 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:52.704339 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.707094 28724 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:12:52.708968 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.709748 28724 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:52.708906 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:52.714372 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 313241us
W20260709 13:12:52.715943 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 387635us
I20260709 13:12:52.703088 32758 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:52.720098 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:52.721874 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:52.675040   872 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:12:52.726550 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.726562   616 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:52.704504   906 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:52.710768   836 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.688083   613 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:12:52.745368 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.745630 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.746001 29258 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:52.730731 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.741210 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.747679 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.748144 28724 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:52.748466 28726 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
W20260709 13:12:52.740983 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 341937us
I20260709 13:12:52.717639   644 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:52.750330 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.751166 29258 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:52.717608   909 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:52.758410 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:52.762529 28726 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:12:52.760936 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.756110 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:52.752913 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:52.749856 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:52.733444   616 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:52.713855   770 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.765669 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.729360   871 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:52.764176 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:52.771258 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:52.737269   580 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:52.727200   972 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:12:52.757273   980 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:12:52.729725 32758 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.774118 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:52.774379   871 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:52.774920   877 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:52.771889 29260 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
W20260709 13:12:52.762240   981 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:12:52.777923 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.777282 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:52.750443   863 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:52.783460 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.790530 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.770172   836 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.795480 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.792575 28652 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:52.768847   691 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:52.775625   580 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:52.745110   906 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.806209   802 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:52.806880   906 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:52.806766   802 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.807287   810 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:52.809136   991 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:52.809403   984 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:52.809595   991 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:52.810608   991 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.799645 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.775687   658 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:52.803309 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:52.770654   909 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.804811   580 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:52.768514   872 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:12:52.784976   621 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:52.787624   877 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:52.839274 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.799445   691 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:52.813350   982 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.848358 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2033) took 1279 ms. Trace:
I20260709 13:12:52.847594 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.865587 28729 rpcz_store.cc:276] 0709 13:12:51.568833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.604995 (+ 36162us) service_pool.cc:224] Handling call
0709 13:12:51.605780 (+   785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.606127 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.606168 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:51.606549 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.147499 (+540950us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b18001a6620. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:12:52.467663 (+320164us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:52.467722 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.467818 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.837420 (+369602us) raft_consensus.cc:1685] finished
0709 13:12:52.837448 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.848274 (+ 10826us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4318,"spinlock_wait_cycles":5976960,"thread_start_us":319909,"threads_started":1,"wal-append.queue_time_us":1042445}
I20260709 13:12:52.851627 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.871615 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.873718 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.873955 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.877161 28650 raft_consensus.cc:2410] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:12:52.793534   871 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.877725 28656 raft_consensus.cc:1217] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[9.6-10.7]   Dedup: 10.7->[]
I20260709 13:12:52.881896 29251 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:52.883781 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:52.892331 28656 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 13:12:52.843258   877 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.794643   863 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.874903   691 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:52.873195   580 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:52.922192 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.885138   911 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:52.931950 28656 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:12:52.946245 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 254115us
W20260709 13:12:52.948709 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 171466us
I20260709 13:12:52.954428 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:52.956151 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 363507us
I20260709 13:12:52.926164   849 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:52.958354 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:52.849283   616 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.954149 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:52.963614 28656 raft_consensus.cc:2410] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:12:52.931948   986 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:52.885529   982 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:52.948696   795 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.961086 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:52.962172   984 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:52.968479   986 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.986804 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:52.990368 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:52.988713 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 318320us
W20260709 13:12:52.995297 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 273483us
I20260709 13:12:52.991834 28649 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:52.975927   907 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:52.982599   616 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:52.977272   975 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:53.004742 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.005667 28581 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:52.989812   972 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:52.987571   658 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:52.987960   989 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.992944   993 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.996656 32758 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:52.989411   986 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:52.984314   795 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:52.996021   770 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:53.012287 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:52.966826   849 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.032546 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.031000 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:53.043989 28575 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:53.017854  1007 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.066694 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:52.992494   580 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.064534   895 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:12:53.068085   985 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:12:53.071172   785 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.013s	sys 0.003s
I20260709 13:12:53.064213 32758 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.024006   658 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.008688   907 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.022410   972 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.009568   975 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:53.091645   785 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.014s	sys 0.003s
I20260709 13:12:53.098776   982 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.099121   795 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:53.100558   849 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.091230   871 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:53.094131   895 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:53.090909 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 112761us
W20260709 13:12:53.105105   973 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.007s	user 0.005s	sys 0.003s
I20260709 13:12:53.077477   909 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.120040 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.118680 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:53.100984 32758 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.091957   800 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:53.030875   993 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:53.131021   766 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.000s
I20260709 13:12:53.097191   863 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:53.129065 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.027839   989 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.104796   615 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.118235  1002 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.135099 28648 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:53.138041   895 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.138958 32758 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.077934  1007 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:53.153038  1010 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:53.163506  1010 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:53.163925  1010 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.164323   658 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.164522   993 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.166119   972 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.168044   907 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:53.168666   992 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:12:53.169382  1001 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:53.170853   975 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.142212   711 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.172962   711 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.173435   711 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:53.173867   905 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.001s
I20260709 13:12:53.174049 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.175300 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:53.182823   848 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:53.187716 28649 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:53.188665 28651 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:53.189497   911 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:53.192330   911 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.194118 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.183750   691 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:53.164575   615 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.191291  1007 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.194876   911 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.142602  1016 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.197494  1016 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.199911  1016 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.195503   877 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:53.199918  1010 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.202145  1004 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:53.159617   922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.007s	sys 0.023s
W20260709 13:12:53.203078   922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.007s	sys 0.023s
I20260709 13:12:53.203135  1010 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:53.203655 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 223184us
I20260709 13:12:53.204721 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.206147 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.151213  1002 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:53.208865  1000 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:53.209234  1002 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.209863  1000 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:53.210330  1000 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.210765  1000 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:53.216249 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.217335 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.217933 29258 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:53.216941 29254 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
W20260709 13:12:53.221366 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 115844us
I20260709 13:12:53.239852   997 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:53.240567   989 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.241587   997 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:53.241784   787 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:53.242167   787 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:53.242190   997 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:53.246210 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.254978 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.256791 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.258595 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.265461   986 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.246220   976 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:53.273131   976 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.273942   997 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:53.146484   766 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.277305   766 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:53.279258   996 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.266s	user 0.000s	sys 0.006s
I20260709 13:12:53.196943   945 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:53.281355 28647 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:53.282008 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.283655 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.304088 28576 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:53.304190 28581 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:53.284317 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.284415 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.285115 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.285312 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.305181 28575 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:53.285462 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.305434 28572 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:53.285746 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.285878 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.286525 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.286824 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.306694 28651 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:12:53.307461 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:53.240008  1017 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.290886   993 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:53.318279   993 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.291337 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.308941   945 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:53.290979 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.322372 28577 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:12:53.310511   905 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:53.242954   787 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:53.293690 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 73283.9us
I20260709 13:12:53.323196   905 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.323740   905 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:53.323844 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.324186   787 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:53.324748   469 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:53.325217 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.326102   469 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:53.326433   802 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.325222  1017 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.327684   976 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.294443 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1106) took 1224 ms. Trace:
I20260709 13:12:53.329344  1017 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.326503 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:53.329274 28580 rpcz_store.cc:276] 0709 13:12:52.069587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.075445 (+  5858us) service_pool.cc:224] Handling call
0709 13:12:52.075798 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.659118 (+583320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.659154 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:52.659202 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:52.659235 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.294129 (+634894us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54003511d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:53.294178 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.294297 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340969344}
I20260709 13:12:53.330897   469 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:53.331343   469 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.331832   469 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.334335 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.270253   986 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.335501   615 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:53.335930   615 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:53.336371   615 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.298316  1004 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:53.299456 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:53.340675 28695 leader_election.cc:400] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:53.341053 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.289388   872 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:53.301429   984 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.288270 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.308959 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.345835 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.347456 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.310788 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.311403 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.312264 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:53.351481 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.352428 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.313253 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.338568 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.340900 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:53.342015 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:53.357519 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:53.299206  1002 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.343008 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.362226 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.362406 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:53.364045 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.366580 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.367344   849 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.376001   849 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:53.376181 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.376478   849 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.373301 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.374553 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.344972   986 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.353943   984 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.348472   877 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.348685   993 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.367975   863 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:53.367549   766 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.377264  1002 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.356923   976 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:53.393509 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.361261   802 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:53.364038   975 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:53.387203 28546 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:53.381772 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.331171   711 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.370090   772 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:53.371965   526 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:53.390519  1013 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:53.391345 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.357569  1004 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.357959 28574 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:53.377583  1017 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.394495 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.394827 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.394917 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.322359   945 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.441516 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.431798 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:53.397241 28730 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:12:53.442651 29258 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.397478 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:53.398521 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.404531 28728 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:12:53.407346 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:53.445679 28576 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.448948 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.450778 29255 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:53.414206 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.452759 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:53.405704  1031 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:12:53.396255   802 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:53.497570 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.419445 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.419812 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:53.499661 28724 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:53.425925 28727 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:12:53.499158 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.453751 28729 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:53.499191 29252 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:53.508278 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.415354 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.425374 28723 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:53.417750 29253 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:53.422065 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.422453 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.489787 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:53.490700 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:53.399874   904 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.420153 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.413911 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.416124 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.510440 29256 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.506919 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:53.516106 29258 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:53.410737   948 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.413908 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:53.457973 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59499.9us
W20260709 13:12:53.512277 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.504402   972 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.513577 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 91568.6us
I20260709 13:12:53.513845 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.519302 29255 raft_consensus.cc:2368] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10.
I20260709 13:12:53.519490 29253 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:53.519819 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.514006 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:53.517207 28650 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:53.520725 28727 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.500315 28722 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:53.515153 29257 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:53.520226 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.511519 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.403460   711 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.529100 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.524621 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.524411 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:53.652318 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 128020us
I20260709 13:12:53.653118 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.654156 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.415915  1004 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.527056 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.655809 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2039) took 2015 ms. Trace:
I20260709 13:12:53.484650  1014 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:53.418615   991 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.530282 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.675309 28577 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:53.531344 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:53.527192  1017 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:53.672951 28721 rpcz_store.cc:276] 0709 13:12:51.640494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.665630 (+ 25136us) service_pool.cc:224] Handling call
0709 13:12:52.333446 (+667816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.356777 (+ 23331us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:52.405035 (+ 48258us) log.cc:844] Serialized 14 byte log entry
0709 13:12:52.984986 (+579951us) log.cc:844] Serialized 14 byte log entry
0709 13:12:52.990299 (+  5313us) log.cc:844] Serialized 14 byte log entry
0709 13:12:53.200650 (+210351us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b180037a260. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:12:53.200792 (+   142us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.201325 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.201483 (+   158us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:53.201519 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.201684 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:53.241474 (+ 39790us) raft_consensus.cc:1685] finished
0709 13:12:53.241494 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.608153 (+366659us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54001caf50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:53.655745 (+ 47592us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10845,"prepare.queue_time_us":59150,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":4973,"raft.queue_time_us":872258,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":17235,"spinlock_wait_cycles":1545842688,"thread_start_us":549366,"threads_started":2,"wal-append.queue_time_us":547279}
I20260709 13:12:53.536641   849 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.536844 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:53.542109 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.497399   802 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.429672   975 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:53.504202  1002 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.682087 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.556506 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:53.410032   800 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:53.512704   999 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.690577 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.557204 29254 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:53.582713 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.582883 28546 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.582129 29256 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:12:53.584491 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:53.693323 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 110532us
I20260709 13:12:53.693656 28579 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:53.349997 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:53.585521 28647 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:53.691586 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:53.676254   772 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:53.526979   972 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.596244 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.596354 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.409281   976 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.654258 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:53.526443 28576 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:53.655182 28722 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:53.656883 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:53.585563 28727 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:53.428334   615 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.551424   863 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:53.542057   989 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:12:53.677794 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:53.730165 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52592.6us
I20260709 13:12:53.489337   945 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.682948 29260 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:53.681236 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:53.730926 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.732293 29251 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:53.685688 28696 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.687086 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:53.733436 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46440.2us
W20260709 13:12:53.735671 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 50076us
I20260709 13:12:53.736634 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.737820 28696 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.688498   800 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.651095  1000 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:53.713405 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 166517us
I20260709 13:12:53.593816 28724 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:53.682024  1017 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.720321 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:53.716123 28725 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:12:53.717068 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62886.4us
I20260709 13:12:53.724282 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:53.705513 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:53.787456 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:53.788216 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 82820.1us
I20260709 13:12:53.689894   975 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:53.785656 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 51396.4us
I20260709 13:12:53.750295 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:53.783571   993 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:53.790735   787 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:53.791481   993 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.792047   787 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:53.793301   787 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.795042   691 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:53.798480 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:53.802209  1034 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:12:53.812785 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 62337.1us
I20260709 13:12:53.829321 28547 leader_election.cc:400] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10.
I20260709 13:12:53.827292 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.831899 28547 leader_election.cc:403] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:12:53.838797 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 48654.4us
I20260709 13:12:53.841157 28581 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.841609 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:53.708910   904 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.727052   526 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.726138  1004 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.854137 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 64990.7us
I20260709 13:12:53.685328   469 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:53.740047   948 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:53.704114   999 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.860392 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.874964 28728 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:53.861316 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:53.862277 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:53.825120   913 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.777174   907 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:53.786798   986 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:53.777504   785 raft_consensus.cc:2764] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:53.703896  1002 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.714495   772 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.731079 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:53.825591  1017 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.838167   909 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:53.873839   948 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.921423   948 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.927120 28581 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:12:53.917191 28580 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:53.857244   872 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10.
W20260709 13:12:53.876833 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 352241us
W20260709 13:12:53.813886  1032 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:53.862195   526 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.792068   993 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.887238 28722 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:53.713732  1029 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:53.889747 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:53.855966   988 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:53.841691   621 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:53.885773 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.815030   691 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:53.943212 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 212230us
I20260709 13:12:53.944262 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:53.873328  1014 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:53.923767   859 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:53.980556 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 94870.7us
I20260709 13:12:53.907444   615 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.981436 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.928659   976 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.902179   766 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:53.911617   849 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.890977   907 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:53.938124   997 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:53.928248   986 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.906324   972 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:53.945079   772 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.896107   871 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:53.897455   469 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:53.987603   691 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:53.993325   807 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:53.985944   872 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:53.984928   905 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.002s
I20260709 13:12:53.948336   526 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.017431 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:53.956193   711 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:53.989095 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:53.986513   580 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:53.877507  1004 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.984664   990 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:53.986889   621 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:53.980068  1029 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.937927   909 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:53.993448   766 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:53.986739  1014 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:54.069408  1014 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.010833   907 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:53.989718   988 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:54.018602   986 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:54.042550 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53545us
I20260709 13:12:54.045641   580 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:54.034008   984 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.006s
I20260709 13:12:54.032915   807 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:54.035122   872 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:54.018896   997 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:54.072885 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 330430us
W20260709 13:12:54.076807 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 289421us
I20260709 13:12:54.106750 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:54.107677 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:54.043397   905 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:54.083333 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:54.108350 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:12:54.109210 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 256838us
I20260709 13:12:54.111986 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:54.112938 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:54.113713 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:54.114705 28652 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:54.120519 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:54.085096  1000 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:54.123873 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:54.126859 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:54.089471   807 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:54.088425   616 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:54.099685   872 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.052884   691 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.146166 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:54.139658 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:54.148387 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:54.140390  1038 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:54.150710 28654 raft_consensus.cc:2368] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12.
I20260709 13:12:54.134317   871 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:54.153373 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:54.154420 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.090306   984 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.142817   615 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.145462   913 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.151218  1037 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.153443   972 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:54.179275  1035 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:12:54.156018   871 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.181520  1041 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:54.152536   991 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:54.150372  1039 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:54.144214   998 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:12:54.152510  1038 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:54.180897   984 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:54.272710 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.198865 28655 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:54.202139   745 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:54.203301   997 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.159176   840 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:54.164758   848 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.161763   999 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:54.121711   766 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.215914 28581 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:54.171854   913 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:54.271548 28726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.039s
W20260709 13:12:54.287051 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 248578us
I20260709 13:12:54.192114   972 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.145838   621 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.356606 29253 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:54.172096   615 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.209183   871 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:54.343149 28726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.001s	sys 0.039s
I20260709 13:12:54.367532 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:54.362669 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 255026us
I20260709 13:12:54.271909  1038 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.365494 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.369621 29253 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:54.299531   991 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:54.158689   988 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.380811 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:54.297039   984 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:54.273221  1002 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:54.354434   972 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.351804  1037 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:54.396598 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:54.364275  1046 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.361835   840 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:54.405762 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:54.332671   848 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.408478 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:54.410456 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:54.297600   745 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.404879 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:54.395388   975 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.004s
I20260709 13:12:54.423121 29251 raft_consensus.cc:2368] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:12:54.407368 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:54.397593   945 consensus_meta.cc:287] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.002s
I20260709 13:12:54.384295  1004 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.374814   711 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:54.425166 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.426577 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:54.438160 28725 raft_consensus.cc:2368] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12.
I20260709 13:12:54.438740 28547 leader_election.cc:400] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:12:54.439136 28547 leader_election.cc:403] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:12:54.431396   580 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:54.442281 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:54.415999  1029 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.474915 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2059) took 1032 ms. Trace:
I20260709 13:12:54.480232 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:54.481176 28581 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.484840 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.485654 28576 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:54.475481 28729 rpcz_store.cc:276] 0709 13:12:53.442945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.507886 (+ 64941us) service_pool.cc:224] Handling call
0709 13:12:53.843689 (+335803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:53.843977 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:53.844309 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.342551 (+498242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:54.342643 (+    92us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:54.342712 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.342796 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.474653 (+131857us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54001b9250. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:54.474825 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":569,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":193252,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":27113,"spinlock_wait_cycles":771279744,"thread_start_us":497771,"threads_started":2,"wal-append.queue_time_us":552481}
W20260709 13:12:54.494422 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 330007us
I20260709 13:12:54.443511   905 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:54.524027 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.440539  1040 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:54.465988  1004 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:54.466136   984 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:54.472188   945 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:12:54.424808   840 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:54.713685   859 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.000s
I20260709 13:12:54.714221   859 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:54.687526  1036 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.508s	user 0.000s	sys 0.004s
W20260709 13:12:54.717135   872 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.564s	user 0.020s	sys 0.020s
I20260709 13:12:54.717700   872 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:54.719262   802 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.015s	user 0.007s	sys 0.007s
I20260709 13:12:54.685593   615 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.719745   802 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.720243   872 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.472585   997 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:54.444905  1041 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:54.552624 28729 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:54.727824 28729 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:54.558398 28728 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:54.468137  1045 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:54.561184 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 212211us
I20260709 13:12:54.563042 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:54.415759  1037 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:54.440198  1046 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.436035   975 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:54.744645  1046 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:54.709554  1040 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:54.746615   772 consensus_meta.cc:287] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.727s	user 0.011s	sys 0.003s
I20260709 13:12:54.736464  1045 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.747093  1040 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.747534  1045 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.747149   772 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:54.748577 28728 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:54.749106 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.750718  1041 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.744865   975 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:54.570513  1042 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:54.588868   800 consensus_meta.cc:287] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.001s
I20260709 13:12:54.569160   787 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.575892  1029 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:54.595206   711 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:54.624655  1050 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:54.769960 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.770766 28577 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
W20260709 13:12:54.625411  1043 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:12:54.628468 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:54.631572   580 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:54.780514   580 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:54.762492   807 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.000s
W20260709 13:12:54.783200   986 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.004s
I20260709 13:12:54.784693   772 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:54.785399   986 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.783650   807 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:54.790052   986 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:54.780939   948 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.003s
I20260709 13:12:54.793955   948 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.794780 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1358) took 1207 ms. Trace:
I20260709 13:12:54.769135   787 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.799937   787 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.764638   998 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:12:54.597306  1066 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:54.802573  1066 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.775969  1029 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.753654  1053 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.764981  1054 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:54.767041   800 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.633518 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:54.644646 28655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2618) took 1765 ms (client timeout 2058 ms). Trace:
I20260709 13:12:54.795357 28726 rpcz_store.cc:276] 0709 13:12:53.587068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.587276 (+   208us) service_pool.cc:224] Handling call
0709 13:12:53.593431 (+  6155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.594078 (+   647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.594123 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.665169 (+ 71046us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.367848 (+702679us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:54.367888 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.367951 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.794500 (+426549us) raft_consensus.cc:1685] finished
0709 13:12:54.794534 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.794704 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7852,"raft.queue_time_us":6751,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":26941,"thread_start_us":702270,"threads_started":1,"wal-append.queue_time_us":800880}
I20260709 13:12:54.810210 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:54.688311 29260 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:54.421581   991 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:12:54.691195 28580 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
W20260709 13:12:54.691630 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 249922us
I20260709 13:12:54.698287 28581 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:54.701469 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:54.830132 28724 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:54.823446 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:54.823736 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.720911 28651 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:54.724511 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2058) took 1281 ms. Trace:
I20260709 13:12:54.425221  1000 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:54.731986 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.824163 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.826833 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:54.737027 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 174056us
I20260709 13:12:54.826078 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.737736 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.742044   616 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.732697 28579 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:54.759236 28578 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:54.760712 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.765185  1042 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.837263 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:54.838840 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.839587 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.817344 28545 leader_election.cc:400] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12.
I20260709 13:12:54.702279 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:54.832595 28576 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:54.833076 29253 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.834308 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:12:54.587603 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 92263us
W20260709 13:12:54.840626 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 138470us
I20260709 13:12:54.840669 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:54.841321 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:54.841739 28721 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:54.841944 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:54.653774  1051 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 13:12:54.822512 28655 rpcz_store.cc:269] 0709 13:12:52.878867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.879007 (+   140us) service_pool.cc:224] Handling call
0709 13:12:54.644457 (+1765450us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003b1354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:54.644571 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2690302720}
I20260709 13:12:54.842466 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:54.844990 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:54.845323 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:54.852717   986 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:54.852623   616 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.855594   976 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:54.856190   976 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.857772   800 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.858372   800 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:54.821177   745 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:54.807834  1053 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.859750 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:54.860646 29255 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.860870   991 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.861413   909 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.861950 28654 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:54.848555  1000 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:54.846094 28545 leader_election.cc:403] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:54.847524 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:54.847781 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:54.832010 28730 rpcz_store.cc:276] 0709 13:12:53.442679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.442975 (+   296us) service_pool.cc:224] Handling call
0709 13:12:53.443426 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.443889 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:53.510293 (+ 66404us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.005403 (+495110us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.006036 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.006211 (+   175us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:54.006505 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.006708 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.006816 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.642835 (+636019us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b1800445de0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d29522 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:12:54.656605 (+ 13770us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:54.724258 (+ 67653us) raft_consensus.cc:1685] finished
0709 13:12:54.724282 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.724442 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16282,"prepare.queue_time_us":67165,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":6749,"raft.queue_time_us":19971,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":46799,"spinlock_wait_cycles":43771520,"thread_start_us":469425,"threads_started":1,"wal-append.queue_time_us":616608}
I20260709 13:12:54.853096   772 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:54.864879 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1057) took 1338 ms. Trace:
I20260709 13:12:54.871062 28651 rpcz_store.cc:276] 0709 13:12:53.526629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.529987 (+  3358us) service_pool.cc:224] Handling call
0709 13:12:54.864723 (+1334736us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540027d654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:54.864826 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2402239872}
W20260709 13:12:54.871650 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54451.4us
I20260709 13:12:54.865772 28650 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:54.873296 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 405390us
I20260709 13:12:54.873538 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:54.874926 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.877279 29253 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:12:54.846504 28695 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 2.058s (SENT) [suppressed 6 similar messages]
I20260709 13:12:54.767491  1058 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:54.887455 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.888150 29253 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:54.858517   976 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.856824   766 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.838402  1037 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:54.807433  1029 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.899304 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:54.900318 28650 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:54.804978  1066 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.908247 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:54.909305 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75057.9us
I20260709 13:12:54.910082 29223 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:54.910815 28576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d30c923964844ccad86f6776b30b074"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:54.911005 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:54.911377 28576 raft_consensus.cc:606] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:12:54.906970 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:54.810675   948 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.903509 29255 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:54.906461 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.914477 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:54.813256   872 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:54.916551 28572 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:54.912063 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:54.921095 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.921926 28576 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:54.922972 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.923317 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:54.876647   909 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12.
I20260709 13:12:54.927181 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.924108 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.885018  1058 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:54.931545 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:54.934603 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:54.919838 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:54.938597 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:54.934692 28580 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:54.904959   986 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:54.958920  1047 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.493s	user 0.001s	sys 0.002s
I20260709 13:12:54.958724   986 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.960338   984 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:54.961046   984 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:54.962035  1042 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:54.808360  1054 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.963480   984 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:54.964138   997 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:54.964406  1054 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:54.964737 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.964769   997 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:54.965860   997 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.971055 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:54.971913 28574 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
W20260709 13:12:54.975333  1014 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.000s
I20260709 13:12:54.975809  1014 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.977279 28576 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:12:54.979482   871 consensus_meta.cc:287] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.002s
I20260709 13:12:54.979945   871 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.981141   905 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:54.984301  1063 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:54.985080  1063 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:54.986537  1063 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:54.943914   745 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.945173  1064 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:54.951181 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:54.924995   848 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.913885   859 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:55.066709 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 115655us
I20260709 13:12:54.987675   905 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:54.972888 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
W20260709 13:12:54.993744   993 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.025s	user 0.002s	sys 0.013s
W20260709 13:12:54.994894   526 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.948s	user 0.012s	sys 0.000s
I20260709 13:12:54.995234   616 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:54.997771   802 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:54.998802  1014 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.060694   849 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:55.066134  1064 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.005329 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:55.005576 28647 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:54.940339 28577 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:55.007404 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 64780.4us
I20260709 13:12:55.059886  1048 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:55.013155 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.015193 29260 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:55.019896 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:55.011720 28648 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:55.003983 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.022627 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:54.915624   840 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.024262 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.926458   787 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.058610 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:54.931073  1044 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:55.095117   904 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.209s	user 0.015s	sys 0.007s
I20260709 13:12:54.938421  1058 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.990861  1037 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:55.069978 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:55.071208 28574 raft_consensus.cc:606] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:54.928771   872 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.042464   990 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:55.041680   772 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:55.081355 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:55.001298 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.002723  1046 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:12:55.078996   526 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:55.091281 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:55.041335   937 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:12:55.028385 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:55.072654  1052 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:55.083833  1017 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.139s	user 0.010s	sys 0.003s
I20260709 13:12:55.098851 29256 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:55.100080 29258 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:55.111726 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:12:55.118736 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 241860us
I20260709 13:12:55.197317 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:55.121598 29253 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:55.181578  1042 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:55.122164 29257 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:55.070789   905 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:55.061931 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.153268  1045 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:55.155956  1038 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.764s	user 0.012s	sys 0.001s
I20260709 13:12:55.108124   986 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.099006  1064 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:55.247617 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.248154 28653 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:55.205046 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 358510us
W20260709 13:12:55.156764  1068 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:12:55.089354   807 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:55.090236  1066 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:55.177585 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 107681us
I20260709 13:12:55.098133   984 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:55.098170   849 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.004477 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.079167   993 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:55.190227 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 99035.1us
I20260709 13:12:55.167194   904 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:55.181599   913 consensus_meta.cc:287] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.007s
I20260709 13:12:55.194909 28573 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:55.121883 28579 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
W20260709 13:12:55.199079 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 170760us
I20260709 13:12:55.159267   616 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:12:55.204170 28729 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:55.193538  1041 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:55.205732 28622 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.159514   840 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:12:55.246922 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.081542  1053 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:55.178634  1067 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:12:55.249696 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.194001  1052 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:55.250661 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.187772   990 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:55.251332 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 153311us
I20260709 13:12:55.122923  1048 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.183676  1037 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.188956   772 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:55.438819 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.205929   691 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:55.247156  1000 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:55.456655 29251 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:55.458196 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.463799 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.245678  1049 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.214s
I20260709 13:12:55.204469  1007 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:55.460234 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:55.434685   526 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:55.249686 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.289188 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:55.489424 28574 raft_consensus.cc:606] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:55.354197  1029 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:55.490435  1029 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:55.492746 28475 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 390) took 12359 ms (client timeout 15000 ms). Trace:
I20260709 13:12:55.492969  1029 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:55.250267   871 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.462522   872 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:55.449771  1075 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:12:55.462939 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:55.429664   986 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.463670  1052 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:55.462841 28655 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:55.289438 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.506063 28650 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:55.465430 29257 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:55.465794 28647 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:55.266134 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:55.200228   975 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.472858 28546 leader_election.cc:400] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12.
I20260709 13:12:55.470533   787 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.473453 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:55.313292 28479 catalog_manager.cc:5697] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 10, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 10 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:55.481055   691 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:55.485572 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 279909us
W20260709 13:12:55.317839  1074 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:12:55.307031   972 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.889s	user 0.016s	sys 0.028s
W20260709 13:12:55.357967  1065 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 13:12:55.367921  1079 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:55.250900  1038 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.495982 28728 raft_consensus.cc:2368] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
I20260709 13:12:55.200559  1017 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:55.449090  1080 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:12:55.289805  1016 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.479461 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:12:55.517825 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45129.5us
W20260709 13:12:55.512336 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 246298us
I20260709 13:12:55.494969  1000 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.512727   621 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:55.517386 28479 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:55.525400   997 consensus_meta.cc:287] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.008s
W20260709 13:12:55.525998   766 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.006s
I20260709 13:12:55.362736   580 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.479038   948 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:55.529567 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 56175.3us
I20260709 13:12:55.545506 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:12:55.290002   907 consensus_meta.cc:287] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.172s	user 0.013s	sys 0.005s
I20260709 13:12:55.496493   989 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:55.207093   802 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.302s
I20260709 13:12:55.484615   984 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:55.493150 28475 rpcz_store.cc:269] 0709 13:12:43.133839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.134221 (+   382us) service_pool.cc:224] Handling call
0709 13:12:55.492651 (+12358430us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:49.846566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:49.862124 (+ 15558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:49.862184 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:12:49.862205 (+    21us) tablet.cc:662] Decoding operations
0709 13:12:49.864544 (+  2339us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:49.864669 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:49.864704 (+    35us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:12:49.880601 (+ 15897us) tablet.cc:701] Row locks acquired
0709 13:12:49.880653 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:12:49.880858 (+   205us) write_op.cc:270] Start()
0709 13:12:49.888329 (+  7471us) write_op.cc:276] Timestamp: P: 1783602769880784 usec, L: 0
0709 13:12:49.888357 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:12:49.937452 (+ 49095us) log.cc:844] Serialized 10834 byte log entry
0709 13:12:50.536546 (+599094us) op_driver.cc:464] REPLICATION: finished
0709 13:12:50.849311 (+312765us) write_op.cc:301] APPLY: starting
0709 13:12:50.849410 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:51.633224 (+783814us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:51.633346 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:52.123870 (+490524us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:52.124455 (+   585us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:12:52.124531 (+    76us) write_op.cc:312] APPLY: finished
0709 13:12:52.239453 (+114922us) log.cc:844] Serialized 244 byte log entry
0709 13:12:53.105911 (+866458us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a24d0c0ac 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b
0709 13:12:53.203549 (+ 97638us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:53.203789 (+   240us) write_op.cc:454] Released schema lock
0709 13:12:53.203857 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:53.209735 (+  5878us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:53.209769 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":900311,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":312465,"apply.run_cpu_time_us":81545,"apply.run_wall_time_us":2360378,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121111,"num_ops":28,"prepare.queue_time_us":353443,"prepare.run_cpu_time_us":72623,"prepare.run_wall_time_us":219530,"raft.queue_time_us":420921,"raft.run_cpu_time_us":24926,"raft.run_wall_time_us":253204,"replication_time_us":600744,"spinlock_wait_cycles":5402880,"thread_start_us":1576235,"threads_started":5,"wal-append.queue_time_us":1123647,"wal-append.run_cpu_time_us":35162,"wal-append.run_wall_time_us":2262175}]]}
I20260709 13:12:55.575842 28655 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:55.487334  1066 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:55.579551 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 329947us
I20260709 13:12:55.530586   787 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.583572   997 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.598847 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.600124 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.596061 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.601230 28729 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:55.602573   840 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:55.602682  1066 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.602954   984 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.603641   580 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:55.604619  1038 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.504468  1062 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:12:55.605726 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:55.606184  1062 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:55.606602  1062 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:55.606904  1084 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:55.607364  1084 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:55.594115   907 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.607725  1084 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:55.607694  1062 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.608685 28652 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:55.579551  1000 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.609748   907 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.611374  1000 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.552861 28479 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:55.606644 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.559849 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.586766 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:55.554075 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 74718.5us
I20260709 13:12:55.597208 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.614405 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:55.479705   913 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.585238   526 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.500150  1053 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:12:55.588927 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:55.584371 28547 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:55.626552 29254 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.592204 28651 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:55.541941  1045 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.500460   976 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:12:55.539961   412 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:55.498943   807 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:55.594133 28727 raft_consensus.cc:2368] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14.
I20260709 13:12:55.516551  1070 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:55.545416   849 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.318276   905 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:55.596437   766 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:12:55.583899  1016 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.551334   691 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.587930 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.612771 28479 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 5, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 5 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.582566   998 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.600841   997 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.615216   877 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:12:55.616310 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.495232  1041 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:55.588037 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.668489 28725 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:55.636369   412 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.617362 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:55.609191  1062 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.513568   986 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.681842   948 raft_consensus.cc:993] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:12:55.682717  1014 raft_consensus.cc:993] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:12:55.682996   986 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.587556   989 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:55.631377 28729 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:12:55.683715 28727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 2066) took 1999 ms (client timeout 1965 ms). Trace:
I20260709 13:12:55.639027   909 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:55.684127 28727 rpcz_store.cc:269] 0709 13:12:53.684791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.719997 (+ 35206us) service_pool.cc:224] Handling call
0709 13:12:55.683474 (+1963477us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54002da354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:55.683619 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4156068224}
I20260709 13:12:55.529418   975 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.633224 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.633898 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.649202   859 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:55.637418 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85402us
I20260709 13:12:55.692981 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:55.607911  1066 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:55.625393   840 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.697111   859 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:55.711681   859 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.642695  1017 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:55.638841   976 consensus_queue.cc:1243] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:55.712249   840 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.629534   907 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:55.586499  1064 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.713054   907 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:55.713899   989 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.714865  1064 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:55.715128   907 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:55.628295  1054 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:55.619812   526 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.715790  1054 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.650245 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:55.651309 28728 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
W20260709 13:12:55.716516 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 66387.4us
I20260709 13:12:55.661573 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.718392 29255 raft_consensus.cc:2368] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:55.658553 28479 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 12. New cstate: current_term: 12 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.719908  1002 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.720332  1002 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.720678  1002 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.721160 28479 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 7 to 13, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 13 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:55.722675 28479 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.667104   904 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:55.617503   906 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:55.726104  1039 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:12:55.669929 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52654us
I20260709 13:12:55.727995  1039 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:55.728288   621 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:55.730036  1039 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:55.670634   999 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:55.732191   999 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.732579   999 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.736073 28581 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:55.675468   913 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.677771  1041 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.737594   904 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.678452  1037 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:55.634963 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 50716.5us
I20260709 13:12:55.724442 28479 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.680610  1016 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.685178   412 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.689873 28574 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:55.692858 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.699918   948 raft_consensus.cc:1081] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:12:55.700459  1014 raft_consensus.cc:1081] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:12:55.701623  1038 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:12:55.701524 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 85296.7us
I20260709 13:12:55.763695 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.764627 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.704811   772 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:55.782022 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.782670 28648 raft_consensus.cc:2376] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9. Re-sending same reply.
I20260709 13:12:55.705808  1086 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.706086  1048 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.709117   766 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:55.710201  1066 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:55.711619   905 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:55.565210   972 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.618789  1085 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:55.715883   526 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.725245 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.815438 28655 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:55.716297  1054 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.665863 29254 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:12:55.726562 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:55.818488 28726 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:55.747002 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.748657 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.716339  1089 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:55.742095  1069 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.744064 28479 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 8, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 8 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:12:55.726224  1050 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:12:55.757045 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 64240.8us
I20260709 13:12:55.828060 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.833451 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.702100   871 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:55.778560 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.765632 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.779115 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.739929   937 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:55.789690 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.790401 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:55.751401   904 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.732720  1084 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.799921 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.762588   993 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.761855   990 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.814530 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.866269 28652 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:12:55.817655 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:55.761550  1038 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:55.783353   906 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:55.821830 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.822104 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
W20260709 13:12:55.873689 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 95851us
I20260709 13:12:55.878156 28581 raft_consensus.cc:606] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:55.878720 28581 raft_consensus.cc:614] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:55.824653 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:55.864801 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:55.879612 28579 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.825369 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:55.825959 28649 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:55.826503 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.739586   859 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.882540 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:55.883248 28576 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.829311 28622 leader_election.cc:400] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:55.791795   986 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.800776   772 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:55.798911   975 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.848773 28578 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:55.846405 28654 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:55.916567 28545 leader_election.cc:400] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
I20260709 13:12:55.851691 28726 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:55.917908 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.918996 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:55.862943   787 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.920014 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.845867 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.853857 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.922228 28580 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:55.856401 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:55.923465   998 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:55.923528 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.847818 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.925136   948 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:55.858052 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.926198 28729 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:55.926994 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.927321   948 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.927848   948 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.833441 28653 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.835004 28479 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 6 to 11, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 11 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.860052 28727 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:12:55.802088  1086 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.937543 28479 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.938673 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:55.939451 28729 raft_consensus.cc:2368] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14.
W20260709 13:12:55.825275  1058 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.003s
I20260709 13:12:55.823805  1089 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:55.933439 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.941151 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:55.941505 28649 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:55.869228 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.873311 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:55.874064 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:55.874110  1085 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:55.940184 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:55.943634 28651 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:55.942905 28652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:12:55.869191   904 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:55.897678 28648 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:55.903401 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.904167 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.935535   989 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.905038 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.905867 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:55.952363 29260 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.912642   999 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.854501   937 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:55.947870   990 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.914075 28723 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:55.914680 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:55.962565 28725 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:55.916899 28545 leader_election.cc:403] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:55.853137  1093 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:12:55.934046 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:55.965806 28726 raft_consensus.cc:2368] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:55.924794 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:55.936223 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.967690 28578 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
W20260709 13:12:55.968582 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52236.9us
I20260709 13:12:55.940398 28656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:12:55.969494 28656 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:12:55.941195 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62675.4us
I20260709 13:12:55.969563 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:55.969965 28656 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.872289 28655 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:55.850603  1069 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.944792 28652 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:55.896090 28622 leader_election.cc:403] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:12:55.942881 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 68890.4us
I20260709 13:12:55.972257 28652 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:55.944021 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:55.936318 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.971149 28579 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:55.947120 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:55.949301 28576 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:12:55.940204 28479 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:55.826704   766 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:55.860232  1045 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:12:55.913497 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.959484 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:55.960309 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:55.944629  1096 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:12:55.915737  1007 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:55.929441   986 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.001363   691 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.001515   412 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.875730  1038 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.972947 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:55.975106 28581 raft_consensus.cc:2368] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:56.005125   871 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:56.005666 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:56.005210   691 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:56.000244 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 171087us
I20260709 13:12:56.010480 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:56.011454 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2307) took 1140 ms. Trace:
I20260709 13:12:56.013257  1093 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:56.011963 28654 rpcz_store.cc:276] 0709 13:12:54.870690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.870965 (+   275us) service_pool.cc:224] Handling call
0709 13:12:54.871279 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:55.921138 (+1049859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.011168 (+ 90030us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b540001d6d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:56.011392 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241966976}
I20260709 13:12:56.013826  1093 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:56.014729 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:56.014806  1093 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.016427 28654 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:56.019594 28573 raft_consensus.cc:2368] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14.
I20260709 13:12:56.001382  1007 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.021029   945 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:56.021401   945 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:56.022136   412 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.022586  1007 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.022220   945 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.023155 28729 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:55.971138   904 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.970480 28572 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:55.978893 28479 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 9, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 9 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:56.029804 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:55.983292 29260 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:55.952708   984 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:55.985131 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.985251   937 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:55.985929   859 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.959254  1066 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.024595  1017 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:55.986676 29251 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:55.960412  1099 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:12:55.972548   990 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.038890   990 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.987624   999 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:55.929965   772 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:56.039577  1052 consensus_meta.cc:287] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.002s
I20260709 13:12:56.040071  1052 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.041432   772 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.041770  1000 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:56.042232  1000 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:55.990332   766 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.043082  1000 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.044370  1000 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.990788   972 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.991339   526 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.046638   766 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.048623 28722 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:56.030102 28479 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 10, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 10 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:56.048259   526 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:56.049335 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 79058.2us
I20260709 13:12:55.992514  1069 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:55.992945   802 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:55.997634  1045 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:56.000317 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:12:56.056051 28579 raft_consensus.cc:606] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:56.056468 28579 raft_consensus.cc:614] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:56.002802 28577 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:55.963845 28653 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:12:56.027451  1002 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:55.963816 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:56.059890 29254 raft_consensus.cc:2368] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:56.054945 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.060490 28576 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:56.050246 28479 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 8 to 9, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 9 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:56.062306 28479 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 12, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 12 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:12:56.058063 28655 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:56.058760 28652 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.064232 28648 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:56.064815 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.065461 29257 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
I20260709 13:12:56.066268 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.066951 29256 raft_consensus.cc:2368] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
I20260709 13:12:56.067857 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.067934 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.069648 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.070552 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:55.950219  1058 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:56.079600 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 115856us
I20260709 13:12:56.080585 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.081211 29260 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:56.070845 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:56.083220 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.072824 29257 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:56.070763 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.073127 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.079124 28581 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:56.092944 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 87363.5us
I20260709 13:12:56.093850 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:56.097174 28652 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.098605 28576 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:56.000516  1054 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.096240 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:56.103770  1104 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:56.104336  1104 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:56.096701   999 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:56.097184   988 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:12:56.106001  1052 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:56.054595   802 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:56.108274 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.109071 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.112015 29256 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:56.109196 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.109165 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:56.112195 29260 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:56.055918  1045 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:56.104722  1104 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.078912  1042 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.070320  1090 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:56.102581   526 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:56.126890 28728 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:56.119796 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:56.133620 28727 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:56.120688 28650 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:12:56.115087  1066 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.123502 29255 raft_consensus.cc:2368] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14.
I20260709 13:12:56.115571 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:56.142200 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.108520   580 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:12:56.144315 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:56.144716 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.144790 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:56.120257  1002 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.136512   999 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.147426 28729 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.152818 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:56.158093   766 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:56.158018 28729 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:12:56.158623   766 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.159024   766 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.161554 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.161280   802 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.161327 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.163060 29252 raft_consensus.cc:2410] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:12:56.164602 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.164480  1081 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:12:56.164989 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:56.165848   871 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:56.166819   937 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.167832 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:56.140906   526 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:56.131517  1062 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:12:56.172663 28727 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:56.176360   871 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:56.148005  1063 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:56.178570 29224 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:56.129874  1042 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.169332  1066 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:56.177055   526 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.186139   999 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.191792  1086 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.186295  1066 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:56.187680  1052 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:56.192977  1052 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:12:56.194056  1101 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:56.193958  1052 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.188887  1084 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.193573  1066 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:56.197033  1106 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:12:56.202142  1045 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:56.188952  1105 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:12:56.179458  1063 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.190116  1054 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.194317  1089 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.199971  1111 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:56.205582  1052 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:56.210692  1042 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:56.214818   802 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.216404  1089 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.219803  1038 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:56.221237   986 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.208106  1063 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.224956   945 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:56.226855   787 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.219780   948 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.229610   948 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.231849  1045 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:56.206378  1058 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.232811  1111 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.251281  1111 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.253340  1111 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:56.121606 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 151897us
I20260709 13:12:56.298684 28545 leader_election.cc:400] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14.
I20260709 13:12:56.299474 28545 leader_election.cc:403] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.307344 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:56.308053 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.309732 28547 leader_election.cc:400] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
I20260709 13:12:56.310249 28547 leader_election.cc:403] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.312968 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:56.316944 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.318396 28574 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:56.321309 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:56.323321 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.325497 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:56.356803 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:56.359989 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:56.364944 29253 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:56.366822 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:56.370172 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:56.370963 28650 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:56.169332 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:56.231056   904 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
I20260709 13:12:56.382766   412 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14.
W20260709 13:12:56.381311 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.406407 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 224042us
I20260709 13:12:56.409683   975 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:56.410279  1016 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
W20260709 13:12:56.410595 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.411345   906 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.461304  1090 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:56.413441  1048 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.415743   905 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.409795  1007 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:56.463907  1007 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:56.464622  1007 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:56.463640  1048 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:56.466665 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 297210us
I20260709 13:12:56.467902 28695 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:56.427126 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 248488us
I20260709 13:12:56.427502   580 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:56.471355   580 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.472635   877 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.428115   616 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:56.463640   905 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.475694   986 raft_consensus.cc:2764] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:56.477123   986 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:56.463548  1067 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:56.477838   986 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:56.478078  1067 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.478611 29260 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:56.430804   872 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:56.479643   986 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.439108 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.480964 29253 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:56.481819 29252 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:56.482394 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.483134  1104 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.484279   872 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:56.485358   872 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.461213 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:56.410416  1097 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:12:56.479724  1067 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.491235 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.479851 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.468622  1048 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.504565 28695 leader_election.cc:400] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:56.504952 28695 leader_election.cc:403] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.492822 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:56.508671 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47774.7us
I20260709 13:12:56.504281 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.513525 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.513724   905 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.513927 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:56.514384 29256 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.515059 28577 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:56.519783  1112 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:56.520457 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:56.520643  1112 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.522416  1052 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:56.522119  1112 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.522949  1052 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.524097  1052 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.525475 29259 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:56.511475 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.529479 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.529857 28576 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:56.531889 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:56.532763 28573 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:56.533170   621 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:56.473515   877 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.535863   621 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.537071   621 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.535228 29223 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:56.538211   877 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:56.557372 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 197632us
I20260709 13:12:56.567016 28580 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:56.571594  1109 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.473170   580 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:56.575742 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 103537us
I20260709 13:12:56.577621  1081 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:12:56.580792 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.581429  1066 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:56.582877 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:56.589123 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:56.590512 28652 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:56.578513 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.561645   877 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.524855  1007 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.608172  1113 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:56.608664  1113 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.610024  1113 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.612387  1113 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.614631   580 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:56.570001   872 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.618553 28653 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:56.619210 29259 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:56.620690 29253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b051a542445141ae99fc26201430f3ae"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:12:56.620784   877 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.622045 29253 raft_consensus.cc:606] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
W20260709 13:12:56.624792  1097 consensus_queue.cc:1175] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "178f22d83287460fb8c0db0ba2799895" responder_term: 11 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:56.605468  1067 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:56.645632 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:56.648448 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.647716 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:56.650380 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.652262 28653 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:56.653543 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:56.656757 29260 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:12:56.661767 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:56.662585 28580 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:56.664511 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:56.665459 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:56.665653   787 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:56.666236   787 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.666456 28722 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.666678   787 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.673285 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:56.675990 28656 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.014s
I20260709 13:12:56.678175 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:12:56.679142 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.684284 28572 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:56.691574 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:56.692631 28652 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:56.693244  1094 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:56.676636 28656 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.712005  1093 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:56.703054 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:56.712733  1037 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:56.714213  1090 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:56.729889  1090 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.733050  1090 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.734012 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:56.724160 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:56.734926  1037 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:56.735563  1037 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:12:56.694969  1121 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 13:12:56.714749  1100 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:56.692842 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53589us
I20260709 13:12:56.703740   412 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:56.707353   877 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.700886 29259 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:12:56.709993 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.722448   905 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:56.725549 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:56.740268 28647 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:56.663915  1104 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:56.737144 28722 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
W20260709 13:12:56.745223   945 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.507s	user 0.002s	sys 0.012s
I20260709 13:12:56.745787 28726 raft_consensus.cc:2368] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
W20260709 13:12:56.746241   766 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.012s
I20260709 13:12:56.755987 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:56.757306 28724 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:56.761755  1007 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.764602 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:12:56.766088  1045 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.003s
I20260709 13:12:56.766400 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.767269 28580 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:56.767711 28580 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:56.767795  1038 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.005s
I20260709 13:12:56.762254 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:56.770201  1007 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:56.772245 28580 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:56.773730 28580 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:56.781543 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:56.784363   905 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.786060 29256 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:12:56.784967   905 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.791111 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:56.751797  1052 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:56.796589 28572 raft_consensus.cc:2410] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:56.799340 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:56.801051 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:56.749531   872 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:12:56.808036  1007 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:56.808573  1007 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:56.809715  1007 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.779127   766 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:56.814273 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.817126  1007 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.811020   412 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.825328   412 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.825788 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.830556 28649 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:56.833104 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:56.833981 28653 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:56.835901 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:56.837303 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:56.837698 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:56.837960 28652 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 9.
I20260709 13:12:56.838493 28651 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 6: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:56.839351   766 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.811182   616 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.849488 28730 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:56.839782  1037 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.849422 28580 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:12:56.844586 28656 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:56.852393 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 250000us
I20260709 13:12:56.843009 29253 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 6.
W20260709 13:12:56.845116   802 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.008s
I20260709 13:12:56.853060 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:56.854471 29255 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:56.805887  1052 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.805276  1045 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:56.859520 28653 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:56.868012 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.868826 29256 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:56.871578  1052 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.866498 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:56.874943 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:56.875424 29259 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:56.882359  1122 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:12:56.859719  1104 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:56.884845 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:56.890480  1016 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:56.891148  1016 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:12:56.886767 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.892405  1016 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.894173  1045 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:56.897396 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 98921.2us
I20260709 13:12:56.879866   616 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.905308  1094 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:56.905648   616 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.908106 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:56.884136 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:56.909584 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:56.910144   766 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:56.910498  1109 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:56.910691  1048 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:56.911224   999 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.911401  1048 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:56.911319  1109 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:56.912868  1048 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.915341 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:56.917506 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:56.912868  1109 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:56.918378 28724 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:56.915725 28696 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:56.917557 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:56.919622  1104 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:56.920502  1104 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:56.920871 28696 leader_election.cc:400] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
W20260709 13:12:56.911350 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44022us
I20260709 13:12:56.930737 28695 leader_election.cc:400] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14.
I20260709 13:12:56.934661 28695 leader_election.cc:403] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:56.928467 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:56.883564   621 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:56.950728 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 49977.7us
I20260709 13:12:56.960992 29259 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:56.967176 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:56.969666 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:56.976145 28580 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:12:56.977365 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.977610 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:56.977890 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.975154 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 54436.7us
I20260709 13:12:56.957648  1094 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14.
I20260709 13:12:56.980075 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:56.982957 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:56.953346  1045 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:56.925542   616 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:56.982461   937 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:56.979620  1037 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.001319 28721 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:57.000690 28696 leader_election.cc:400] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14.
I20260709 13:12:57.002086 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:57.009483 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:56.990767   937 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:56.990295  1007 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:12:57.014416  1038 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:57.024641   937 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.045823 28580 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:57.060169 29251 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:57.060885 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 87295.8us
W20260709 13:12:57.062397 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53047.9us
I20260709 13:12:57.073235 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:57.074123 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:57.053525   802 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.077085 28721 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:57.078596 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.088379 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:57.089866 28724 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:57.090559 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.088850   766 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:57.104067 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 119890us
I20260709 13:12:57.063831  1104 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.093920   621 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:57.115797 28696 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:57.117157   986 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:57.121615  1094 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:57.124541 28572 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:57.118399   802 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:57.127815 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 150403us
I20260709 13:12:57.128419 28572 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:57.130877 28621 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:57.137636 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:57.140163 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:57.142913   621 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.143571   621 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.146581 28621 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:57.139294 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:57.146157 28572 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.150875 28572 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.150698 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:57.145845  1113 consensus_meta.cc:287] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.009s
I20260709 13:12:57.120428   787 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.147488  1093 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:57.131891   905 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:57.155762 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 71393.5us
I20260709 13:12:57.159881 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:57.149782   766 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:57.161784  1063 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.938s	user 0.015s	sys 0.004s
I20260709 13:12:57.169317  1063 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.171609  1063 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.172441 28726 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:12:57.174484   787 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.175402 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:57.175778 28576 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:12:57.177028 28577 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:57.180236  1113 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:57.180958 28581 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:57.151634  1016 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:57.182615  1016 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.182988  1016 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.183406   905 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.160717  1093 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.162253  1094 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:57.185185   998 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:57.162384  1089 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.156402  1038 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:57.186535  1038 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:57.187590  1038 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.162259   526 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:57.145107   412 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.185591  1093 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.165035 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.194555 28724 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:12:57.203045 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52419.9us
I20260709 13:12:57.205550 28722 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:12:57.206290 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 51677.6us
I20260709 13:12:57.208737 28728 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:57.209573 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:57.212224 28581 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.213135 28696 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:57.213842 28653 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:57.217928   999 raft_consensus.cc:993] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:12:57.218465   999 raft_consensus.cc:1081] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:12:57.215108 29224 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.220515   999 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:57.220923   999 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.221299   999 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.225677   986 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.225749   526 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:57.228492 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:57.229786   986 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:57.230518   906 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.231171   906 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.205965  1090 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:57.230005 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65162.5us
I20260709 13:12:57.227265  1094 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:12:57.236102 28546 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:57.230019 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:57.244643  1134 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:57.245323  1134 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:57.245810  1134 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.244730   906 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:57.252562 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:57.253711 28653 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:57.265568   412 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.267381 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:57.268226 29254 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:57.269219 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.278671 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:57.281653 29256 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:57.282101 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.283443 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.283660   905 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:57.284204   766 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:57.285746   766 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:57.229210  1063 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:12:57.287340 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.288028  1048 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:57.288652  1048 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.261564 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:57.288805 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.291498 29260 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:57.300038 28572 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:57.289193  1090 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.301677 28581 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:57.304798 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:57.305446 28649 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.289690  1089 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:57.309664   937 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:57.310940   904 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:12:57.314507 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:57.330250 29254 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:12:57.294775   412 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:57.295711   621 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:57.337446 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:12:57.350682 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 125400us
I20260709 13:12:57.356534 28696 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:57.337975   766 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:57.335058  1089 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:57.339107  1037 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:57.349226  1045 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:57.365759 28649 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:57.335443  1052 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:12:57.340787  1063 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:57.355890   937 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:57.345932  1067 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:12:57.371744 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.366714 28726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b051a542445141ae99fc26201430f3ae"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:44608
I20260709 13:12:57.378674 28726 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:57.379139 28726 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.361163  1112 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:12:57.383749  1016 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:57.384977 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 96282.8us
I20260709 13:12:57.385716 29252 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:12:57.386009 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.387665 28620 leader_election.cc:400] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12.
I20260709 13:12:57.356570   412 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.376525  1104 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:57.389420  1093 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.393313 28573 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:57.394681   412 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.394879  1093 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:57.383777   877 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.399514 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:57.399919  1094 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:57.400331  1094 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:57.387544  1037 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:57.401326  1094 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.403076  1094 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:57.364289   766 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:12:57.406025   766 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.387080  1089 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.392652 28722 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:57.384371 28545 leader_election.cc:400] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11.
I20260709 13:12:57.414968 28647 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
W20260709 13:12:57.421782  1133 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.296s	user 0.003s	sys 0.000s
I20260709 13:12:57.423372  1104 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:57.424413   877 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.425096   877 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.426281 28581 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:57.428552   877 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.424597  1104 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.432437 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:57.438923 28647 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:12:57.433533 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.436889 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:57.447096 28729 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:57.442858 28726 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:57.433319  1126 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:12:57.455845 28728 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:57.446041 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:57.446409 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:57.460531 28726 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.461681 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:57.463272 28722 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:57.466645 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:57.467537 29259 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:57.467832  1048 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.467924 29259 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:57.471280  1038 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:57.473058 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:57.473582 29251 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:57.472121 29259 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.412793  1045 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.478371   711 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:57.478829   711 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:57.479802  1045 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:57.479674   711 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.475768 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:57.481246 29253 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:57.482486 29259 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.447803 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:57.484259 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:57.453925   877 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:57.494741  1134 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.495337  1016 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:57.497609  1049 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:57.498072  1049 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:57.498507  1049 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.498781 28656 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:57.499759 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:57.499917 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 115692us
W20260709 13:12:57.500993 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 112112us
I20260709 13:12:57.435045  1063 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.445341   580 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:12:57.503118 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:57.506453 29251 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:57.505704 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:57.488577   711 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.505836 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:57.507400 29252 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:57.512437 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:57.513746  1143 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:12:57.511152   937 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:57.516100   906 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:57.516803   787 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:57.516654   999 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.517941 29255 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:57.516701   906 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.518859   906 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:57.524487 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:57.525102 28579 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:57.525712   986 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:57.525867 28656 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:57.528261 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.531940 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.503929  1134 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:57.537513 28725 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:12:57.539503 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:57.539775 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:57.539541 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:57.540495   999 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:57.540745 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:57.541383 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:57.541572 28581 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:57.541960  1142 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:12:57.543067  1142 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:57.543454  1142 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:57.544904 28647 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:57.533965   937 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:57.546095   937 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.550799 28649 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:57.553192 28546 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:57.558704 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:57.559630 28653 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:57.499310   526 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:12:57.501772  1007 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:57.508574   877 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:57.533622   986 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.564287   412 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:57.544549  1142 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.569490 28579 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:57.578589 28653 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:57.590150 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:57.602830 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:57.588042  1094 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:12:57.608045 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:57.629561 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53693.7us
W20260709 13:12:57.630841 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.633759 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:57.634553  1142 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.636926  1104 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.601873  1016 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.601297  1067 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:12:57.628818  1109 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:57.645707   877 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.646725 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:57.697160 28651 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:57.648051  1145 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:12:57.648245  1143 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:57.606740 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:57.588321   904 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:12:57.675482  1104 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.677138  1094 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.678225  1037 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:57.678399 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75446.2us
I20260709 13:12:57.652688 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:12:57.684448 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 75964us
I20260709 13:12:57.606462  1089 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:57.698364 29259 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
W20260709 13:12:57.719798 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 117642us
I20260709 13:12:57.685448   787 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:57.738178 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:57.738520 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:57.739614  1154 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:57.713949   412 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:57.718334  1038 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.714139  1143 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:57.740096  1154 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:57.695930  1016 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.725023  1109 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.725569  1089 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:57.756168 28573 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:57.745508   621 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:57.749682  1063 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:57.746757   616 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:12:57.755946   872 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:57.745985  1097 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:12:57.760639  1048 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:57.761067  1089 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.762661   711 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:57.767401   621 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.797907 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:57.777525   872 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:57.760974  1109 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.786742  1134 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:57.813503  1151 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:12:57.770624  1067 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:12:57.814587  1147 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:12:57.798755   621 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:57.846120 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 121725us
I20260709 13:12:57.787714  1045 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.761368  1038 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.869469 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:57.892486 28572 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:57.829880   872 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:57.983346 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 330740us
I20260709 13:12:57.987074 28576 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:57.988165 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 229606us
I20260709 13:12:57.841506  1134 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.986609 29256 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:57.844295   711 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:57.915091  1093 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.923980   986 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:58.010756 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:57.902850  1045 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.015312 28581 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:12:58.010669 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.018419 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:57.851254   412 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.829169  1143 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.893081   787 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:57.993444  1049 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:58.003552  1094 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:58.044977  1144 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.026031  1093 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:58.049721  1168 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.036932  1104 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:58.064641  1160 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:58.064744   999 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:12:58.071111 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 72120.2us
I20260709 13:12:57.893244  1154 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.091831 28651 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:12:58.093271 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:58.095347 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.107621 28723 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:58.107824 28649 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:58.070395   616 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:58.116822 28649 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:58.120342 28651 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:58.104650  1143 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.140801 29256 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:58.101295   999 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:58.145737 28651 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:58.095463  1063 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:12:58.115373  1104 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:12:58.143383 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 82215.4us
I20260709 13:12:58.092669  1144 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:58.155884 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 128952us
I20260709 13:12:58.179235 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:58.218173 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:58.222352 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:58.223533 28577 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:58.122098   616 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.162320  1104 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:58.163296  1100 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:58.173674   526 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:58.105962  1168 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.215173  1109 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:58.220726   580 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.265123  1104 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:58.334918 28655 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:58.241147  1038 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:58.334369 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 116705us
I20260709 13:12:58.282641   766 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.344543 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:58.293437   711 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:58.333266  1145 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:12:58.338917  1134 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:58.336930  1109 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:58.364148 28655 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:58.346138  1045 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:58.267469   999 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:58.358765  1170 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.340s	user 0.002s	sys 0.000s
I20260709 13:12:58.295804  1100 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.389762  1109 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:58.374732   906 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.006s
I20260709 13:12:58.454325 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:58.457317 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:58.468612 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.468837 28655 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:58.355525   711 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.474026 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:58.305199   526 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.365469  1063 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:58.479004 28722 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 7.
I20260709 13:12:58.474759 29251 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:58.354023   580 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:58.458642  1142 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.778s	user 0.014s	sys 0.000s
I20260709 13:12:58.353327   766 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.498251 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:58.456137   877 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:58.363756   909 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.175s
I20260709 13:12:58.499899 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.502002 29255 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:58.467037  1093 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:58.506534 28581 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:58.509696 29224 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:12:58.484194  1045 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.486040  1063 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:58.535154 29251 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:58.542203 29256 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:58.544696 28649 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:12:58.545517  1194 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:12:58.546025  1045 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:58.547077  1177 log.cc:927] Time spent T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.106s	user 0.000s	sys 0.009s
I20260709 13:12:58.533501  1144 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:58.549811 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.550786 28652 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:58.551493 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.479668   906 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.486320   711 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.548688  1045 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:58.585129 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 131412us
W20260709 13:12:58.556242 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 101671us
I20260709 13:12:58.589197 28651 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:58.538699  1063 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:58.599157 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:58.587982  1156 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:12:58.548615  1168 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:58.605222 28652 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:58.606058 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:58.604485 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 432144us
I20260709 13:12:58.608541 28651 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:58.610504 28696 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:58.534926   877 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.617945  1195 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.618505  1109 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:58.618577  1195 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.621044  1179 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.175s
W20260709 13:12:58.624058  1181 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:12:58.629387  1165 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:58.629985  1165 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.630404  1165 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:58.630935   580 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:58.633242   909 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:58.633816   909 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:58.634886   909 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:58.580029  1097 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:12:58.637288  1097 consensus_queue.cc:1243] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:58.638880   526 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:58.639855   877 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:58.640540  1168 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:58.640667   906 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:58.641342  1168 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:58.642550  1168 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.646087   766 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:58.646874  1089 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.000s
I20260709 13:12:58.647328  1089 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.651391  1100 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:12:58.655938   872 consensus_meta.cc:287] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.001s
I20260709 13:12:58.656673   711 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:58.656374   872 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.671276 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.620893  1195 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:58.676961   872 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:58.673847 28652 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:58.680590  1089 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:12:58.681529   621 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.001s
I20260709 13:12:58.682090   621 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.685420  1063 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:58.687115  1202 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:58.688077  1142 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:58.688551  1202 consensus_queue.cc:1243] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:58.687458 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:58.690127  1038 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.690654  1038 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.691515  1203 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:58.692870  1038 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:58.693065 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:58.694998  1200 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:58.696229 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.693943  1202 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:58.696779 28647 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:58.698254 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.696811 28649 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:12:58.698850 28656 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:12:58.702019 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:58.702930  1175 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:58.704857 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.705513 28656 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:58.711174  1175 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:58.711521 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.712610 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.713091 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:58.713718 28647 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:58.714524 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.716171 28649 pending_rounds.cc:85] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 8
I20260709 13:12:58.716413 28649 pending_rounds.cc:107] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:58.716667 28649 raft_consensus.cc:2889] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:58.684690   621 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:58.674275 28655 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:58.713644 28656 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:58.579758   616 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:58.720088  1143 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 13:12:58.731328 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:58.733489  1202 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.747931  1049 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:58.748453  1202 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:58.751502  1202 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:58.735085 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:58.756552 28725 raft_consensus.cc:2410] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:12:58.756791 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 418326us
I20260709 13:12:58.757624 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:58.761431 28647 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:58.773500 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:58.777396 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.778231  1143 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:58.779053  1143 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.780166  1206 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:58.780680  1206 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.781064  1206 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:58.784737 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.785465 28728 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:58.778769 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.779549 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.788303 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:58.788393 28727 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:12:58.767102  1203 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:58.786839 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:12:58.794931 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 197503us
I20260709 13:12:58.769361  1200 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:58.744192  1104 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:12:58.796972 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 179680us
I20260709 13:12:58.806522 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:58.804672 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:58.799145 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:58.801781 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:58.796406 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:58.814219 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:58.858068 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:58.858995 28722 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:58.801101  1202 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:58.871438 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:58.873745 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:12:58.874852 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 60758.9us
I20260709 13:12:58.870095 28577 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:58.876075 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.877250 28647 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:12:58.879109 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:58.880015 28722 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:58.882748 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:58.881378 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.885658 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.886054 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.886421 28727 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:12:58.887889 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:58.891088 28728 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:58.891489 29256 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:12:58.891896 29256 pending_rounds.cc:85] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 9
I20260709 13:12:58.892231 29256 pending_rounds.cc:107] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:12:58.892618 29256 raft_consensus.cc:2889] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:58.800096   872 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:12:58.861685   802 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:58.906939 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 395677us
I20260709 13:12:58.908496 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.909904 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.911063 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.911942 28655 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:58.880792  1104 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:58.870822  1202 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:58.872902  1142 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:58.909271 28730 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:12:58.917493 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:58.917678 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 118665us
I20260709 13:12:58.796541  1203 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:58.889823  1089 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:58.921728 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:58.928066 28656 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:58.922514 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:58.929520 28655 raft_consensus.cc:2368] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:12:58.924314 28647 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:58.925964 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:58.882107  1093 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:58.926292 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.912557   802 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.809880  1200 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:58.947014 28726 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:12:58.949826 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:58.971501 28726 pending_rounds.cc:85] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 11
I20260709 13:12:58.972112 28726 pending_rounds.cc:107] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:12:58.972554 28726 raft_consensus.cc:2889] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:58.999207 28656 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:58.924996  1202 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:58.938689 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:58.925733  1207 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:12:59.018424 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 79790.6us
I20260709 13:12:58.931442  1089 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:58.941296  1209 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:12:58.941788  1208 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:12:59.021874 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:58.941380  1183 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:59.005923   711 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:58.940433  1180 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.945479   802 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.940337  1186 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:58.939941  1187 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:59.021477   621 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.023919  1063 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:58.949244  1143 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.029078  1183 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.939811  1210 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:59.028659 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 224053us
I20260709 13:12:58.930799  1142 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.036913 29224 leader_election.cc:400] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:12:59.050908 29224 leader_election.cc:403] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:59.030838   711 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.056056  1142 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.039819   986 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.931845  1154 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:59.056936   986 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.057659  1204 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.048606  1175 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:59.058247  1204 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.058360  1175 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.059504   986 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.025233  1089 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.060446  1204 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:12:59.025684 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 101442us
I20260709 13:12:58.952302  1165 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.046150   621 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.062155 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:59.045262 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.046198 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.056054 28651 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:59.063247  1165 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.051550 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.069330 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.060451  1175 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.070591  1216 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.071187  1216 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.043769  1168 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:59.077809  1226 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:12:59.080128   872 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:59.080644  1206 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.052372 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:59.054034 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:59.083666 28578 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.027525  1207 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.084854  1168 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:59.085516  1168 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:59.086203  1207 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.086465  1168 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.038035  1186 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:59.087491  1186 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.054374  1097 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.054761  1100 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.054034  1212 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:59.048744  1183 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:59.054028  1184 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:59.091305  1184 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:59.090972  1100 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.091706  1184 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.091015  1212 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.056259   711 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.057109  1154 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:58.955098  1093 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.049258  1210 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.096426  1210 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.044924 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.063206   621 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.083112  1206 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.040859  1187 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.098831 29224 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:59.100212 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.103709 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.108349 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:12:59.109376 28578 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:59.115371 28656 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:12:59.125377 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:59.128252 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.129736 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.130589 28655 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:59.118678 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.134528 28650 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:59.106348  1187 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.106882  1142 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:59.150152 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.116547   621 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:59.128391  1052 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:59.148859 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.150902 28650 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:59.134786   986 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:59.136859  1165 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.162591 28654 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:59.163118 28655 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:59.166246   986 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.171345   986 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:59.171779  1224 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:12:59.150043  1142 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.183398  1142 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.184662  1165 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.185413  1232 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.185985  1232 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.186975  1165 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.188024  1171 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.188122  1232 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.188627  1171 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.190816  1171 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.175707  1093 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.176082 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.176584  1216 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.148818  1100 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.165921 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.195395  1232 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:59.196264  1232 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.155225  1143 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.197081  1143 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.196962  1232 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.198827  1203 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.199412  1143 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.201426  1154 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.171527  1228 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.201910 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.202409  1228 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:59.180317 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.181712  1045 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:59.205039 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.205737 28576 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:12:59.171214  1225 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:59.206629  1225 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:59.182690  1212 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.207347  1184 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.207618  1225 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.208149   872 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.208725   872 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.201355 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.201125   526 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:59.165870  1169 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.204277  1200 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.219233 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.196708 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:59.213857 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:59.209229  1218 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:12:59.224045 28575 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:59.224334 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.225050 29256 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:59.227586 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.235877 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.236184 29253 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:59.235847 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.237938 28727 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:12:59.238193 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.238721 28654 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.239580 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:59.218793  1212 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.239612 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:59.247248  1227 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.228209  1184 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.222327   872 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.277833 29254 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:59.278687 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.279278 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.280532 28579 raft_consensus.cc:2368] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11.
I20260709 13:12:59.283296 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.283926 28577 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:12:59.226023  1169 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.292011  1097 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:12:59.291859  1210 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.293390  1169 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.293434 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.280104  1227 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.300454 29252 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:59.218111   986 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.309948 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.222071  1089 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:59.285585  1192 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.729s	user 0.000s	sys 0.003s
I20260709 13:12:59.316373 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.326462 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.327055 29253 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:59.327412 28722 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:12:59.279564  1143 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.317915  1157 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 1.425s	user 0.006s	sys 0.008s
I20260709 13:12:59.335505 28654 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:12:59.320197  1178 log.cc:927] Time spent T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 1.082s	user 0.003s	sys 0.000s
I20260709 13:12:59.321411 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.338445 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.339103 28580 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:59.321465 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:59.323293 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.340003 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.277396  1212 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.328680 29223 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.343544 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:59.314872 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:59.334578 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.344251 28579 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:59.318892  1016 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.345206 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:12:59.340610 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.341333 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.342113 28575 raft_consensus.cc:2368] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11.
I20260709 13:12:59.336566 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.344822 29254 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:12:59.342939  1171 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:59.345585  1237 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:59.348248  1171 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.348404  1228 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.348556   872 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:59.348702  1171 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.351321  1232 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.352308 28575 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:59.354475 28577 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:59.354540  1089 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.356844 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.346546 28727 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:59.359448 28580 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:59.359576 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.360438 28654 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:12:59.334146  1180 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:59.346791 28722 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:12:59.363226  1227 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.343348 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1098) took 1507 ms. Trace:
I20260709 13:12:59.365804 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.374368  1202 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.375674 28724 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:59.345400  1052 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:12:59.376832  1052 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.377859   986 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.379232  1052 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.364327  1203 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:59.380693  1203 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:59.381407 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.381819  1203 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.382579  1187 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.383795 28572 raft_consensus.cc:2368] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15.
I20260709 13:12:59.382068 28723 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:12:59.385704 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.386428 29254 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:59.378998 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.387445  1212 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.387233 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.389789 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.391085 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:59.357254  1193 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:59.393870 28579 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:59.391064 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:59.395416  1193 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:12:59.399583  1193 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.366796 28653 rpcz_store.cc:276] 0709 13:12:57.832948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.833233 (+   285us) service_pool.cc:224] Handling call
0709 13:12:57.833680 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.850676 (+ 16996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.850730 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:57.875612 (+ 24882us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.682548 (+806936us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b18002ff5c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1
0709 13:12:58.682718 (+   170us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:58.683047 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.698919 (+ 15872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.698998 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.319578 (+620580us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:12:59.339881 (+ 20303us) raft_consensus.cc:1685] finished
0709 13:12:59.339905 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.340047 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15630,"prepare.queue_time_us":694,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":34401,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":27519,"spinlock_wait_cycles":65575168,"thread_start_us":141442,"threads_started":1,"wal-append.queue_time_us":204028}
I20260709 13:12:59.398257  1212 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:59.356832  1154 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:12:59.402169  1212 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.402884  1212 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:59.310782  1186 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.404825 28722 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.405115 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.408053 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:59.408460  1113 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:59.408908  1113 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.409375  1195 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:59.410324 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:12:59.411814  1244 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:12:59.429226 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.429962 28647 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:59.430183 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.430788 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.430856  1227 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:59.431265  1171 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.393327  1089 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:59.432101  1089 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.432504  1089 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:59.381721  1202 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.434897 28695 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:59.435295 28695 leader_election.cc:403] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:59.435892  1104 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:59.435966  1142 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.406600 28621 leader_election.cc:400] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11.
I20260709 13:12:59.438345 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:12:59.439311 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:12:59.418006 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.407200  1187 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.419602 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:59.405546  1186 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.421494  1210 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.421986  1052 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:59.340790  1143 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.315625  1183 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.400854  1193 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:59.426699 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.497400 28579 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:12:59.426995 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.498656 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.431515 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:59.395939   802 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.418416  1180 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:59.441242 28621 leader_election.cc:400] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11.
I20260709 13:12:59.443327 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.508438 28621 leader_election.cc:403] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:59.448704 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.509181 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.409350  1113 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:59.516357 28578 raft_consensus.cc:2368] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17.
I20260709 13:12:59.410907 28654 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:12:59.360800   711 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:12:59.460565 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.470317  1232 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.471031 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:59.472532 28722 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:12:59.475860  1253 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.476540 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.482154  1052 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.503549 28577 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:12:59.501185 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:59.507509 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:12:59.476893   986 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.525018   986 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.447089 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.450917  1049 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:59.502368  1097 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.461593 28647 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:59.520344 29254 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.529935 28656 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.498221 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.504705 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.533289 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:59.540019 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.535045 28650 raft_consensus.cc:2368] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:12:59.538089 28721 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:12:59.517379  1175 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.502177  1089 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.600147 29256 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:59.522665  1180 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:59.646027 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:59.532495  1253 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.653609 28723 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.654080 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:59.654290 28648 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:59.653920  1180 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.568797  1100 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:59.569098  1203 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:59.528875  1252 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11.
W20260709 13:12:59.656505 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 123294us
I20260709 13:12:59.616959 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.656080 29256 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:59.616951 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.547797 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:59.541587  1168 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:59.568591 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.548098 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.672904 28654 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:59.671197 28656 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:59.675650 28647 raft_consensus.cc:2368] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:12:59.557811 29254 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:12:59.679107 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.680114 28651 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.531742  1052 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:59.685578 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 244458us
I20260709 13:12:59.686281 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.661501 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.690021 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.691059 29254 raft_consensus.cc:2410] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:12:59.689450 28575 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:59.695241 28652 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:59.547261  1045 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:59.535046  1093 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:59.658515  1251 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.701556 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:12:59.680768  1168 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.656539  1203 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.660097  1252 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:59.701169 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:59.719839 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.719126 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.722824 28654 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:59.597982  1097 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.541201  1049 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.725798 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.727401 28730 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:12:59.707209  1109 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:59.702147   621 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.703322  1142 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:12:59.686635  1175 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.719949  1168 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.723325  1203 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.723771   580 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:12:59.741731 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:12:59.742986 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.748584 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:12:59.745362 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:59.730947  1232 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:59.740895 29257 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:12:59.737341  1171 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.754562 28651 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:12:59.737704  1109 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.760217 28723 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:12:59.773391  1089 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.769225  1183 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.775400  1253 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.776317  1253 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:59.763464  1232 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.747711  1143 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.760589  1254 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:12:59.782214 28725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2682) took 1771 ms (client timeout 2085 ms). Trace:
W20260709 13:12:59.782694 28725 rpcz_store.cc:269] 0709 13:12:58.010405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.010521 (+   116us) service_pool.cc:224] Handling call
0709 13:12:59.781991 (+1771470us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54002341d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:12:59.782125 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712581376}
I20260709 13:12:59.740792   621 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.783943 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:12:59.784549 28725 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.774268  1097 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.788107 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:12:59.720216  1251 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:12:59.786408 28654 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:12:59.784895  1016 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:59.787108  1171 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:12:59.796950  1171 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.799006  1255 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:12:59.799628  1255 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.801646  1255 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.803237   621 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.767025  1109 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:59.812289 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.814481  1016 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.815670 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1690) took 1331 ms. Trace:
I20260709 13:12:59.816962 29251 rpcz_store.cc:276] 0709 13:12:58.484625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.484924 (+   299us) service_pool.cc:224] Handling call
0709 13:12:58.485227 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.535687 (+ 50460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.815366 (+1279679us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b54005f0354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:59.815569 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55026944}
I20260709 13:12:59.814101 28721 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:12:59.819043 28721 pending_rounds.cc:85] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 10
I20260709 13:12:59.819331 28721 pending_rounds.cc:107] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:12:59.819676 28721 raft_consensus.cc:2889] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:59.831645 28725 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
W20260709 13:12:59.790828 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 72820.7us
I20260709 13:12:59.733500  1252 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.791038 28651 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:59.791518 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1168) took 2002 ms. Trace:
I20260709 13:12:59.791652 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.836730 28656 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.840431 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.842355 28651 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:12:59.844434 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:12:59.838610 29223 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:12:59.819849  1097 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:59.833755   999 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:59.846976  1255 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:59.862356  1112 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:12:59.868423 28725 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:59.846946  1199 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:12:59.870460  1252 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.852288   621 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:59.871899   621 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:59.874500   621 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.877210 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.882157 28696 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:59.883656 28696 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:59.883369  1052 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.884079  1175 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:12:59.862201  1049 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:12:59.846927  1259 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:12:59.898319 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.899278 28648 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:12:59.899752 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:12:59.900535 29254 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.897464 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.901660 29253 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:12:59.895038 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:12:59.888532 28620 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.085s (SENT) [suppressed 3 similar messages]
I20260709 13:12:59.906075 28651 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:59.837973 28573 rpcz_store.cc:276] 0709 13:12:57.784031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.785178 (+  1147us) service_pool.cc:224] Handling call
0709 13:12:57.798927 (+ 13749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.857912 (+ 58985us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:58.803876 (+945964us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b18004591c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a2b80e3c7 00007f4a27e209a7 00007f4a27e300bf
0709 13:12:58.804020 (+   144us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.035683 (+231663us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:59.781470 (+745787us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b2c000014c8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:12:59.782016 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.782192 (+   176us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:59.782231 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.783462 (+  1231us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b54003525d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:12:59.783517 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.785790 (+  2273us) raft_consensus.cc:1685] finished
0709 13:12:59.785812 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.785930 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8027,"prepare.queue_time_us":143724,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":43641,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":25660,"spinlock_wait_cycles":188184064,"thread_start_us":159321,"threads_started":2,"wal-append.queue_time_us":211955}
I20260709 13:12:59.916275 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:59.916857 29260 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:12:59.908954 28726 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:59.910202 28656 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:12:59.931870 29254 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:12:59.890785  1143 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:59.896926  1097 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:12:59.940490 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:12:59.942214 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.895887  1142 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:59.889947  1063 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:59.941946 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:12:59.939462 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 190951us
I20260709 13:12:59.923619  1202 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:59.937899  1104 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:12:59.896425   526 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:12:59.941679  1180 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:59.964469 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:12:59.962831 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:12:59.974001 28648 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.895833  1186 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:12:59.974257 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:12:59.975103 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:12:59.959879  1187 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:59.987617 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:12:59.953795  1142 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:12:59.945350  1007 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:12:59.982987  1225 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:59.967599  1063 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.996301  1142 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.992713  1187 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:12:59.956357  1154 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:12:59.994176  1180 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:00.003667 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.083045  1180 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:00.083521 28652 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:00.083626  1180 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.014058 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:00.027244 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 53092.6us
I20260709 13:13:00.087649 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:00.005944  1193 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.004s
I20260709 13:13:00.016460 28648 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:00.035784   621 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.091189   621 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.998294  1232 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:00.093391  1260 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:00.096434 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:00.002432  1262 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:13:00.041950  1063 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:00.051668 29252 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:13:00.110690 29252 pending_rounds.cc:85] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 9
I20260709 13:13:00.110978 29252 pending_rounds.cc:107] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:13:00.111243 29252 raft_consensus.cc:2889] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:00.050396  1168 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:12:59.981498  1109 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.066387 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.072947 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.073899 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:00.117455 28655 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:00.117956 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 44130.7us
I20260709 13:13:00.076151 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.077147 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.019956  1251 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:00.082195  1261 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:00.100871 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.028345  1225 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:00.108624 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 193567us
W20260709 13:13:00.020501  1212 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.617s	user 0.016s	sys 0.000s
I20260709 13:13:00.078680   909 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:00.177563 29258 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:13:00.120206 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:00.123696 28656 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:00.019196  1052 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:00.104136   621 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:00.112056  1174 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.013651  1097 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:00.177032 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 288497us
W20260709 13:13:00.183306 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63171.8us
I20260709 13:13:00.153324 29256 raft_consensus.cc:2368] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:00.181370  1007 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:00.191632 28647 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:00.131503   616 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:00.195024 28655 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:00.199584  1205 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:00.219617  1113 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.002s
I20260709 13:13:00.220055  1270 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:00.142014  1225 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:00.223464 28696 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:00.211066 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:00.237653 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 148646us
W20260709 13:13:00.240329 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.240907 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.245092 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.245961 28580 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:00.220127  1264 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:13:00.244272 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.248934 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:00.255257 28578 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:00.221427  1007 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.187040  1212 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.235276  1199 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:00.256506  1263 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:00.225811   621 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:13:00.276254 28580 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:13:00.246323  1113 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.255661   616 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:00.225572  1174 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.259341  1268 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.237447  1186 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:13:00.260285  1007 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.281100 29251 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:00.266301  1270 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:00.273537   906 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:00.269258  1081 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:00.287870 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 251191us
I20260709 13:13:00.295989 29259 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:00.247853  1187 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.278116  1199 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.297420  1270 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.302853  1199 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:00.305684  1081 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:00.286732  1246 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.747s	user 0.005s	sys 0.000s
I20260709 13:13:00.319128  1180 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.322604  1180 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:00.285576  1263 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:00.341782  1263 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:00.345963  1272 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:00.346127  1212 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:00.363498 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:00.365417   909 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:00.367465   909 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:00.367573   412 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.368746   616 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.371650  1277 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.372327 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2694) took 1016 ms. Trace:
I20260709 13:13:00.372772 28722 rpcz_store.cc:276] 0709 13:12:59.355999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.390862 (+ 34863us) service_pool.cc:224] Handling call
0709 13:13:00.372124 (+981262us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54002332d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:00.372255 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29432704}
W20260709 13:13:00.332924  1266 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:13:00.358371  1113 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:00.370882  1016 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:00.378089 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 129350us
I20260709 13:13:00.316717   906 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.361527  1168 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:00.371690   412 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:00.395236  1142 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.402284 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:00.402732   906 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:00.402653 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:00.403384  1154 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:00.387012  1203 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.623s	user 0.013s	sys 0.000s
I20260709 13:13:00.404000 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.404510  1203 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:00.405421 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.406100 28654 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:00.406565 28725 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:00.407013  1203 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:00.371054  1007 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.407465 28655 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:00.408370 28695 leader_election.cc:400] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17.
I20260709 13:13:00.408685 28695 leader_election.cc:403] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:13:00.395797   412 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:00.412688 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.387286  1016 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:00.415436 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:00.372327  1277 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.419268 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.421936 28656 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:00.422034 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:00.419668 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:00.416450  1016 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:00.415000  1260 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:00.414783  1203 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:00.420992  1276 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.058s	user 0.004s	sys 0.000s
I20260709 13:13:00.428881 28695 leader_election.cc:400] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:13:00.432927 28695 leader_election.cc:403] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:13:00.436064  1063 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:13:00.427452  1267 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:00.420370  1186 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:13:00.443408 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2689) took 1037 ms. Trace:
I20260709 13:13:00.443974 28650 rpcz_store.cc:276] 0709 13:12:59.406503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.439481 (+1032978us) service_pool.cc:224] Handling call
0709 13:13:00.442926 (+  3445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.443105 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.443129 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:00.443171 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:00.443208 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.443259 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.443354 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.445925 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.435777  1260 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:00.449805 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.450407 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.452575 28650 raft_consensus.cc:2368] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:13:00.445602  1267 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:00.457368  1267 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:00.458211 28724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 2122) took 1600 ms (client timeout 2089 ms). Trace:
I20260709 13:13:00.458886   986 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:00.451792  1016 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:00.467214  1016 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.467777  1277 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:00.468758  1278 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:13:00.470718  1260 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.461418  1142 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:00.474020 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:00.475021 28581 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:13:00.477025 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2691) took 1035 ms. Trace:
I20260709 13:13:00.477425 28649 rpcz_store.cc:276] 0709 13:12:59.442165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.476253 (+1034088us) service_pool.cc:224] Handling call
0709 13:13:00.476523 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:00.476678 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.476704 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:00.476752 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:00.476791 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:00.476844 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:00.476952 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:00.479347   711 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:00.482924  1225 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.485356 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.486964 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1176) took 1443 ms. Trace:
I20260709 13:13:00.487371 28572 rpcz_store.cc:276] 0709 13:12:59.043789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.043906 (+   117us) service_pool.cc:224] Handling call
0709 13:13:00.486763 (+1442857us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54000ee2d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:00.486883 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656410368}
I20260709 13:13:00.493515 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.495576 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:00.458753 28724 rpcz_store.cc:269] 0709 13:12:58.858292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.859349 (+  1057us) service_pool.cc:224] Handling call
0709 13:13:00.458038 (+1598689us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54001e73d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:00.458152 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124250496}
I20260709 13:13:00.497274 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:00.498063 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.502247 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.502830 28575 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:00.504276 28651 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:00.500597  1262 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:13:00.506876  1280 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:00.507788  1225 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:00.507201  1203 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17.
I20260709 13:13:00.510627  1175 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:00.511139  1175 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:00.511881 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:00.512030  1175 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.512956  1207 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:00.514130  1183 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:00.513979  1207 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:00.514711  1183 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:00.515018  1158 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:00.515766  1158 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:00.515928  1183 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:00.516583  1158 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:00.517683 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:00.517900  1158 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.522959 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.529393 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.530462 28655 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:00.535274 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.538564 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.534879 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:00.546604 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:00.548406 29254 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:00.551029 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.551251 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.552680 28656 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:00.553719 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.555713 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.556268 28655 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:00.557461 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:00.581732 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:00.587903 28655 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:00.589212 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:00.589478 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:00.589891 28730 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:00.591907 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:00.593986 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:00.542150  1210 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:00.588661 29257 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:00.599490 29254 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:00.538117  1186 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:00.602124 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44227.6us
W20260709 13:13:00.625336 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.609663 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:00.634687 28727 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:00.558075  1203 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:00.635757  1277 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:00.588960  1048 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:13:00.649062 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:00.576778   986 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:00.550076  1283 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:00.635385  1186 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:00.653539  1174 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:00.666411  1175 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:00.667136 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.668452 28727 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:00.672148 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:00.673261 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.730643 29252 raft_consensus.cc:2410] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:13:00.731596 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.677273 28724 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:13:00.730684 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 58667.6us
I20260709 13:13:00.733269  1048 consensus_queue.cc:1243] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:00.733598  1277 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:00.734068 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:00.734694 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 85753.5us
I20260709 13:13:00.734913   412 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:00.735625  1268 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:00.737341  1268 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.738025  1268 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:00.734738  1277 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.684303 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.589128  1207 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:13:00.732694 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:00.751926 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:00.690630  1283 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.708277  1260 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:00.559044  1274 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.171s
I20260709 13:13:00.607327   580 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:13:00.757689 28575 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:00.757261 28696 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:00.773609 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:00.774380 28580 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:12:59.298413 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:00.775956 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:00.771436 28574 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:13:00.782456 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.685559  1203 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.785893 28574 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:00.818699 29253 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:00.707990   986 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:00.821527 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:00.760411  1283 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:00.806075  1278 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:00.838934 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:00.818473   802 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:00.848244 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:00.850077 28728 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.805428  1113 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:13:00.830165  1268 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:00.773598  1260 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:00.827986  1232 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:00.863427 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:00.855198  1187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.002s	sys 0.018s
I20260709 13:13:00.881291 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:00.882258 28725 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:00.876996 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:00.886931 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:00.893019 28722 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:00.894248 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:00.874727  1263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.017s	sys 0.040s
W20260709 13:13:00.881428  1187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.002s	sys 0.018s
I20260709 13:13:00.914578 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:00.903759  1263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.021s	sys 0.040s
I20260709 13:13:00.884306  1292 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:00.926283  1289 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:13:00.927829  1287 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:13:00.930418   986 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:00.885445  1268 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:13:00.951947 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.960369 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:00.962458 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:00.995949 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:00.997686  1252 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.998405 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.999337 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:00.999929 28655 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:01.001318  1037 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:00.989945  1186 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:00.943980  1292 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:01.006910 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:00.996387  1199 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:01.021611 29256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1452) took 1286 ms (client timeout 1618 ms). Trace:
I20260709 13:13:01.023227 28730 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
W20260709 13:13:01.022228 29256 rpcz_store.cc:269] 0709 13:12:59.728592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.729202 (+   610us) service_pool.cc:224] Handling call
0709 13:13:01.014984 (+1285782us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400489ed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:01.015126 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901594496}
I20260709 13:13:01.032838 28728 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:13:01.025421  1142 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:01.035899 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:01.035993  1270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.017s	sys 0.028s
W20260709 13:13:01.003844 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 65203.5us
W20260709 13:13:01.042076 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 65132.6us
W20260709 13:13:01.041378  1270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.017s	sys 0.029s
I20260709 13:13:01.045398 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:01.041582  1203 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.055181  1260 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.039717  1263 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:01.058135  1263 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:01.059351  1109 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:01.059087  1263 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.063848 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:01.064868 28728 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.066641 28730 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:01.075788 28728 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:01.076896   580 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:01.077991 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:01.087772 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:01.093945  1203 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.110745 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:01.115862 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:01.087641  1158 consensus_meta.cc:287] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.006s
W20260709 13:13:01.092458  1016 consensus_meta.cc:287] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.003s
I20260709 13:13:01.109994  1212 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:01.133147 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.134290 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:01.122087  1307 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:01.126348  1232 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:01.148865 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.152134  1232 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:01.152372 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.152688  1232 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.138489  1307 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:01.153589 28722 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:01.153059 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.153761  1307 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:01.154410 28729 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
W20260709 13:13:01.151547 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.156198 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:01.138708  1212 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:01.162271 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:01.122179  1081 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:01.163853 28729 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:01.125973  1113 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.166368 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.151895  1267 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:01.169245  1212 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.173324  1238 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:01.174779  1291 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.286s	user 0.000s	sys 0.002s
I20260709 13:13:01.172885  1134 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:13:01.184280 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.134837  1292 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:01.197816 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:01.126524  1304 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:13:01.209906 28695 leader_election.cc:400] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:13:01.210496 28695 leader_election.cc:403] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:13:01.212258 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:01.213177  1254 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.213471  1063 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:13:01.202411  1318 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:01.203974 28728 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:01.218163  1315 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:01.218488  1279 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:01.193403  1238 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.229038  1238 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:01.228889  1279 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.193456  1016 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:13:01.222132 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:01.233376 28647 raft_consensus.cc:2368] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:13:01.234194 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.236492  1142 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:01.236725  1171 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:01.237298  1142 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.237885  1142 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:01.223954   616 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:01.239470   616 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.222960 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.231812 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:01.247287 28650 raft_consensus.cc:2410] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:13:01.180943  1081 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.187042  1113 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.261047 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:01.256361 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:01.258129 28652 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:01.262707 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:01.256706 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:01.263180 28622 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.263180 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:01.231282  1279 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:01.260927 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:01.269630 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.231451  1318 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:01.243996  1037 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:01.275890 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:01.311265 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.311508 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:01.312022 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 51170.3us
W20260709 13:13:01.313385 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 50343.6us
I20260709 13:13:01.315650  1283 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:01.317504  1316 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:01.317910   787 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:01.335572  1227 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:01.336344  1321 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:13:01.274494  1318 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:01.337054   787 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:01.337558   787 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:01.338363   787 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.326782  1037 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:01.341095  1322 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:13:01.270735  1175 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:01.350811 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.355263 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:01.339596   787 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:01.357460 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:01.361268 28581 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:13:01.363328 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:01.364984 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 105847us
I20260709 13:13:01.365885 28725 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:01.367369 28579 raft_consensus.cc:2368] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:01.243533  1254 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.317844  1016 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:01.374692 28573 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:13:01.355671  1265 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:13:01.373229 28579 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:01.375074 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.375792 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:01.313794  1267 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:01.381871 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:01.328387  1259 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:01.351183  1316 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:01.370052  1187 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:01.412039 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:01.412611 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1491) took 1532 ms. Trace:
I20260709 13:13:01.413025 28581 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:01.413484 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.414959 28621 leader_election.cc:400] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:01.415222 28621 leader_election.cc:403] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:01.416432 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:01.412968 29255 rpcz_store.cc:276] 0709 13:12:59.880395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.881297 (+   902us) service_pool.cc:224] Handling call
0709 13:12:59.881671 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.881936 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:59.882273 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.410704 (+1528431us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b18003c7000. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a
0709 13:13:01.412256 (+  1552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:01.412317 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:01.412385 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.412442 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:01.412549 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1305,"prepare.queue_time_us":628,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"spinlock_wait_cycles":10446208,"thread_start_us":145519,"threads_started":1,"wal-append.queue_time_us":145397,"wal-append.run_cpu_time_us":2218,"wal-append.run_wall_time_us":1219944}
I20260709 13:13:01.369465  1158 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:13:01.389884  1184 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:01.423906 28572 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:01.407255  1045 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.385489  1162 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:13:01.417223  1283 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:01.387506  1067 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:13:01.422302  1260 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:01.432909  1175 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:13:01.502234 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 117071us
I20260709 13:13:01.432168  1037 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:01.437386  1045 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.477571   616 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:01.498796  1296 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:13:01.523578 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:01.432292   802 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:13:01.542047   802 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:01.542557   802 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:01.544121  1320 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:13:01.543751   802 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.547789   802 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.533195  1081 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:01.533787  1323 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:13:01.523053   580 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:13:01.534665  1327 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:13:01.538823  1306 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.494s	user 0.001s	sys 0.001s
W20260709 13:13:01.623864 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 100368us
I20260709 13:13:01.478376  1252 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
W20260709 13:13:01.653074 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.658428  1154 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:01.691028 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:01.668082  1259 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:01.540608  1232 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.658499  1333 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:13:01.672502  1203 consensus_meta.cc:287] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.004s
I20260709 13:13:01.683177 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.679167   580 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:01.680593  1307 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.526s	user 0.013s	sys 0.007s
I20260709 13:13:01.688369  1254 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:01.558662  1037 consensus_queue.cc:1175] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d64d870625d6461b89b1fb75cd2e26e0" responder_term: 10 status { last_received { term: 10 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 10 index: 8 } }
I20260709 13:13:01.698129  1270 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:01.702181  1283 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:01.703166 28654 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:01.732347  1312 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.682s	user 0.000s	sys 0.010s
I20260709 13:13:01.721567   580 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.735162   580 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:01.737567  1225 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:01.738020  1225 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:01.738375  1307 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:01.738880  1225 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.740648  1307 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:01.751775 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.752921   909 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:01.753427   909 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:01.754294   909 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:01.755302 28722 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:01.755601   909 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.757815 28726 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:01.748724 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.761662 28721 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:01.763289 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:01.767813 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 340965us
I20260709 13:13:01.770645  1007 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.772573  1113 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:01.776671  1259 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:01.777182  1259 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:01.781144  1259 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.672936  1316 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:01.706375  1203 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:01.688192   802 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.785686   802 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.710427  1333 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:01.787448  1333 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:01.787825   802 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.788065  1333 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:01.711681 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:01.713563  1045 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.793708  1279 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:13:01.793883 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 82280us
I20260709 13:13:01.719422 29255 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:01.794925 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.796008  1279 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:01.794986  1045 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.782469  1227 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:01.797691  1227 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:01.798660  1227 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:01.800274  1227 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:01.705802  1232 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.694373  1154 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.803351  1154 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.803231  1318 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.804872 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:01.806344 28723 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:01.807077   711 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:01.807684   711 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:01.809538 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:01.808667   711 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:01.814184 29259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1698) took 2333 ms (client timeout 1527 ms). Trace:
I20260709 13:13:01.814940 29251 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:13:01.817592 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.818974 28574 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.841188 28654 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:01.841885 28574 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:01.821969 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:01.768656 28621 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.822988  1259 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:01.823644  1309 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.780s	user 0.005s	sys 0.004s
I20260709 13:13:01.826362 28722 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:01.847373 28695 leader_election.cc:400] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:13:01.847779 28695 leader_election.cc:403] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:13:01.796151  1142 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
W20260709 13:13:01.853740 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44283.1us
W20260709 13:13:01.854656 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 86093.1us
I20260709 13:13:01.835901  1175 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
W20260709 13:13:01.840363 29259 rpcz_store.cc:269] 0709 13:12:59.481285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.481642 (+   357us) service_pool.cc:224] Handling call
0709 13:13:01.813913 (+2332271us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540044edd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:01.814076 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804511104}
I20260709 13:13:01.856741 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:01.867314 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:01.854007  1238 consensus_meta.cc:287] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.012s
I20260709 13:13:01.872198 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:01.853636  1154 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:01.885349 28650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1123) took 1373 ms (client timeout 1757 ms). Trace:
W20260709 13:13:01.890291 28650 rpcz_store.cc:269] 0709 13:13:00.498243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.499398 (+  1155us) service_pool.cc:224] Handling call
0709 13:13:01.862617 (+1363219us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540022c254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:01.871811 (+  9194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588630272}
I20260709 13:13:01.859387  1037 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:01.859220  1081 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:01.859407  1203 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 8. Current term is 9.
I20260709 13:13:01.870826  1254 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.907936  1045 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:01.908545  1045 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:01.912220 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:01.913609  1171 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:01.914233  1171 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.914731  1171 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.859964  1279 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:13:01.889137  1238 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:01.918042  1254 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:01.919755 28577 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:01.888010  1199 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:01.889542  1154 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.871393  1067 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:13:01.908600 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:01.922340 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:01.952520 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:01.954228 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:01.955685 28581 raft_consensus.cc:2410] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:01.958431 28647 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:01.859930  1142 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:01.932495  1308 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.883s	user 0.004s	sys 0.008s
I20260709 13:13:01.923411  1154 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.921502  1199 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:01.993348 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.994155 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:01.920944  1254 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:01.954556  1175 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:01.990553 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:01.935891  1318 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.934211  1252 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:01.922673  1238 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:01.998886 28728 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:02.001055 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:02.003275 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:02.010483 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 313017us
I20260709 13:13:02.010330  1333 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.011427 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:02.012874  1227 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:02.026913 28574 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:13:02.027798   906 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:13:02.027895 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1210) took 1277 ms. Trace:
I20260709 13:13:02.001519  1254 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:01.936165  1338 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.140s
I20260709 13:13:02.018848  1333 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:02.028555 28574 rpcz_store.cc:276] 0709 13:13:00.750765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.750925 (+   160us) service_pool.cc:224] Handling call
0709 13:13:00.753179 (+  2254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.818447 (+1065268us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b4c000ae580. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a260e2a20 00007f4a260f3a29 00007f4a260b9644 00007f4a260e0f2d 00007f4a260e0b93 00007f4a27e1118b 00007f4a27e11cb5 00007f4a27e0cf30 00007f4a27e0e7de 00007f4a27e18b49 00007f4a27e19416
0709 13:13:02.027514 (+209067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.027814 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18203392}
I20260709 13:13:02.022228  1175 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.062160  1175 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.064646  1175 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:01.999197  1232 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:13:02.021592  1183 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:13:02.059089  1142 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:02.059333  1199 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:02.061223  1337 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:02.022505  1184 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:02.074239 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.059104 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1713) took 1383 ms. Trace:
I20260709 13:13:02.074988 28574 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:02.003147  1252 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.070776 28580 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:02.071800 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:02.072635 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.074054 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:02.075994 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:02.090260 29253 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:02.096316 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.097805 29260 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:02.074820 29258 rpcz_store.cc:276] 0709 13:13:00.675950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.927558 (+251608us) service_pool.cc:224] Handling call
0709 13:13:00.927951 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:00.928367 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:00.928402 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:00.928930 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:13:01.037429 (+108499us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:01.088867 (+ 51438us) log.cc:844] Serialized 14 byte log entry
0709 13:13:01.105637 (+ 16770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.105718 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:01.931379 (+825661us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:02.055045 (+123666us) raft_consensus.cc:1685] finished
0709 13:13:02.058865 (+  3820us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.059034 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18604,"prepare.queue_time_us":2570,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":28754,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":4251,"spinlock_wait_cycles":10578816,"thread_start_us":106538,"threads_started":1,"wal-append.queue_time_us":120151}
I20260709 13:13:02.071830  1339 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:02.106601  1171 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.076382  1142 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.055522  1254 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.074589  1184 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:02.136106 28581 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:02.157089 29255 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:02.158631 28575 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:13:02.159076 28575 pending_rounds.cc:85] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 8
I20260709 13:13:02.159309 28575 pending_rounds.cc:107] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:13:02.159554 28575 raft_consensus.cc:2889] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:02.159935 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:02.161433 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 284827us
I20260709 13:13:02.164325 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.172305 29253 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:13:02.180008 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.180828 28574 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:02.143826  1142 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:02.185256 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.161170  1175 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:02.185918 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:02.185657 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 313503us
I20260709 13:13:02.232785 28577 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:02.233956 28722 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:13:02.230728 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44897.9us
I20260709 13:13:02.190428 29253 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:02.235415 28724 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:02.186812  1316 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:02.141776  1339 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.162678  1259 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:02.237330 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:02.241086 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:02.245937 28721 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:02.224637  1277 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.271034 28649 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:13:02.274540 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.272413 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:02.272063 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.273365 28730 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:13:02.254321 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.269783 28724 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:02.281071 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.227459  1037 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:02.286029 28649 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:02.229440  1175 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:02.288631  1345 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:13:02.289806 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.289839  1281 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:02.182199  1184 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.231698  1341 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:13:02.248907  1227 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:02.290911  1346 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:13:02.255525 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.297489 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:02.312069 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:02.307696  1252 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.313764 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:02.287648  1277 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:02.301417  1281 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.231175  1352 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:02.281126  1263 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:02.340106 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:02.341531 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.339394  1352 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.334849  1016 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:02.347543  1016 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:02.313484  1339 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:02.308691  1142 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.348944  1225 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:02.253288  1316 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:02.341852 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:02.351999  1354 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:02.275790   580 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:13:02.354393  1045 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.346906  1352 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:02.354499   580 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:02.351986  1316 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:02.297122  1199 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:02.324728 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:02.357366 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:02.356422 29258 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:02.285625  1238 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:02.364629 28655 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:02.374150 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:02.367144 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:02.367691  1016 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:02.345543  1227 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.313510  1154 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:02.358359   580 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:02.307127  1171 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:02.385109 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1132) took 1126 ms. Trace:
W20260709 13:13:02.385522 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 60862.6us
I20260709 13:13:02.278424  1259 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.295972  1174 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
W20260709 13:13:02.374359 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 135865us
I20260709 13:13:02.376585  1184 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:02.414389 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:02.415344 28654 rpcz_store.cc:276] 0709 13:13:01.258547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.258700 (+   153us) service_pool.cc:224] Handling call
0709 13:13:02.384887 (+1126187us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540023e954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:02.385043 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894805760}
I20260709 13:13:02.418764 28727 raft_consensus.cc:2368] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:02.419438 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:02.498932 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 79590.7us
I20260709 13:13:02.360881  1263 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.390067   621 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:02.411696  1354 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.379130   909 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:13:02.541533   909 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:02.542027   909 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:02.541675   580 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.418361  1212 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:13:02.543133   580 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:02.543329  1354 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.544513 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:02.378533  1183 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.154s
I20260709 13:13:02.545970  1354 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:02.548487  1318 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:02.556587 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:02.549973  1227 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.550865  1281 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.552281  1154 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:02.390916  1254 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.555971 28650 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
W20260709 13:13:02.560772 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.557623 29257 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:02.565115 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:02.388417  1199 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.534806  1315 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:02.578167 28696 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:02.587502 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 212308us
I20260709 13:13:02.386273  1238 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.591415 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 2150) took 1175 ms. Trace:
I20260709 13:13:02.593295 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:02.601785 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:02.601701 28728 rpcz_store.cc:276] 0709 13:13:01.416085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.416208 (+   123us) service_pool.cc:224] Handling call
0709 13:13:02.591209 (+1175001us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54001b9254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:02.591350 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337429888}
W20260709 13:13:02.637039 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.640287 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55091.4us
I20260709 13:13:02.641355 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1496) took 2123 ms. Trace:
W20260709 13:13:02.641724 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 63664.5us
I20260709 13:13:02.642168 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:02.643059 28655 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:02.644081 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:02.538254  1232 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:13:02.641770 29251 rpcz_store.cc:276] 0709 13:13:00.492222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.541605 (+ 49383us) service_pool.cc:224] Handling call
0709 13:13:01.814665 (+1273060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:01.840762 (+ 26097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.615217 (+774455us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540044edd0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:02.615428 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2926888832}
I20260709 13:13:02.648698 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:02.655405  1016 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:02.662928 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:02.737095 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 74225.3us
I20260709 13:13:02.738253 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:02.664492 28648 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:02.567014  1318 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:02.614167  1277 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:02.633498  1316 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:02.589306  1281 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:13:02.702229  1089 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:02.682348   787 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:13:02.675788  1315 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:02.674746  1348 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.734419 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 93055.7us
I20260709 13:13:02.661489  1352 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.709527  1259 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:02.833142 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.748883  1254 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:02.839365 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:02.749315  1351 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:02.845983  1318 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:02.794307  1089 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.891206  1238 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.839896  1134 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.892199  1089 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:02.845989  1362 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:13:02.892504  1134 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.848091  1337 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:02.856087 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1715) took 2179 ms. Trace:
I20260709 13:13:02.895481  1134 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.896538  1263 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:02.895519  1337 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.751318  1316 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:02.832562  1277 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:02.859545 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1722) took 1702 ms. Trace:
I20260709 13:13:02.860163 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1215) took 1602 ms. Trace:
I20260709 13:13:02.861816  1352 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.795116  1315 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.833597  1348 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:02.900660  1337 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:02.923570 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 79285us
I20260709 13:13:02.895677 29256 rpcz_store.cc:276] 0709 13:13:00.676661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.077471 (+400810us) service_pool.cc:224] Handling call
0709 13:13:01.077837 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:01.913459 (+835622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.913505 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:01.914086 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:13:02.168043 (+253957us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:02.168101 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.855662 (+687561us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400661cd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:02.855713 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.855759 (+    46us) raft_consensus.cc:1685] finished
0709 13:13:02.855773 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.856019 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4207,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":1920689024,"thread_start_us":253437,"threads_started":1,"wal-append.queue_time_us":387397}
I20260709 13:13:02.932147 28577 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:02.913808  1315 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:02.908803 28580 rpcz_store.cc:276] 0709 13:13:01.257293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.257436 (+   143us) service_pool.cc:224] Handling call
0709 13:13:01.271672 (+ 14236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.087993 (+816321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.859897 (+771904us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54000ed8d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:02.860098 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837132160}
I20260709 13:13:02.909171 29254 rpcz_store.cc:276] 0709 13:13:01.156847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.432895 (+276048us) service_pool.cc:224] Handling call
0709 13:13:01.495160 (+ 62265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:01.498594 (+  3434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:01.498627 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:01.500272 (+  1645us) log.cc:844] Serialized 26 byte log entry
0709 13:13:02.383976 (+883704us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18000fdd20. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:02.641488 (+257512us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:02.641531 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.641605 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.859100 (+217495us) raft_consensus.cc:1685] finished
0709 13:13:02.859127 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:02.859434 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127965,"raft.queue_time_us":14395,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10634,"spinlock_wait_cycles":28297472,"thread_start_us":257318,"threads_started":1,"wal-append.queue_time_us":1201479}
I20260709 13:13:02.974958  1134 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:02.977933 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:02.972640 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:02.980018 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:02.981652 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:02.984817 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:02.986462 29224 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:02.991600 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:02.900938  1316 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:02.988476  1225 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.002s
I20260709 13:13:02.995215  1016 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:02.995307  1371 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:02.995829  1016 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.996347  1016 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:02.996053  1371 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:02.897912  1199 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:02.997663 28579 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:02.928565  1281 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.983418  1134 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:13:02.997848 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 70300.8us
I20260709 13:13:02.987777   580 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:02.915975  1348 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:02.985417  1337 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:02.985381   787 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:02.987389  1183 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:02.997560   621 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:02.903026  1277 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.056068  1175 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.057493  1183 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:03.060551  1227 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:03.063627  1368 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.999606  1352 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.066694   580 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.080880   580 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.001847  1263 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:03.068686   711 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:02.999606  1364 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:03.005081  1281 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.003594  1373 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:13:03.083070   580 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.080412  1227 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:03.118832  1227 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.067611  1337 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.086946  1352 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.108515   711 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.139734   711 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.095777  1368 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.150650 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.153529 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:03.154204 28574 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:03.156984 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.157438 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.158329 28576 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:03.160753 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.133460  1371 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.161443 28577 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
W20260709 13:13:03.166029 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.167939 28577 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:03.170442 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:03.163213  1184 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.006s
I20260709 13:13:03.181340 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.182315 29254 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:03.177485  1134 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:13:03.184962  1281 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.107040  1364 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.188984 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:03.190265  1175 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:03.192606 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2709) took 1200 ms. Trace:
I20260709 13:13:03.193159 28727 rpcz_store.cc:276] 0709 13:13:01.992542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.993876 (+  1334us) service_pool.cc:224] Handling call
0709 13:13:03.192351 (+1198475us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540008c354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:03.192531 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971319040}
I20260709 13:13:03.196023  1016 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.196029  1174 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:03.198715  1174 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.199749   711 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.201193  1370 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:13:03.123273  1183 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.169332  1263 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:03.202744  1263 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.212320 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1514) took 1024 ms. Trace:
I20260709 13:13:03.213521 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:03.227240 28722 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.215592  1045 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:03.177470 28621 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:03.234064 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 56674us
I20260709 13:13:03.224915 28648 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:03.234109 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.224447 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1513) took 1037 ms. Trace:
I20260709 13:13:03.236994 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:03.238484 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:03.239230 28577 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:03.239850 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50979.1us
I20260709 13:13:03.240302 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.240743 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:03.241047 28574 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:03.179903 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.236047 29253 rpcz_store.cc:276] 0709 13:13:02.187199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.187645 (+   446us) service_pool.cc:224] Handling call
0709 13:13:02.190212 (+  2567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.235672 (+ 45460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.223956 (+988284us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54004b5620. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8ddc0 00007f4a27e19a02 00007f4a27e15dd6 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:13:03.224342 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241340672}
I20260709 13:13:03.240936 28576 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:13:03.153774  1369 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:03.248220 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.249297 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.254063 29259 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:03.254745 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.200377   711 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.258322 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.228410 29260 rpcz_store.cc:276] 0709 13:13:02.187493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.187636 (+   143us) service_pool.cc:224] Handling call
0709 13:13:02.221582 (+ 33946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.226831 (+  5249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.227017 (+   186us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.227509 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:13:02.342557 (+115048us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:03.210756 (+868199us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b18002cf0e0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a2b80e3c7 00007f4a27e209a7 00007f4a27e300bf
0709 13:13:03.210974 (+   218us) log.cc:844] Serialized 14 byte log entry
0709 13:13:03.211416 (+   442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.211535 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.211862 (+   327us) raft_consensus.cc:1685] finished
0709 13:13:03.212017 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.212226 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16209,"prepare.queue_time_us":356171,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":15672,"raft.queue_time_us":6228,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1127,"spinlock_wait_cycles":38424192,"thread_start_us":394599,"threads_started":2,"wal-append.queue_time_us":406075}
I20260709 13:13:03.259944 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.253497 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2153) took 1021 ms. Trace:
I20260709 13:13:03.261471 28724 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:03.261418 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:03.259593 28722 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:03.253470 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.265935 28724 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:03.266295 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.266330 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.260572 28726 rpcz_store.cc:276] 0709 13:13:02.231919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.232662 (+   743us) service_pool.cc:224] Handling call
0709 13:13:02.232932 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.249475 (+ 16543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.249523 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.540515 (+290992us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b2c00116bf8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:13:02.575233 (+ 34718us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.111106 (+535873us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:03.150170 (+ 39064us) log.cc:844] Serialized 14 byte log entry
0709 13:13:03.150388 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.150459 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.240622 (+ 90163us) raft_consensus.cc:1685] finished
0709 13:13:03.253198 (+ 12576us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.253415 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35298,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":7648,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":49234,"spinlock_wait_cycles":11681536,"thread_start_us":463259,"threads_started":1,"wal-append.queue_time_us":590942}
I20260709 13:13:03.268059 28725 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:03.269878 28728 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:03.243053   802 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:03.273034 28620 leader_election.cc:400] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:03.273557 28620 leader_election.cc:403] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:03.243413  1232 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.163906  1316 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:13:03.234086  1045 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:03.243230  1277 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.243319  1375 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.296195 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.299667 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.301100 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.303357 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:03.305588 28729 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:03.247023  1252 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:13:03.297464  1175 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:03.316651  1383 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.320561  1277 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.316056 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.325605  1277 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.298990  1381 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:03.337435 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.337458 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.342595  1277 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.342767  1352 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.259950  1369 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.345323  1174 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.345534   711 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.345366 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.347533  1376 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.347923 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.348053  1376 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.348510 29258 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:03.350220  1376 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.350759  1376 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.351451 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.352173  1337 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.352325 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1726) took 1041 ms. Trace:
I20260709 13:13:03.352867 29259 rpcz_store.cc:276] 0709 13:13:02.310748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.311769 (+  1021us) service_pool.cc:224] Handling call
0709 13:13:03.352092 (+1040323us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54006aa754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:03.352248 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943721728}
I20260709 13:13:03.310599  1016 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.299726  1045 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:03.354594 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.266723  1318 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:03.365412 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.375665 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.378624 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.387053 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.387805 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.390106 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.297734   802 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:03.308166  1375 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.400470 28575 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:03.405077 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.409569 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.410954 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.411616 28654 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:03.414916 29258 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:03.418143 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:03.418972 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.425459 28655 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:03.422034 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:03.427345 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.427996 29257 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:03.388485  1369 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.394029  1262 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.443363 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.438905 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.440793 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.446188 28651 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:03.393222  1337 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.306859  1232 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.403891   802 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.457782 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.458554 28574 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:03.453259  1263 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.460770 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2424) took 1116 ms. Trace:
I20260709 13:13:03.461225 28647 rpcz_store.cc:276] 0709 13:13:02.344804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.344958 (+   154us) service_pool.cc:224] Handling call
0709 13:13:02.345305 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.640957 (+295652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.640992 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:02.641063 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:02.641120 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.460520 (+819400us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540027ef54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:03.460568 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.460713 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679473024}
I20260709 13:13:03.463558 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.471546  1184 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:03.336027  1383 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.473263  1205 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:03.473662  1205 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:03.474289 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:03.478068  1184 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:03.480039 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:03.453065  1262 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.483325  1262 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.483188   580 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:03.429116  1371 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.453372  1364 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.486963  1375 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.488384  1383 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.452448  1252 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.491962  1252 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.474593  1205 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.493602  1205 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:03.392863  1315 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.438812  1174 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.495424 29260 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:13:03.495209  1174 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.496335  1315 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.497212 28723 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:03.497831  1174 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.441255   787 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.498914   787 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:03.407874  1318 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.488273 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:03.501555  1318 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.502547  1174 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:03.503121  1174 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.505985  1174 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:03.455610  1337 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.510556  1337 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.475093  1175 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.453473 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.492301 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.513674 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.513386 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:03.529677 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52704.9us
W20260709 13:13:03.522579   580 consensus_queue.cc:1175] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" responder_term: 13 status { last_received { term: 11 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:03.562301 28580 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:03.560431 28651 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:03.580369 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:03.494529  1252 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.505092  1369 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.593442 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.517479   711 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.605480 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.528573 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:03.563666 28577 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:03.504462  1232 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.574362 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.590198 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:03.617544 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 89091.6us
I20260709 13:13:03.581933 28651 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:03.569939  1212 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.616165 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:03.565990  1175 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.504487  1238 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:13:03.618685 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:03.575305   616 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:03.598376  1315 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.628605  1352 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:03.636103  1238 consensus_queue.cc:1243] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:03.639392  1225 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:03.612895  1369 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.646660 28647 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:03.624938   711 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.631899  1212 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.613596   802 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.637593   616 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.666504  1352 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:03.663687  1225 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:03.710928 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 116094us
I20260709 13:13:03.652904  1315 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.665256  1383 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:13:03.699149  1367 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.716609  1225 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:03.724448  1367 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.758745  1367 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.760354 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.761132 28656 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
W20260709 13:13:03.727413 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 466028us
I20260709 13:13:03.762208 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.762454 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:03.725361 28651 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:03.763087 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:03.771775 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:03.748464   711 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.748535   616 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.775498  1389 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.777372   802 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.778709  1212 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.779142  1315 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.780361  1381 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:03.781193  1367 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:03.781667  1367 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.782099  1367 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.782714  1317 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:03.783325  1317 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.724079  1232 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:03.786253  1376 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:13:03.787755  1390 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:03.781939 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:03.786089  1232 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:03.795204 28579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2902) took 1883 ms (client timeout 2049 ms). Trace:
I20260709 13:13:03.797608 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:03.791821  1238 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:03.796765 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:03.797289 28579 rpcz_store.cc:269] 0709 13:13:01.911823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.911977 (+   154us) service_pool.cc:224] Handling call
0709 13:13:03.795035 (+1883058us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001a9d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:03.795145 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494745984}
I20260709 13:13:03.783963  1388 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:13:03.803025 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.805373 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:03.775527   711 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:03.800475  1389 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.809440   711 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.810796  1376 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:03.822424  1376 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:03.822902  1376 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.803478  1238 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:03.826146  1238 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.817273  1225 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.833709  1317 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.803262  1134 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.837975  1232 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.834199  1225 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.841372  1174 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.806687  1315 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:03.804651  1175 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.847699 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.850447 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.867900 28578 raft_consensus.cc:2368] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15.
I20260709 13:13:03.763471  1352 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.863328 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.859458  1369 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:03.866603 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 64791.8us
I20260709 13:13:03.878764   711 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.880944  1174 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:03.885883 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 80577.2us
I20260709 13:13:03.886852 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:03.887437  1342 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:03.887940  1342 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:03.888847  1342 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.717213 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:03.893616  1227 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:03.896577  1342 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.898864 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.890053  1045 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.891024  1315 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:03.901648  1376 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.901819   909 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.902714  1315 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:03.903133   909 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:03.903801  1315 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.909744 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:03.910223  1368 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.910866  1347 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:03.911285  1347 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:03.911631  1347 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:03.915027 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.915158  1376 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.921202 28650 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:03.923197 29224 leader_election.cc:400] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15.
I20260709 13:13:03.923573 29224 leader_election.cc:403] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:03.924135  1171 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:13:03.916090  1367 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.926362  1347 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.927143  1367 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:03.928222  1281 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:03.928632  1281 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:03.929625  1045 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.929544  1281 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.930640  1281 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:03.931348 28722 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:13:03.935034  1277 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:03.935807 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 374012us
I20260709 13:13:03.935617  1277 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.937793  1277 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.939502  1277 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:03.940102 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.941349 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.939968  1277 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.942060 28580 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:03.942093 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.942991 28581 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:03.945680  1277 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:03.928637  1347 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:03.947949  1387 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:13:03.949218 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1496) took 1698 ms. Trace:
I20260709 13:13:03.949851 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:03.951098 29252 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:13:03.952268 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.953226 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.953367 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:03.953827 29257 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:03.954236 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.949610 28721 rpcz_store.cc:276] 0709 13:13:02.251292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.284888 (+ 33596us) service_pool.cc:224] Handling call
0709 13:13:02.342748 (+ 57860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.343116 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.343146 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.343479 (+   333us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.796788 (+1453309us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b1800419b60. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:03.881190 (+ 84402us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:03.881249 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.881329 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.948845 (+ 67516us) raft_consensus.cc:1685] finished
0709 13:13:03.948869 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.949132 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2026,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2507,"spinlock_wait_cycles":13945728,"thread_start_us":74655,"threads_started":1,"wal-append.queue_time_us":1535987}
I20260709 13:13:03.952111 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.956336 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.957325 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:03.958014 28651 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:03.958529 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.958719 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:03.960032 28648 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:03.960217  1316 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:03.960656  1316 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:03.961036  1316 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:03.961997 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:03.962710 29256 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:03.956387 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:03.965250 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:03.966054  1381 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.967124  1154 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:03.967644  1154 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.967137 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:03.968209  1307 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:03.968631  1307 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:03.968896  1381 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.969467  1307 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:03.970038 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:03.970506  1307 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.974200 28655 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:03.974406 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:03.971275  1388 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.975119 28581 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:03.975219  1388 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.977373  1381 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.972856  1389 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.978446  1389 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:03.978499 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:03.936877 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:03.981875 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 45121us
I20260709 13:13:03.983146 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:03.985863 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:03.981053  1389 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.973359  1154 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:04.009764 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:03.977408  1388 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.989886 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.010847 28653 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:04.010954  1252 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:04.011713  1252 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:04.012048  1252 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.012567  1252 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:03.989871 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:03.992208 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.017379 28650 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:04.017499 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:04.020244 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.020961 28654 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:03.993238 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:03.994130  1292 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.025390  1292 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:04.027485  1292 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:03.994927  1331 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:04.027695  1316 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.028234  1331 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.030398  1331 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:04.034072  1175 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:04.034576  1175 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.034924  1175 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:04.036056 28650 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:04.038228   802 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:04.038829   802 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.039283   802 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:04.040163 28575 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:04.043107 28653 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
W20260709 13:13:04.044559 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 327454us
I20260709 13:13:04.046111 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.060647 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:04.005681 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:13:04.007622 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 68776.4us
I20260709 13:13:03.971632 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:04.063563 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 57967.4us
W20260709 13:13:04.063764 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 78021.7us
I20260709 13:13:04.064314 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.053296  1373 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:04.057742   802 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:04.059763 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.002516  1171 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15.
W20260709 13:13:04.064100 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 92545.5us
I20260709 13:13:04.049808  1398 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:04.065347 28722 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260709 13:13:03.997380 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:04.066269 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.067255 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.069979 28727 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:04.080369 28729 raft_consensus.cc:2410] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:13:04.081497 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.081557 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:04.080399 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.070427 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.077085 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.082485 28722 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:04.078677 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.079011 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.083354 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:04.084095 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.084304 28653 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:04.084812 28650 raft_consensus.cc:2368] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15.
I20260709 13:13:04.085934 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.063860  1348 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:04.087100 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.087721 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.087822 28727 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:04.068480  1184 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:04.090103 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.069427  1331 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:04.069600  1281 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:04.068104  1337 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:04.107199 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.101511 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:04.091171 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 93864.9us
I20260709 13:13:04.092583 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.121569 28723 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:04.069723  1380 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:04.095695 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.095870 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.099045 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:04.079291  1354 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.101826 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.102831 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.113458 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.137574 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.104923 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:04.140158 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:04.140553 29260 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:13:04.139387 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.141626 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:04.145203 29253 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:04.105365  1113 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:04.088001  1402 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.149188 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:04.090374  1398 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:04.146991 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.147989 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:04.156570 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:04.149605 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:04.157866 29257 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:04.146193 29251 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:04.151011 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.096407   909 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:04.105610  1281 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.168934 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:13:04.150017  1396 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:04.162931 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.163862 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:04.159039 28724 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
W20260709 13:13:04.164013 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 99375.1us
I20260709 13:13:04.105957  1337 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.166868 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:04.159621 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.182001  1337 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:04.182629 28579 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:04.183609  1045 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:04.183779  1252 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.146919  1348 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:04.192536 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:04.193259 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:04.193847 28578 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:04.200109 28579 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:04.200793 28578 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:04.202680  1418 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:04.202832 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:04.203231  1418 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.204025 28621 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:04.204348  1045 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:04.204893 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:04.147647  1331 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:04.217434 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.217760 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:04.218179 28581 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:04.218487  1331 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.219725 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.164513   909 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.220908 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.221227   909 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:04.221318 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.221928 28650 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:04.223130 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:04.223454 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.223687 28722 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:04.225183  1418 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:04.225792  1418 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:04.150166  1354 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.171092   621 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:04.245148 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.149214  1262 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:13:04.157992  1174 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:04.166153  1394 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:04.181447 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:04.254953 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:04.257619 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 50287.8us
I20260709 13:13:04.256985 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.258692 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:04.205679 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:04.208623 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:04.261337 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 52826.5us
I20260709 13:13:04.173889  1316 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:04.212594 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.164707  1205 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:13:04.159126  1402 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.180876  1398 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.215935  1380 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:04.218967 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.177762   802 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:04.225186 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.230767 28722 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:04.233073 28579 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:04.233357 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:04.235229 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:04.241806 28723 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:04.230921 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:04.287122 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 51983.9us
W20260709 13:13:04.287731 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.288137 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:04.179104  1175 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.226253  1418 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:04.246414 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.171794  1281 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:04.311990 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:04.253145 28573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:04.256219 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:04.314731 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 58573.7us
I20260709 13:13:04.316360 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:04.263150 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:04.214377  1263 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:04.265679 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 200648us
I20260709 13:13:04.265069 28730 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:04.248929   906 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:04.255683  1348 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.274868 28572 raft_consensus.cc:2410] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:13:04.274931 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:04.253849  1171 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.245397   621 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:04.298565 29256 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:13:04.307142 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 60797.9us
I20260709 13:13:04.297863  1397 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:04.273403   787 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:04.305176  1316 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:04.253772 29253 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:04.313658 28573 raft_consensus.cc:606] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.333474 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.336643 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:04.297145  1307 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:04.341661 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 66802.7us
I20260709 13:13:04.358403 29224 leader_election.cc:400] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15.
I20260709 13:13:04.359805 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:04.309026 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:04.360961 29251 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:04.273342  1277 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:04.366110 28696 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:04.347795 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 84713.4us
I20260709 13:13:04.305281  1380 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:04.311764  1109 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:04.370600 29251 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:04.342280   802 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:13:04.329865  1292 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:04.362450 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:04.368311 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.338234  1388 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:04.346264   621 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:04.311160  1318 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:13:04.387192 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:04.381672 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 176038us
I20260709 13:13:04.349766  1263 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:04.358786  1183 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:04.369716  1389 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:04.357484  1307 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:04.380067   787 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:04.386219  1277 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:04.354184  1171 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.491722  1432 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:04.492326 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 105254us
I20260709 13:13:04.426975  1318 consensus_queue.cc:1243] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:04.416052  1404 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:04.492408  1433 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 13:13:04.494094 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 131740us
I20260709 13:13:04.403223  1405 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:04.407042  1109 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:04.347138  1348 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.496207  1354 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:04.431526  1252 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:04.498656 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.497679 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.417369  1263 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.422124  1183 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:04.497238 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 123869us
W20260709 13:13:04.586140 28619 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.26.202.62:36613, user_credentials={real_user=slave}} blocked reactor thread for 44901.6us
I20260709 13:13:04.402724  1315 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:13:04.507337 29260 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:04.493400  1381 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:04.432902  1307 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:04.499472  1406 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:13:04.542687 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44122.1us
I20260709 13:13:04.543855  1367 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:04.544647  1420 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 13:13:04.545560  1422 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 13:13:04.611814 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 252120us
I20260709 13:13:04.563711   787 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.565158  1277 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:04.566390  1426 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:13:04.426388  1418 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.552834  1337 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:04.530793  1380 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:04.537514  1419 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.324s	user 0.002s	sys 0.000s
I20260709 13:13:04.569610  1175 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:04.536697  1383 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:04.578436   909 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:04.578159  1263 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:04.580665  1174 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:04.569676 28573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:04.639353 28573 raft_consensus.cc:606] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:04.632638  1171 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:04.639803 28573 raft_consensus.cc:614] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:04.633641  1430 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:13:04.589144 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:04.587755 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 289600us
I20260709 13:13:04.642486  1281 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.601747 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.592911  1183 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:04.649339  1439 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:04.498474  1424 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:04.612764 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.593497  1381 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:04.652758  1381 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:04.655818 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:04.629277  1109 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.657244  1109 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.658375  1383 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:04.658808  1383 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.659179  1383 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:04.659870  1109 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:04.630125 28681 heartbeater.cc:646] Failed to heartbeat to 127.26.202.62:36613 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.202.62:36613 timed out after 15.000s (SENT)
I20260709 13:13:04.661847 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:04.593508 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 184729us
I20260709 13:13:04.614271  1316 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:04.665163  1398 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:04.669057 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.670825 28653 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:04.670037 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.673038  1430 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:04.673636  1430 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:04.674851  1430 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:04.677552 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 88532.6us
I20260709 13:13:04.681581  1432 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:04.682186  1337 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:04.683295  1316 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.684788 28574 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:13:04.669878  1376 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:04.685828  1376 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:04.686559 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.687182 28572 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:04.687860  1376 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:04.688452  1367 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.689248  1367 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.689741 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.692895 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.693611 29259 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:04.694866 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:04.699362 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:04.699726 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:04.700246 28721 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:04.700278 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:04.699013 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.702292 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:04.713219 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.713362 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.713557 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.712532 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.709627 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.718032  1441 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.718204  1369 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:04.718899  1369 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:04.712877  1238 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:04.719476  1369 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:04.720149  1134 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:04.718036 28577 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:04.699137  1430 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:04.723048  1232 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:04.724213 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.731397 28656 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:04.733259 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.676558   621 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.743999  1402 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:04.684393   909 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:04.754205 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.754281 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:04.755861 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.756098 28622 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.755116 28656 raft_consensus.cc:2376] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14. Re-sending same reply.
I20260709 13:13:04.759371 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:04.762216 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.763703 29260 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:04.764845 28573 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:04.764845 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.767223 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:04.768018 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:04.714941  1337 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:04.772716 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:04.778962 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:04.778590 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:04.774130 28647 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:04.792140 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.770869  1109 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.780511 29257 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:04.719164  1441 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.929185 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:04.773537  1252 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:04.847694 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55653.2us
I20260709 13:13:04.814640  1389 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:13:05.002489  1419 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:13:04.930591  1175 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:04.780437  1421 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.241s
W20260709 13:13:05.073819 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 294937us
I20260709 13:13:04.801963  1337 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.929580  1442 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:04.993575  1227 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.003151  1352 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.006289  1252 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:05.031447  1417 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:13:05.063699 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:04.991707  1109 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.108110 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:05.113826 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:05.018886  1381 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:04.773854  1307 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.078828  1442 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:05.090767  1389 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.103595  1175 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:05.125320 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:05.105104  1252 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:05.099888  1227 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:05.127681  1436 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.134701  1337 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.139878   787 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.260026   787 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.262401   787 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.134847  1315 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.104032  1352 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.138137  1442 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:05.139415  1367 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:05.224170  1383 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.002s
W20260709 13:13:05.224345  1443 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:13:05.130333  1316 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:05.276726  1315 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.282295 29257 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:05.226106  1281 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:05.294629  1424 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.002s
I20260709 13:13:05.265390  1376 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:05.291296  1380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.028s	sys 0.025s
I20260709 13:13:05.206457  1183 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:05.315728 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.034s	sys 0.033s
W20260709 13:13:05.316186 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.034s	sys 0.033s
W20260709 13:13:05.316555 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 511731us
I20260709 13:13:05.223702  1389 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:05.314795  1380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.028s	sys 0.025s
I20260709 13:13:05.291529   621 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:05.317478 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:05.302125  1424 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:05.340761 28656 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:05.326486  1376 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:05.295636  1383 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.344982  1184 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:05.353480  1184 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.353912  1184 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:05.358736  1389 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.362660  1183 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:05.363785  1446 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:13:05.346542  1458 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:05.364985  1369 consensus_meta.cc:287] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.001s
I20260709 13:13:05.365561  1458 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.368199  1109 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:05.369426  1307 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.370759  1458 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:05.367339  1430 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.001s
I20260709 13:13:05.368228  1381 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.373276  1369 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:05.373832  1227 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:05.374557 28575 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:05.272291  1436 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.376545  1315 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.376648  1369 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:05.377674  1436 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.383711 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:05.390535 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44536.5us
W20260709 13:13:05.382067  1448 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:13:05.402697 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 277478us
I20260709 13:13:05.403887 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:05.405397 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:05.408972 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:05.409873 28579 raft_consensus.cc:2368] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:13:05.412810 28581 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:13:05.413424 28581 pending_rounds.cc:85] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 9
I20260709 13:13:05.413738 28581 pending_rounds.cc:107] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:13:05.414043 28581 raft_consensus.cc:2889] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:05.414172 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:05.416278 28572 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:05.416386 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:05.417908 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:05.417974 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:05.418936 28578 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:05.379696  1184 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.419636  1463 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:05.421182  1455 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.422119 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:05.446040  1441 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:05.446199  1455 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.446642  1465 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:05.447458 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:05.412521  1436 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:05.426023 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.426834 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.425585 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:05.434747  1184 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:05.434774  1307 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:05.453492 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:05.454978 29251 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:05.456037 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.456470 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:05.457238 29260 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:05.457360 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.459261  1045 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:05.436635  1383 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.459986  1045 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.460482 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.462033 29253 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:05.462396  1045 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.424950 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:05.426445 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:05.444078  1263 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.773s	user 0.006s	sys 0.002s
I20260709 13:13:05.448370  1465 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:05.440114  1463 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:05.482594  1183 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.493474  1183 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.441669  1352 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.421332  1376 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:05.510538  1227 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:05.499962  1458 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:05.496564  1263 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:05.518146 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 70805.4us
I20260709 13:13:05.520097 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:05.521126 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:05.522444 28578 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:05.522843 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:05.523494 28655 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:05.523636 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:05.524784 28655 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:05.524806 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:05.526227 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:05.527033 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:05.527798 28721 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:05.527922 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:05.528465 28654 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:13:05.529299 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:05.529567 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:05.531025 29253 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:05.532300 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:05.531435 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:05.533329 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:05.536718 29254 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:05.534083 29253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:13:05.535391 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:05.535413 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:05.537681 29253 raft_consensus.cc:606] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:05.538118 28581 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:05.515249  1376 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.539780 29224 leader_election.cc:400] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:13:05.540197 29224 leader_election.cc:403] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:13:05.545238 28652 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:05.542358 28648 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:05.538664 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:05.526417  1315 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:05.618424  1459 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:05.619508  1466 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:05.542035  1383 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:05.620044  1466 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.620519  1466 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.619163  1459 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:05.699569 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 163913us
I20260709 13:13:05.700120 28723 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:05.698614 29256 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:05.527067  1465 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:05.724543 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 193498us
I20260709 13:13:05.706162  1463 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:05.706671  1453 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:05.708753   802 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:05.519100  1227 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.698719  1376 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.739085 29254 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:05.740008  1376 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.740348  1227 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.718655  1459 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.719630  1455 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:05.721225  1183 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.726043 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:05.729519 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2732) took 1029 ms. Trace:
I20260709 13:13:05.730132 28578 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:05.732951 28581 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:05.533205  1352 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:05.542332  1045 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.734051 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.735543   802 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:05.737982  1467 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.749508 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.757603 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.751780 29251 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:05.746778 28730 rpcz_store.cc:276] 0709 13:13:04.699665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.700690 (+  1025us) service_pool.cc:224] Handling call
0709 13:13:04.701139 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:04.701465 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.701510 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:04.701975 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.463036 (+761061us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b1800425080. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:05.513924 (+ 50888us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:05.517331 (+  3407us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.525150 (+  7819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.525241 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.709926 (+184685us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b1800425080. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d29522 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:05.729142 (+ 19216us) raft_consensus.cc:1685] finished
0709 13:13:05.729194 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.729428 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92101,"prepare.queue_time_us":3142,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":20780,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":9623,"spinlock_wait_cycles":205325440,"thread_start_us":50645,"threads_started":1,"wal-append.queue_time_us":794224}
I20260709 13:13:05.752086 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:05.700134  1421 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:05.754134 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53736.7us
I20260709 13:13:05.778177 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:05.796882  1373 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:05.779879 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:05.805289 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 273015us
I20260709 13:13:05.760156  1376 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:05.804682  1333 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:05.802295  1463 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:05.810664  1316 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.621910  1472 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.194s
I20260709 13:13:05.816262  1373 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.816804  1376 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.765373  1045 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.818111  1375 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:05.762655  1352 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:05.844308 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 80781.2us
I20260709 13:13:05.826263  1333 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.824687  1450 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:05.736569  1465 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:05.834649  1442 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.004s
I20260709 13:13:05.803438  1421 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.862857 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:05.863847 28578 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:05.821908   802 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.836336  1376 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:05.856925  1333 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:05.852833  1205 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:05.873288 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 66786.3us
I20260709 13:13:05.856184  1375 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:05.865065  1442 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.875722 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:05.869163  1252 consensus_meta.cc:287] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.003s
I20260709 13:13:05.805415  1467 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.828930  1463 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:05.833393  1471 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:13:05.834363  1316 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.870980   802 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.881827 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:05.874106  1450 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.887049  1475 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:13:05.901117  1212 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:05.901741  1475 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:05.902035  1212 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:05.888206  1468 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
I20260709 13:13:05.907747  1471 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:05.908080 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:05.909032  1467 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.912417  1472 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.888449  1442 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:05.890081  1352 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.890411 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1734) took 1752 ms. Trace:
I20260709 13:13:05.835704  1373 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.898929  1421 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:05.926223  1400 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:05.926802 29257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1498) took 1676 ms (client timeout 1794 ms). Trace:
I20260709 13:13:05.929183 29255 rpcz_store.cc:276] 0709 13:13:04.138376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.138503 (+   127us) service_pool.cc:224] Handling call
0709 13:13:04.661423 (+522920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.661628 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.661658 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:04.661702 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:04.661744 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.661807 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.890234 (+1228427us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54006da1d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:05.890352 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201851776}
I20260709 13:13:05.893121  1477 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:05.930594 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2927) took 1167 ms. Trace:
I20260709 13:13:05.931699 28575 rpcz_store.cc:276] 0709 13:13:04.763072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.763243 (+   171us) service_pool.cc:224] Handling call
0709 13:13:04.763601 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.374935 (+611334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.930375 (+555440us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54000ec4d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:05.930542 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404638080}
W20260709 13:13:05.931231 29257 rpcz_store.cc:269] 0709 13:13:04.250903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.311728 (+ 60825us) service_pool.cc:224] Handling call
0709 13:13:05.926633 (+1614905us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400750154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:05.926743 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075632384}
I20260709 13:13:05.877986  1205 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.936628 28578 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:13:05.886188  1263 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:05.902818  1475 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.879758  1436 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:13:05.908435  1471 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.913265  1472 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:05.926785  1466 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:05.882946  1252 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.041461  1352 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.068276 28649 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:05.953420  1477 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:05.927805  1450 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.056594  1212 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:05.938246  1400 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.059306  1436 consensus_queue.cc:1243] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:06.067684  1455 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:06.112587 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2700) took 1895 ms. Trace:
I20260709 13:13:06.113050 28574 rpcz_store.cc:276] 0709 13:13:04.216853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.216961 (+   108us) service_pool.cc:224] Handling call
0709 13:13:04.217361 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:04.685210 (+467849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.112295 (+1427085us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b5400352ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:06.112520 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074315520}
I20260709 13:13:06.106806  1465 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.074702  1352 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:06.124933 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 59188.1us
I20260709 13:13:06.064236  1375 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.135782 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.118309  1045 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.117466  1477 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.146509  1400 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.111106  1455 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.153183 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:06.139091  1470 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:06.155000  1470 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.139093  1465 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.168696  1472 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.169405  1472 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.169895  1472 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.173743  1186 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.174804  1186 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.177413  1373 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:06.178630  1348 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.148736  1205 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.160441  1465 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.151594  1316 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.193377  1490 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:06.194507  1367 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.198925  1367 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.199453  1292 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:06.200064  1292 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:06.200582  1489 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.153095  1463 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.195206  1045 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:06.195667  1486 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:06.196192  1470 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:06.196204  1252 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.197449  1475 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.194677 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2739) took 1404 ms. Trace:
I20260709 13:13:06.201311  1292 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.208936  1465 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.201443  1367 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.201453  1466 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.198135 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:06.246621 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48569.9us
I20260709 13:13:06.214003  1352 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.248797 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:06.249020 28730 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:13:06.215196  1455 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.224411 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.186750  1472 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.250051 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.250542 28729 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:06.229306 28656 rpcz_store.cc:276] 0709 13:13:04.790927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.791131 (+   204us) service_pool.cc:224] Handling call
0709 13:13:04.802018 (+ 10887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.341276 (+539258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.194432 (+853156us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540023da54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:06.194617 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235693312}
I20260709 13:13:06.231897 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.245609  1292 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:06.251957 28578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:06.252664 28578 raft_consensus.cc:606] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:06.212172  1471 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:06.226738  1045 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.257718  1045 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.250522  1472 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:06.221385  1489 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.261051 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.296658 28725 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:13:06.259964 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.274896 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.275588 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:06.298728 28579 raft_consensus.cc:606] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:06.275740 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.276805 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.299629 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.277696 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.300522 28730 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:06.283802  1464 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.276248  1277 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.302008 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.261543 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.259109 28581 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:06.292963 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:06.260887 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.300765 29256 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:06.305487  1493 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:06.305727  1466 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:06.290210  1465 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:13:06.304786 28724 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:06.308955  1367 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.309643  1376 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.310168 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.315932 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:06.309861  1277 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.311252 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.312196 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:06.313948 28724 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:06.314783 29253 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:06.315475 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.315591 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.316591 28726 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:06.316713 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.318473 28581 raft_consensus.cc:606] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:06.319214 28728 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:06.296913  1472 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.329186 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.329582 28727 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:13:06.329934 28727 pending_rounds.cc:85] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 8
I20260709 13:13:06.330212 28727 pending_rounds.cc:107] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:13:06.330515 28727 raft_consensus.cc:2889] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:06.329828 28730 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:06.306375  1464 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.334685  1464 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.337817 28723 raft_consensus.cc:2368] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:06.339123 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:06.339663 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.340274 28581 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:13:06.342397  1489 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.323347  1367 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.345542  1367 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.335776  1491 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:13:06.346256  1376 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.340583 28696 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:06.327929  1493 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:13:06.351678  1277 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.352043  1489 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:06.332312  1472 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:06.354566 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:06.355842 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.357777 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.358316 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.358639 29257 raft_consensus.cc:2410] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:13:06.367856  1292 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:06.338488  1333 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.355947  1466 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:06.372394 28726 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:06.377053  1333 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:06.366755  1492 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:06.379617  1492 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.380043  1492 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.376376  1466 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.384022 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:06.368947  1493 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:06.390748  1493 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:06.392736 28696 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:06.397469  1493 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:06.397956  1405 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:06.388218  1475 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:06.397532  1454 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:06.398849  1405 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:06.397514  1450 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.402866 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.403160  1367 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:06.405268  1367 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:06.405689  1367 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.406088  1367 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.407598  1496 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:06.408520 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.400445  1405 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.411489  1496 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:06.415454 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:06.435460  1496 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.435971  1496 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.436105 29257 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:06.428848 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.418742 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1495) took 2264 ms. Trace:
I20260709 13:13:06.437796 29259 rpcz_store.cc:276] 0709 13:13:04.153929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.154156 (+   227us) service_pool.cc:224] Handling call
0709 13:13:04.171550 (+ 17394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.694044 (+522494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.418462 (+1724418us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400610154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:06.418672 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200164224}
I20260709 13:13:06.438937 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.399219  1475 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:06.444384 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.444689 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.445348 28721 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:06.456955  1388 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.447350  1331 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.467639 29257 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:06.458048  1405 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:06.464057  1388 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.474530 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.474954  1388 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.477804  1388 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:06.478511 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.479418 28579 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:06.478705  1388 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:06.481158  1383 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:06.480537  1388 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.481737  1383 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:06.482646  1383 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.486443 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.490476 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:06.442039  1475 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.485831  1374 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:06.514658  1367 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.518764  1367 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.519071 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:06.505249  1389 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:06.481611  1331 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.508457  1374 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:06.529487  1493 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.523717  1466 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:06.529938  1374 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.525255  1464 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.530155  1493 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.526989   787 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:06.546808  1492 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.556087   787 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.559078   787 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.559433  1492 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.538468  1374 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.553090  1466 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.556488  1464 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.564065  1464 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.564257  1318 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:06.564635  1318 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:06.565783  1318 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.564544  1331 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.566382  1466 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.567057  1318 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.561914  1496 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.536962  1472 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.575884  1493 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.577507  1496 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.578238  1472 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:06.613833 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 174721us
I20260709 13:13:06.620498 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.658700 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:06.660233 28579 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.661207 28729 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:06.661949 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.663457 28573 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:13:06.664829 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.665480 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:06.667161 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.668136 28722 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:06.671378 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:06.674696 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.677310 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:06.677969 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:06.679255 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:06.710435  1485 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:06.711186  1485 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:06.711799  1485 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:06.731865  1262 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.733209  1262 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.743010  1331 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:06.745841  1466 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:06.745360  1331 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.746407  1466 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.750452  1205 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.748834  1466 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.751403  1205 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.768296 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:06.769513 28721 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.774274 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.781457 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.782721 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:06.793907 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:06.797097  1262 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.797396 28727 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:06.797132  1404 raft_consensus.cc:993] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:13:06.796386 28724 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.809312  1331 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:06.811990  1404 raft_consensus.cc:1081] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:13:06.808008  1205 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.826982 28579 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
W20260709 13:13:06.838155 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.843008 28724 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:06.845495 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:06.848459  1389 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:06.882185  1491 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:06.883523  1491 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:06.884842  1491 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.888151  1485 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:06.889875 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:06.899784 28721 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:06.901660 28728 raft_consensus.cc:2393] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:06.913357  1485 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:06.898725  1466 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:06.917052  1466 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:06.963941 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:07.083887 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:07.091351 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 201597us
I20260709 13:13:07.091408  1485 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:07.097724  1368 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:07.098883  1368 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.102483  1368 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.103132  1368 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:07.103649  1368 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.106308  1368 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.138984 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2726) took 2431 ms. Trace:
I20260709 13:13:07.139741 28650 rpcz_store.cc:276] 0709 13:13:04.707709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.707836 (+   127us) service_pool.cc:224] Handling call
0709 13:13:04.718161 (+ 10325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:05.088952 (+370791us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:05.123989 (+ 35037us) log.cc:844] Serialized 14 byte log entry
0709 13:13:05.270215 (+146226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:05.270295 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:05.270364 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.137764 (+1867400us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400259c54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:07.138450 (+   686us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.138696 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2491,"prepare.queue_time_us":34798,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":5020,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":16606,"spinlock_wait_cycles":852089088,"thread_start_us":143226,"threads_started":1,"wal-append.queue_time_us":242286,"wal-append.run_cpu_time_us":1117,"wal-append.run_wall_time_us":1001100}
I20260709 13:13:07.145310  1435 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.146445  1435 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.147970 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2708) took 2928 ms. Trace:
I20260709 13:13:07.150738  1435 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.151504  1435 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.152571  1515 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:07.152530  1435 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.153299  1515 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.155236  1435 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.155680  1515 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.156289  1515 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.156766  1435 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:07.156868  1515 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.157554  1435 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.159272  1515 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.148871 28577 rpcz_store.cc:276] 0709 13:13:04.219362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.220132 (+   770us) service_pool.cc:224] Handling call
0709 13:13:04.220421 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:04.721810 (+501389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.147315 (+2425505us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54003534d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:07.147699 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143963520}
I20260709 13:13:07.176779  1435 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:07.181377 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 87670.1us
I20260709 13:13:07.185439  1484 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.186440  1484 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.188350  1484 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.190153  1491 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.191031  1491 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.195004  1491 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:07.175318  1515 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.201359  1515 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.204542 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.205472  1515 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.205883 29256 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:07.206939 29252 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:07.206772 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:07.207396  1516 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.207950 29257 raft_consensus.cc:2368] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:07.208212  1516 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.209079 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.210093 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.210372 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.210426 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.211262  1515 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.212152 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.212077  1515 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.212610 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.213418 29256 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:07.213768 29257 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:07.215144  1515 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.215616 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.216236 29251 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:07.216418 29256 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:07.217708 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.218194 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:07.218802  1435 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:07.219844  1374 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.660s	user 0.005s	sys 0.020s
I20260709 13:13:07.219554  1435 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:07.206776 28622 connection.cc:256] RPC call timeout handler was delayed by -1.3326582409997627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:13:07.222513  1516 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.222556  1435 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:07.223587  1318 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.649s	user 0.018s	sys 0.000s
I20260709 13:13:07.223883 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:07.224579 28649 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:07.225905 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.227663 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.228065 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:07.229414 28649 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:07.229061 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.230250 28648 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:07.229117 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:07.231315 28652 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.228543 28650 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:07.236447  1515 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:13:07.240545 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:07.240888 28622 leader_election.cc:400] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:07.241361 28622 leader_election.cc:403] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:13:07.242244  1515 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:07.244081 28649 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:07.245072 28652 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:07.246587 29257 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:07.248411 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.250499 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.251775 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.253404 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:07.253618 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.254628 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:07.255375 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.255650  1262 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:07.256134  1515 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:07.256127  1262 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.256850  1262 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:07.257288  1435 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:07.257197 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.257902  1435 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.258095 29252 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:07.258364  1435 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:07.259531 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.260528 29252 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:07.263463  1432 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:07.264535  1432 consensus_queue.cc:1243] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:07.265208  1516 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:07.265600  1516 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:07.266701  1516 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.267453  1262 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.270120  1262 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.271207 28622 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:07.274008  1515 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:07.275761  1515 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.274724 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.275648  1435 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.276537  1515 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.278831  1435 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.279871  1435 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.280840  1435 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.283641  1435 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.284176  1435 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.288188  1262 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:07.284830  1435 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.289166  1262 consensus_queue.cc:1243] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:07.291082  1435 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.291471  1262 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:07.291970  1262 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:07.295272 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.305797  1262 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.306443 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.309036  1262 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:07.291805  1515 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.313522  1515 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.316762  1388 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:07.318506  1388 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:07.319135  1388 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:07.333803 28547 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.4:38541 timed out after 1.538s (SENT) [suppressed 7 similar messages]
I20260709 13:13:07.340735 28724 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:07.344475 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.353531  1388 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.355170  1388 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.355263 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2738) took 1106 ms. Trace:
I20260709 13:13:07.356832 28723 rpcz_store.cc:276] 0709 13:13:06.248443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.248554 (+   111us) service_pool.cc:224] Handling call
0709 13:13:07.354822 (+1106268us) spinlock_profiling.cc:243] Waited 88 ms on lock 0x7b540008c854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:07.355051 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202472704}
I20260709 13:13:07.359458  1516 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:07.360987 28724 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:07.361608 28478 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:07.362380 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.381599 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.382297 28723 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:07.383270 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.384341 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.385237 28723 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:07.385303  1477 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:07.386390 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.386677  1477 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.387854 28723 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:07.390812  1405 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.391589  1405 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.373850 28728 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:07.375850 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:07.394829 28726 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:07.402776 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.403787 28656 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:07.410614 28725 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:07.413925 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.413978 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:07.416015 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.417654 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.418080 28578 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:07.419229 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.422601 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:07.423983 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.424897  1452 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:07.388927 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.429136 28577 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:07.434741 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 101096us
I20260709 13:13:07.437119 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:07.436156   909 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.441936 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.441578 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:07.441613   909 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.445694  1496 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:07.447970  1307 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:07.448724  1496 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:07.453807  1450 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:07.455533  1450 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:07.456719  1450 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:07.459133 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.460047 28649 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:07.457438 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.462070 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.466348 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:07.461504  1450 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:07.467461 28577 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:07.468037 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:07.468439  1459 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.467877  1450 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.468690 28574 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:07.468984  1459 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.469606  1450 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:07.471339  1459 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.464924 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:07.467903 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.448770  1307 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.474154 28656 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:07.475481  1307 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:07.477893 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.479197 28652 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:07.479488 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.480093 28725 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
W20260709 13:13:07.482820 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.484292  1183 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:07.484488  1477 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.485124  1183 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.487506  1183 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.480959 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:07.495960 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.497136 28573 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:07.461987   909 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.498922 28725 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.503716 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.505296 28728 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:07.506217  1452 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:07.507477 28572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1259) took 2815 ms (client timeout 2131 ms). Trace:
W20260709 13:13:07.507928 28572 rpcz_store.cc:269] 0709 13:13:04.691823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.694634 (+  2811us) service_pool.cc:224] Handling call
0709 13:13:07.506926 (+2812292us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54003511d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:07.507266 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657522944}
I20260709 13:13:07.510049  1432 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:07.511015  1432 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.513821 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.514132 28578 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:07.548451 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:07.558638 28656 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:07.558954 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.559230 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.558805  1435 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.560340 28649 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:07.560354 28573 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:13:07.558666 28581 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:07.560089  1435 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.555275  1515 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.553192  1459 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.565960  1515 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.566394 28572 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:07.566524  1459 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.568125  1431 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.568732  1431 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.545564   909 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:13:07.553462  1405 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:07.550101  1262 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.565205  1467 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.588264 28574 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:07.589746 28577 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:13:07.596479  1374 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.599850  1374 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.601164 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.602273  1374 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.602353  1475 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:07.606431 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.607035 28478 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:13:07.609668 28478 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 6 to 10, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 10 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.611755 28478 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 7 to 9, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 9 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.614423 28726 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:07.614138 28478 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 6 to 7, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 7 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:07.615708 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.617064  1520 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:07.566660  1435 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.568948  1515 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.568957  1459 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.629766 28725 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:07.630946 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.626847 28722 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:07.573671  1432 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.638206 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2740) took 1389 ms. Trace:
W20260709 13:13:07.639868 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 213949us
I20260709 13:13:07.639034  1405 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.641328 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:07.641592 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.616871 28726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:13:07.642644 28726 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.643054 28726 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.645452 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.646241 28572 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:13:07.647022 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.647085 28721 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:07.569378  1503 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:07.650437 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.573412  1262 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.628157  1520 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.639878 28729 rpcz_store.cc:276] 0709 13:13:06.259405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.259601 (+   196us) service_pool.cc:224] Handling call
0709 13:13:07.626325 (+1366724us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54000a73d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:07.638120 (+ 11795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832247040}
I20260709 13:13:07.652532 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.654484 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.657546 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.659030 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.660876 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.655874 29256 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:07.634230  1475 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.664073 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:07.665024 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.663602 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.667199 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.667903 29252 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:07.671514 29259 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:07.671716 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.670713 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.673199 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.675154 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2207) took 1230 ms. Trace:
I20260709 13:13:07.675697  1262 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.675585 28730 rpcz_store.cc:276] 0709 13:13:06.444360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.445412 (+  1052us) service_pool.cc:224] Handling call
0709 13:13:06.459191 (+ 13779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:06.459644 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.459685 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.460260 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.269961 (+809701us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18003e9560. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:07.556551 (+286590us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:07.567789 (+ 11238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.567884 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.674724 (+106840us) raft_consensus.cc:1685] finished
0709 13:13:07.674743 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.674955 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3277,"spinlock_wait_cycles":5841152,"thread_start_us":232792,"threads_started":1,"wal-append.queue_time_us":1200117}
I20260709 13:13:07.677445 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:07.677537  1475 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.678282 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.679589 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.679768  1475 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.680197 28730 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:07.660425  1467 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.681402 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:07.683097  1467 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.670696 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.684108 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:07.676700 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:07.685539 28581 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:07.680799 28649 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:07.684890 28730 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:07.641693  1405 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.663763  1520 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.693790 28726 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.835978 28724 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:07.836208 28652 raft_consensus.cc:2410] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:13:07.808073 28650 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:07.835531 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:07.700376 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:07.837742 28649 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:07.837950 29257 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:07.762429 28723 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:13:07.751600 28729 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:07.743564 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:07.699532 28656 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:07.834385 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:07.748006 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:07.844388 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 158087us
I20260709 13:13:07.845534 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:07.842938 29260 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
W20260709 13:13:07.740540 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 50264us
W20260709 13:13:07.849112 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.850214 28726 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:07.849018 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:07.854950 29252 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.854529 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:07.780133  1503 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.852955  1452 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:13:07.871358   906 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:07.872323  1452 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:07.872802  1452 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:07.872315   906 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:07.873734 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.874390 29254 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:07.875072   906 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:07.863411 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.865231 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.863586  1263 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.876591  1171 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:07.880105  1263 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.864538 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.866726 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:07.866163 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.865775 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:07.861989 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.875396 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.755045  1186 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:07.882131 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:07.704209  1467 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:07.883647 29254 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:07.863245 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:07.894739 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:07.936427 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.936937 29252 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:07.936487 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:07.972327 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 77697.5us
I20260709 13:13:07.977126 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:07.978047 28574 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:13:07.871299  1134 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:07.976716 28577 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:07.978901 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:07.865834  1431 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:07.863023  1388 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:07.936666  1318 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:08.001223  1318 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:08.003772 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.004118  1318 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:08.000875 28575 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:13:08.010193  1307 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.010928  1307 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:08.011350  1388 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:08.013345  1432 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:08.013751  1388 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:08.015628  1432 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:08.016057  1432 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:08.017138 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea260 after lost signal to thread 27435
I20260709 13:13:08.017153 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:08.016456  1432 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:08.018532 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08001b60e0 after lost signal to thread 28513
I20260709 13:13:08.018812 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.019505 28647 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:13:08.019851 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08003252c0 after lost signal to thread 28605
W20260709 13:13:08.020155 28510 debug-util.cc:398] Leaking SignalData structure 0x7b0800362280 after lost signal to thread 28606
I20260709 13:13:07.985778  1134 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.021812  1134 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:08.022080  1307 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:08.017393 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.019515 29252 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:07.969445  1516 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:08.009196 28580 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
W20260709 13:13:08.029606 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 84253.5us
I20260709 13:13:08.022114 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:08.030998 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08003582e0 after lost signal to thread 28680
W20260709 13:13:08.037467 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08003517c0 after lost signal to thread 28754
I20260709 13:13:08.036965 28574 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:07.873782  1452 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:07.991762  1496 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.029841 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:08.039582 28510 debug-util.cc:398] Leaking SignalData structure 0x7b0800375d80 after lost signal to thread 28755
I20260709 13:13:07.985263  1475 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:08.045058 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08003f05c0 after lost signal to thread 29286
I20260709 13:13:08.037925  1318 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:08.051292  1374 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:13:08.071790  1318 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:08.074666  1318 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:08.075299  1520 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.001243  1263 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:08.078907 28649 raft_consensus.cc:2368] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13.
I20260709 13:13:08.032038  1516 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.088229 28656 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
W20260709 13:13:08.089299 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67254.1us
I20260709 13:13:08.090262 28651 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:08.091617 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.091889  1263 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:08.082434  1477 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:13:08.092981 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.093530 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.094015 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.094856 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.094161 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:08.096436 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.096588 28655 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:08.097086  1496 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:08.098295 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 71981us
I20260709 13:13:08.102921 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.104910 29257 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:08.021517 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:08.114703  1171 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:08.114295 28478 catalog_manager.cc:5697] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:13:08.086356   909 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:08.118009 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.118917 28648 raft_consensus.cc:2368] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12.
I20260709 13:13:08.121116  1525 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:08.121824  1525 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:08.122327  1525 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:08.115193  1171 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:08.125427  1171 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.125337 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:08.128288 28647 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:08.115196  1432 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.131418  1459 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:08.132185  1459 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:08.133158 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:08.132406  1432 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.126924  1171 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:08.116734 28478 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 6 to 8, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 8 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:13:08.100045  1516 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:08.047050  1475 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:08.152148 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49312us
I20260709 13:13:08.167683 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.168279 28648 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:08.145227  1475 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:08.176713 29254 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:08.201929   906 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:08.162328  1452 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:08.217312 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:08.219141 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:08.222980 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 69751.5us
W20260709 13:13:08.236541 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 360338us
W20260709 13:13:08.241273 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.246133 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:08.251204 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.246407 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.254134 28648 raft_consensus.cc:2410] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:13:08.207975  1520 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:08.261726 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 251023us
I20260709 13:13:08.252213 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:08.264568 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.271132   906 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:08.278110 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.281232 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:08.262722  1503 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.283433 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:08.287451 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.284889  1134 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.208166  1459 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.297524 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:08.297807  1464 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:08.298349 28652 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:08.299101  1367 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:08.285319   906 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:08.284154  1374 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:08.318929 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:08.332199 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 241167us
W20260709 13:13:08.343272 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 56234.3us
I20260709 13:13:08.303014  1520 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.318889   909 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:08.378396 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44390.7us
I20260709 13:13:08.331067   906 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:08.330829  1374 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:08.400840   909 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.405493  1263 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:08.334933  1467 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:13:08.406898 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 308803us
I20260709 13:13:08.391245 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.389853  1374 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:08.358657  1520 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:08.424198 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 152195us
I20260709 13:13:08.447556 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:08.461310 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 177702us
I20260709 13:13:08.465780 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.424844  1405 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.440248  1134 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.485749 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:08.490870 28479 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 277) took 17847 ms (client timeout 15000 ms). Trace:
I20260709 13:13:08.498049 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.456892  1496 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.506834 28581 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:08.516309 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 129198us
I20260709 13:13:08.518577 28647 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
W20260709 13:13:08.518842 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 139933us
I20260709 13:13:08.451925  1534 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:13:08.525141 28648 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:08.518061   906 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:08.531102  1520 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.531924  1520 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:08.519569  1530 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:08.514895  1171 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:13:08.543578 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:08.543998 28576 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:08.544337 28577 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:08.544736 28577 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:08.545652 28577 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:08.546694 28577 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:08.546582  1475 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.549122   621 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:08.549448 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.549846  1475 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.550850   621 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:08.551365  1371 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:08.551649 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.552992 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.553437 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.557595  1371 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:08.558601  1263 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:08.560413 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:08.561254 29259 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:08.561895 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.535917  1547 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:13:08.552819 28575 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:08.569792 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.570123 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.553519 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.532836  1489 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.514160  1496 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:13:08.579882 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.551306   621 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:08.551265 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:08.581427 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.583307 29259 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:08.586231 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:08.587136 29258 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:08.587529 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:08.588871 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:08.542260  1530 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:08.589619  1530 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:08.590591  1548 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:08.579803 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.596818 28728 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:08.598737 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:08.599261 28576 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
W20260709 13:13:08.599639 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56714.5us
I20260709 13:13:08.599466 29254 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:08.600765  1432 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:13:08.601293 28580 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 9.
I20260709 13:13:08.605753 28581 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:08.607548 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.608704 28728 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:08.613245 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.618223 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.619977  1432 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:08.620503  1432 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:08.621595  1432 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:08.623095  1432 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:08.624522   621 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.627352 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:08.537695  1525 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.629084 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.632129 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.633620  1318 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:08.633880  1537 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
I20260709 13:13:08.634158  1318 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.634646  1318 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:08.608161  1520 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:13:08.568885  1547 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:13:08.637880  1547 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:08.638264  1547 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:08.639014 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 59294.1us
I20260709 13:13:08.639518  1538 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:08.640537 29223 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:08.639047  1547 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.643028 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.646503  1551 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:08.646746  1542 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:08.647276  1551 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:08.647722  1544 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:08.648121  1544 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:08.592118  1489 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.649107  1544 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.650349 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.650578  1544 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:08.650960  1489 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.606635  1548 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.652938  1533 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:08.654163  1520 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:08.654933  1520 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.655092 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.655813  1542 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:08.656235  1542 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:08.657222  1542 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.658707  1371 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:08.659168  1371 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:08.660595  1431 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:08.661041  1431 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:08.661202 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:08.661937  1542 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:08.495210 28479 rpcz_store.cc:269] 0709 13:12:50.455731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.518062 (+ 62331us) service_pool.cc:224] Handling call
0709 13:12:51.613304 (+1095242us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400163d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d80090 00007f4a27e1ef3a 00007f4a2dbd51cc 00007f4a2dcd337e 00007f4a2c1942a4 00007f4a2c194232 00007f4a2c194161 00007f4a2c1940dc 00007f4a2c193392 00007f4a2615148c 00007f4a261508c6
0709 13:13:08.289329 (+16676025us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:56.345875 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:56.346847 (+   972us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:56.346908 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:12:56.346948 (+    40us) tablet.cc:662] Decoding operations
0709 13:12:56.348819 (+  1871us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:56.348940 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:56.348978 (+    38us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:12:56.350678 (+  1700us) tablet.cc:701] Row locks acquired
0709 13:12:56.350737 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:12:56.351025 (+   288us) write_op.cc:270] Start()
0709 13:12:56.351288 (+   263us) write_op.cc:276] Timestamp: P: 1783602776350899 usec, L: 0
0709 13:12:56.351341 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:12:56.352632 (+  1291us) log.cc:844] Serialized 6230 byte log entry
0709 13:12:57.258663 (+906031us) op_driver.cc:464] REPLICATION: finished
0709 13:12:57.305387 (+ 46724us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a24d0c0ac 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a2b84cef0
0709 13:12:57.508407 (+203020us) write_op.cc:301] APPLY: starting
0709 13:12:57.513693 (+  5286us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:58.039516 (+525823us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:58.047680 (+  8164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:58.785338 (+737658us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:58.785847 (+   509us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:12:58.785941 (+    94us) write_op.cc:312] APPLY: finished
0709 13:12:58.786638 (+   697us) log.cc:844] Serialized 148 byte log entry
0709 13:12:59.046374 (+259736us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:59.072400 (+ 26026us) write_op.cc:454] Released schema lock
0709 13:12:59.072509 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:59.077145 (+  4636us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:59.077208 (+    63us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":459768,"reported_tablets":44,"spinlock_wait_cycles":522611072,"child_traces":[["op",{"apply.queue_time_us":180984,"apply.run_cpu_time_us":41511,"apply.run_wall_time_us":1568783,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70975,"num_ops":16,"prepare.queue_time_us":37075,"prepare.run_cpu_time_us":19846,"prepare.run_wall_time_us":210211,"raft.queue_time_us":237256,"raft.run_cpu_time_us":22805,"raft.run_wall_time_us":162965,"replication_time_us":860424,"spinlock_wait_cycles":7312256,"thread_start_us":607827,"threads_started":5,"wal-append.queue_time_us":494351,"wal-append.run_cpu_time_us":30488,"wal-append.run_wall_time_us":2610702}]]}
I20260709 13:13:08.661900  1431 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:08.663316  1431 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:08.665323  1516 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.667006  1525 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:08.667496 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.667660  1525 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:08.668673  1543 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:08.669133  1543 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:08.670207 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.670050  1543 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.660169  1371 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.643311  1547 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:08.677662 28726 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:08.677380 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:08.671350 28724 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:08.692252 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.688820 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:08.693648 28727 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:08.693693 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:08.697861 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 212213us
I20260709 13:13:08.700927 29256 raft_consensus.cc:2410] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:13:08.700973 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:08.701692 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62748.7us
I20260709 13:13:08.703769 29252 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:08.704942   621 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:08.705667 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:08.706713 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:08.648357  1551 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.711812 28730 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: [10.5-11.6]
I20260709 13:13:08.720608 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:08.721962 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 291471us
I20260709 13:13:08.708580  1516 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.655457  1520 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.735118 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:08.726202 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.724475 28621 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.736222 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:08.716444  1525 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:08.745383 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 339138us
I20260709 13:13:08.746322 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:08.746621 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 43881.6us
I20260709 13:13:08.751406 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:08.723563  1371 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:08.746225 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:08.758744 28546 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.725544  1548 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:08.762241 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.741293  1560 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:08.766942 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.767038 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.748786  1516 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:08.769038 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.769678 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.771145 28577 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:08.766120 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.772663 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.773065 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.773417 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:08.774713 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.776700 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:08.782907 28579 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:08.767277  1525 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:08.808980 29254 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:08.809804  1432 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:08.811012  1432 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:08.811753  1432 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:08.812516  1432 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:08.777101  1496 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:08.787639  1553 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:08.788399  1552 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:08.751724  1367 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:13:08.784600  1464 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:13:08.790412  1520 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:08.769924  1530 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.737524  1405 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:13:08.798763 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 51134.1us
I20260709 13:13:08.763772  1555 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.768134  1560 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:08.813409  1477 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:08.785234  1503 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:08.770685  1516 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:08.815694  1553 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:08.785706 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:08.825052 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 59086.9us
I20260709 13:13:08.783607  1548 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:08.837726 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 70164.6us
I20260709 13:13:08.858228 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:08.860160 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 74551.3us
W20260709 13:13:08.835019  1558 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:13:08.916353 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.917714 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.915398 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.919363 28622 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:08.839843 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.931834 28579 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:08.843201  1317 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:13:08.950363 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:08.952409 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 94273.5us
I20260709 13:13:08.953668 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:08.953302 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 70915.8us
I20260709 13:13:08.914744  1318 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.837073  1374 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.867252  1516 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:08.957576 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.843384  1559 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:08.867050  1503 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.954118 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:08.961447 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46136.2us
I20260709 13:13:08.857402  1553 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:08.961723 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:08.955847 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:08.961928 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 126375us
I20260709 13:13:08.930496  1552 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:08.966388 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50157.4us
I20260709 13:13:08.934206  1489 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:08.971011  1489 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:08.958297  1557 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:13:08.946743  1452 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:08.954384  1548 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:08.957960  1432 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:08.958750  1467 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:08.958987  1533 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:08.962441  1559 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:08.861595  1555 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.965416  1520 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:08.965379  1503 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:09.014433  1374 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:09.014789  1432 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:09.015264  1432 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.015641  1432 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:09.015851  1530 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:08.973398  1525 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:09.006001 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:08.973219  1459 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:09.012290  1559 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:09.012727  1568 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:09.013160  1566 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:09.013281  1318 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.029232  1566 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:09.030014  1318 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:09.030550  1318 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:09.030310  1566 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:09.031651  1566 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:09.014364  1520 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:08.976110  1496 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:13:09.035818  1564 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:13:09.042026 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:09.042955 28730 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:09.026408  1571 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:09.049129  1571 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:09.050371  1571 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.021773 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:09.023829 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48325.4us
I20260709 13:13:09.058182 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:08.991060  1171 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:09.031004  1318 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.068523  1548 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.071015  1553 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.013599  1555 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.075238  1543 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.003139  1317 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:09.065665 28730 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:08.998935  1134 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:09.066249 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 43513.8us
I20260709 13:13:09.058580  1459 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.067101  1171 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.065739  1560 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:08.994192  1452 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.072832  1553 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.083415 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:09.020409  1525 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:09.088306 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 126649us
I20260709 13:13:09.105706 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:09.089856 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 134074us
I20260709 13:13:09.064482 28727 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
W20260709 13:13:09.090939 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.098224 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.106843 29251 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:09.111824 28729 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:09.104967 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:09.113209 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:09.116783  1569 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:09.117808  1569 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:09.119720 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.120052 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.117825  1568 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:09.121097 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.121832 28652 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:09.097411  1134 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.130195 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:09.128072  1318 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.086239   909 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:09.139498 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.139797 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.106158  1525 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.111693  1547 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:09.151902 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.154351 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.119041  1569 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.158936 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.174748 28650 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:09.131494  1577 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:09.102932  1317 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:09.192668 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.165279  1547 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:09.165825  1489 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.168517  1525 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:09.170766  1318 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.171305  1575 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.207396  1575 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.208384  1525 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:09.209805  1575 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.171880  1554 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:09.172385  1570 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:09.173208  1520 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:09.173429  1561 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.463s	user 0.001s	sys 0.003s
I20260709 13:13:09.162562  1134 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.182996  1432 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.227901  1432 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.200219 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:09.200392 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 364678us
I20260709 13:13:09.188321  1516 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:09.149426  1568 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:09.201088 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 102065us
I20260709 13:13:09.231911  1516 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:09.232564 29224 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.232954  1568 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.171459  1503 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.234813 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:09.236706  1374 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:09.237226  1538 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:09.237303  1374 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:09.238054  1538 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:09.239100  1538 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.210822  1577 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:09.202584 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62878.9us
I20260709 13:13:09.206104  1459 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.242455  1459 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:09.242800  1577 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:09.205523  1547 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.210772  1554 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:09.243952  1554 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.201419   909 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:09.222476  1520 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:09.246516  1520 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.248723 28546 leader_election.cc:400] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12.
I20260709 13:13:09.221949  1405 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:09.249111 28546 leader_election.cc:403] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:09.249392  1405 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:09.249871  1459 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12.
I20260709 13:13:09.250300  1405 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:09.250825 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.251561  1405 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:09.253917  1317 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.238073  1374 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.262229 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:09.262930 28579 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:09.267776 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:09.268530 28573 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.269538 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:09.270166 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:09.276818 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.275398 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:09.280584 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:09.282424 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:09.283766 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:09.283674 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:09.284920 28572 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:09.286725 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.256844  1452 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:09.293303 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:09.296082 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.297526 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:09.288648  1550 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:09.304806 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:09.289605  1569 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:09.290129  1134 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:09.311672  1318 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:09.311888  1576 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:13:09.312918  1576 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:09.313340  1576 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:09.313416  1318 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:09.313867  1576 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:09.314031  1318 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.314606  1318 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.315062  1577 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:09.315460  1577 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:09.317114  1171 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:09.317678 28726 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:09.292685  1477 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:09.292887  1575 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:09.298334  1570 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:09.308849 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.322749 28573 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:09.326550 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:09.324079 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:09.303375  1432 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:09.316325  1577 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.304128  1584 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:09.332796 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.338577 28649 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:09.335945 29254 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:09.329177  1432 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.337299 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:09.309705  1569 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:09.344214 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:09.346015 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46370.1us
I20260709 13:13:09.346112 28652 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:09.328215  1570 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:09.329469  1571 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:09.351617 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:09.354758 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:09.353432 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:09.357148 28724 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:09.347098  1171 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:09.345237  1432 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.348829  1569 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:09.351075  1560 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:09.369037 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:09.349766  1584 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:09.354172  1570 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:09.381887  1503 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.385317 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.386312 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:09.387785 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:09.388414 29256 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:09.389945  1584 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.366708  1571 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:09.357965  1552 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:13:09.395462  1571 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:09.385424  1263 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:09.396853 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.397614 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:09.398212   909 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:09.360464  1171 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:09.399214  1171 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.400645 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:09.401309 28572 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:09.402100 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:09.402252 28648 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:13:09.402781 28728 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:09.408264 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.408893 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:09.409111 28651 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:09.409279 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:09.409783 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.410101 28573 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:09.410399 28654 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:09.410661 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:09.411407 28656 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.412961  1544 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:09.413594  1544 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.416173  1544 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:09.417279  1263 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.418090 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.418882 28651 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:09.419442  1263 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:09.419827 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.409516 28653 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.421979 28722 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:09.423403 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:09.424630 28728 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 10: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:09.426016 28730 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:09.358505  1577 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:09.430650 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:09.372869 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.378037 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.360033  1543 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:09.439970 29256 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:09.409065 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:09.449767 28647 raft_consensus.cc:2393] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:13:09.456847 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47876.5us
W20260709 13:13:09.462255 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 93321.1us
I20260709 13:13:09.458189 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:09.462716 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:09.452025 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:09.464435 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:09.465163 29258 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:09.460254 28653 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:09.466094 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:09.449476 28724 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:09.467500 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:09.467912 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:09.468874 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 69281.6us
I20260709 13:13:09.399807  1459 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:13:09.476045 28648 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:09.416785  1544 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:13:09.469611 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:09.471316 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:09.486222 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:09.487129 28652 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:13:09.487600 28652 pending_rounds.cc:85] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 5
I20260709 13:13:09.477262 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:09.472548 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.503418 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.465169  1263 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:09.509979 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:09.450740  1548 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:09.513890  1548 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:09.514386  1548 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.520916  1571 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:09.487859 28652 pending_rounds.cc:107] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:13:09.522742 28652 raft_consensus.cc:2889] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:09.476138  1575 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.526261 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.529170 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:09.526590 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:09.536108 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.537159 29255 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:09.537703 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.547966 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.548868 28652 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:09.554399 29224 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.476554  1542 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:13:09.512151  1525 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:09.560381 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.547401  1464 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:09.513099  1263 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:09.566537 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:09.572906 28579 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:09.573450 28580 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:09.573546 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:09.533532  1371 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:09.576546 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:09.533167  1588 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.591447 28572 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:09.578204 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.582175 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:09.585368 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.586172 29252 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:09.588376 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.488097   906 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 13:13:09.585393 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 99322us
I20260709 13:13:09.535810  1540 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:09.600833 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:09.608709 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.610765 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.535259  1553 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:13:09.576030  1263 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:09.572670  1568 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:09.589479  1551 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:09.533613  1559 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:09.638347 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 168717us
I20260709 13:13:09.544409  1575 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:09.640059 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:09.592417  1374 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:09.646762  1595 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:13:09.649956 28652 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:09.655072  1580 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:13:09.656090  1548 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.614548  1134 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:09.658021  1578 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:09.608695  1371 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:09.660171 29260 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:09.622601  1552 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:09.665230 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 98864.5us
I20260709 13:13:09.660537 28655 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:09.671499 28650 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:09.629698  1525 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:09.675535 29251 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:09.686165  1475 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:09.637235  1171 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.691498 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:09.691926  1171 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:09.694485  1432 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.697633  1371 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.699230  1452 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:09.692731 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:09.701753 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 89398.1us
I20260709 13:13:09.675688  1530 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:09.615748  1588 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.700404  1432 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.683517  1582 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:09.703305  1525 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:09.729737  1550 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:09.790884 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 176689us
W20260709 13:13:09.793468 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.802109 29258 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:09.730050  1530 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:09.812465  1318 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:09.815303  1318 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:09.816255  1593 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
W20260709 13:13:09.818681 28695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.039s
W20260709 13:13:09.829351 28695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.000s	sys 0.041s
W20260709 13:13:09.829804 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 525039us
I20260709 13:13:09.714617  1475 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:13:09.839959 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:09.843685  1452 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:09.766990  1489 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:13:09.876735 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:09.773991  1576 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:09.870445  1550 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:09.894243 28656 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:09.895833 28652 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:09.878042  1405 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:09.893838  1550 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:09.874148  1530 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:09.926347 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 233681us
I20260709 13:13:09.909765  1548 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:09.921860  1570 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.003s
I20260709 13:13:09.913163  1452 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:09.912357  1609 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.931454 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:09.922348  1550 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:09.925557  1560 consensus_meta.cc:287] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.001s
I20260709 13:13:09.940510  1530 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:09.941097  1464 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:09.941691  1570 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:09.942394  1617 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:09.942687  1263 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:09.944135  1554 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.005s
I20260709 13:13:09.945304 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:09.923522  1575 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:09.901221  1525 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:09.962519 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.958726  1559 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:09.962059  1607 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:13:10.032987 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:10.035372 28574 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:10.034600 29253 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:10.000028  1588 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:09.956904  1543 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:10.048832 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:10.051280 28574 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:10.053989 28577 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:10.054443 28578 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:10.061975 28729 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:13:10.064963  1263 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:10.077448 28577 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:10.079557 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:10.080873 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:10.081949 28574 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:10.086365  1538 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:10.089807  1576 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:10.090245 28726 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:09.951920  1609 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.095768  1609 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:10.100217  1543 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:10.102066  1578 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:10.102873  1606 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:10.104106  1606 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.002838  1617 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.104750  1606 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.119494 29254 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:10.121748  1367 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:10.122352  1367 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.112848 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:10.131243 28726 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:10.101339  1543 consensus_queue.cc:1243] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:10.132397  1318 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:10.133200  1405 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:10.134286  1570 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:10.134217  1405 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:10.132547 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 255921us
I20260709 13:13:10.138006 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.140946 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:10.141350  1594 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:10.141636 28656 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:10.141812  1594 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:10.143170 28650 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:10.145503 29257 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:10.155396 28579 pending_rounds.cc:85] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 8
I20260709 13:13:10.144452 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:10.168469 28579 pending_rounds.cc:107] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:13:10.169597 28579 raft_consensus.cc:2889] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:10.148063 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:10.172348 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:10.173158  1317 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.173548 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:10.173720  1317 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.142262  1594 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:10.174697 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:10.175881 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:10.176126  1317 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:10.176436 28655 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:13:10.173550 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:10.178758  1367 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:10.172659 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.180127 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:10.170356 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:10.181699 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.182513 28655 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:10.182838  1555 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:13:10.183386  1576 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:10.187376 28655 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:10.182961 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.182525 28647 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:10.153481 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:10.183418 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:10.190148 28729 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:10.190338 28656 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.186666 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:10.169050 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 51218.4us
I20260709 13:13:10.199348 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:10.154101 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:10.219394 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 65384.2us
I20260709 13:13:10.176748  1317 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.132910  1318 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:10.210456 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 50463.7us
I20260709 13:13:10.226373 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:10.002539  1554 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.211067 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.188576 28655 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.147640 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:10.221702 29254 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:10.234882 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:10.220960  1576 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:10.235459  1576 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:10.235013  1318 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.235855  1576 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:10.233759 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.236503  1318 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:10.236963  1584 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:10.237417 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.222465 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:10.223901 29257 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:10.238173  1584 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:10.238534  1584 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:10.238924  1584 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:10.239727  1599 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.517s	user 0.001s	sys 0.000s
I20260709 13:13:10.241174  1613 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:10.241946  1596 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.595s	user 0.002s	sys 0.000s
I20260709 13:13:10.242154  1583 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:10.242772  1583 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.243562  1613 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.244062  1613 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:10.246320 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:10.246987  1584 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:10.221097  1367 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:13:10.248540 29260 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:10.249171  1611 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:13:10.250003  1584 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:10.250402  1611 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:10.250842  1611 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:10.225205 28581 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:10.225766 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:10.226740 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:10.183336  1608 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:10.251642 29257 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:13:10.223235 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75282.6us
I20260709 13:13:10.258920 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.252388 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.255597 29254 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:10.215035  1617 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:10.260947 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:10.260332 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.264842 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.224407  1547 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:10.272329 29258 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:10.193717  1609 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:13:10.256594  1588 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:10.295713  1568 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:10.274215  1551 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:10.297241  1551 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:10.298199  1551 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.232771  1317 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:10.302734  1317 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:10.275019 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:10.275305  1475 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:10.275194  1611 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.275071 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:10.279428 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 53732.8us
I20260709 13:13:10.244941  1583 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:10.287408 28656 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:13:10.276988  1550 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.265534  1405 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:10.265269  1516 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:13:10.316543  1611 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:10.265473  1579 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:10.318375  1579 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:10.318575 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 43588.3us
I20260709 13:13:10.319643  1550 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:10.319345  1579 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.320286 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.321236 29251 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:10.269865  1608 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.321977  1584 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:10.323468  1608 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:10.293174  1548 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:10.324713  1405 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:10.277705  1553 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:13:10.233115  1575 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:10.249221  1367 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:10.308095 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:10.305124  1374 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:10.310470 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.232860  1543 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:10.262271  1452 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.325229  1405 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:10.293644  1559 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:13:10.330210 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.331856 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 66608.5us
W20260709 13:13:10.334046 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 75237.1us
I20260709 13:13:10.339005 28726 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:13:10.342221 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.342957 28648 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:10.326218  1583 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:10.346302 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.350960  1554 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:10.353060  1569 consensus_meta.cc:287] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.980s	user 0.014s	sys 0.000s
I20260709 13:13:10.353595  1569 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.354897 28649 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:10.355959  1569 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:10.356825  1575 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:10.343721  1452 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.359822  1452 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:10.361261  1583 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:10.361732  1583 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:10.367231 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:10.367936 28724 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:10.332388  1367 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:10.369321  1367 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:10.370522 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.370620  1367 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:10.344038 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:10.335075  1543 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.376026 28723 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:10.377767 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:10.374019  1575 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:10.383158 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:10.383805 28730 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:10.371613  1609 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:10.385800 29256 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:10.385789 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:10.387670 29256 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:10.387943 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:10.374253  1584 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:10.389676 28722 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:10.387960 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:10.388712 28728 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:10.380172  1578 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:13:10.393345 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:10.394107  1544 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:10.383275  1559 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:13:10.395236  1547 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:10.424280  1547 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:10.425815  1547 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.427109  1547 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:10.383055  1588 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:13:10.434149 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:10.434896 29254 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:13:10.435779  1475 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:10.435978 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:10.397728 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:10.400007 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:10.441910 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:10.398257 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:10.402760 28725 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:10.380600  1543 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.406692  1580 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:10.407781  1554 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:10.404438  1617 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:13:10.404597  1544 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:10.402585  1171 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:10.400440  1318 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:10.459084  1318 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:10.450660  1609 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:10.459854 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:10.460062  1318 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:10.462865 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:10.463496 29257 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:13:10.412648  1636 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:13:10.413162  1624 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.474s	user 0.000s	sys 0.006s
I20260709 13:13:10.413897  1637 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:10.419315 28655 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:10.421594  1623 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.482s	user 0.000s	sys 0.003s
I20260709 13:13:10.421499  1594 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.478937  1594 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:10.423542  1584 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:10.480193  1584 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.433692  1575 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.401774 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:10.416317  1613 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.443272 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.541479  1613 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:10.463537 28728 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:09.996112 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:10.469194 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 2500) took 1101 ms. Trace:
I20260709 13:13:10.542578 28649 rpcz_store.cc:276] 0709 13:13:09.367756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.367956 (+   200us) service_pool.cc:224] Handling call
0709 13:13:10.468950 (+1100994us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b540027e054. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:10.469100 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227703040}
I20260709 13:13:10.469975 28654 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:10.481524 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:10.515993 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45316.9us
I20260709 13:13:10.455158  1554 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:10.544771  1554 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:10.552947 28725 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:10.560639 28728 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
W20260709 13:13:10.562674 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.583526 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:10.584211 28622 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.482781 28727 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:10.603130 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 58524.1us
I20260709 13:13:10.604310  1544 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.611148  1405 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:10.596011  1578 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:13:10.622327 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.615005 28728 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:10.596167  1516 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:10.617419 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 174353us
I20260709 13:13:10.600307  1503 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.624086 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.600008  1580 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.671589 28728 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:13:10.672415 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:10.628971  1617 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:10.624171  1552 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:13:10.674605  1552 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:10.674969  1552 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:10.675832  1552 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:10.626581  1530 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:10.677986  1552 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:10.654533 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:10.692472 28575 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 18: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:10.710762 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:10.710991 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:10.712317 29223 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:10.723721 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:10.726045 28576 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:13:10.741672 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 125394us
I20260709 13:13:10.728654 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:10.748826 28655 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:13:10.715185  1617 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:10.712976  1544 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:10.636241  1503 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:10.733132  1601 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:13:10.718194  1405 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:10.636519  1516 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.736662  1548 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:10.771396 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:10.771821 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:10.671185  1580 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.731702  1571 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:10.807035 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 57713us
I20260709 13:13:10.810860 28723 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:10.815543 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:10.825393 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:13:10.823089 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48694.2us
I20260709 13:13:10.779199 28655 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:10.829811 28650 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:10.732288  1576 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:10.833559 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:10.786428  1431 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:10.837589 28576 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:13:10.814092  1525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.015s	sys 0.000s
W20260709 13:13:10.832897 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 217020us
W20260709 13:13:10.835983 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 221149us
W20260709 13:13:10.840979 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.842701 28580 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:10.749907  1608 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:13:10.812992  1548 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.844635 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:10.844595 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:10.754595  1583 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.843847 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:10.891930 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48155.3us
I20260709 13:13:10.746816  1579 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:13:10.846284  1552 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.832348  1571 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:10.816326  1547 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:13:10.845635  1525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.015s	sys 0.000s
I20260709 13:13:10.961851 28723 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.848831  1548 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.846230  1550 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:10.888355  1542 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:10.846576  1575 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:10.847415  1431 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.000437  1576 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:10.942922  1647 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260709 13:13:10.958632  1640 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
W20260709 13:13:10.941886  1641 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:13:11.024909 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:11.035877 28721 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:11.086159 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61749.2us
I20260709 13:13:11.087606 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:11.037341  1583 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.040956  1666 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.094542 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:11.041936 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 153232us
W20260709 13:13:11.045496  1631 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:13:10.990325  1552 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.011404  1405 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:10.989231  1578 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:11.057542  1662 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:11.060737  1648 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:13:11.000702  1575 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:11.010447  1550 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:11.062968  1431 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.064577  1580 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.013567  1475 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:11.123088  1582 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:11.000319  1516 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.073742 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1187) took 1569 ms. Trace:
I20260709 13:13:11.138413  1579 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.076970  1571 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.077612  1611 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:13:10.947772  1601 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:13:11.100858 28581 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:13:11.124269 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 279737us
W20260709 13:13:11.179535 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.104417 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:11.135349 28723 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:10.947433  1626 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.179s
W20260709 13:13:11.140643 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 247701us
I20260709 13:13:11.150890 28729 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:11.127305  1554 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 13:13:11.066954  1661 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:11.075402  1543 consensus_meta.cc:287] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.007s
I20260709 13:13:11.126138  1525 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:13:11.164938 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 331441us
I20260709 13:13:11.165436 28654 rpcz_store.cc:276] 0709 13:13:09.503919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.625177 (+121258us) service_pool.cc:224] Handling call
0709 13:13:10.469792 (+844615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.544233 (+ 74441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.073486 (+529253us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b540027e050. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:11.073643 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941579008}
I20260709 13:13:11.168063  1582 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:11.180837 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 76554.4us
I20260709 13:13:11.125764  1547 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:13:11.125871  1636 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:13:11.163200  1475 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:11.166325  1431 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:11.200145 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:11.211735 28729 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:11.172618  1663 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:11.199291 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:11.174904  1611 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:11.219596 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:11.220835 28580 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:11.126680  1666 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.196300 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:11.211910 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:11.213702 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:11.205578 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:11.178519  1553 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.216773 28727 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:13:11.158443  1578 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.222364 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:11.221321 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:11.223963 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:11.230334 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 135873us
I20260709 13:13:11.191152  1496 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.242295 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:11.208691  1318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.018s	sys 0.019s
I20260709 13:13:11.217283  1530 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:13:11.204016  1661 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.176540  1579 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.197455  1554 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.208379  1582 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:11.212770  1475 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:11.259296 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:11.246745  1575 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:11.303912 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:11.260200  1520 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:11.305394 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:11.261607  1553 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.203576  1543 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.306702  1677 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:11.270383 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:11.219020  1577 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:11.275826 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 91197.9us
I20260709 13:13:11.230080  1525 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.287569 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 63779.6us
I20260709 13:13:11.158667  1662 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.297179  1657 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:11.321830 29255 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:11.299353  1616 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.299358 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:11.365033 28725 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:11.365267 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:11.301251  1431 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:11.368793 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:11.301734 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:11.302143 28727 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:11.369586 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 161220us
W20260709 13:13:11.370837 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 69220.5us
I20260709 13:13:11.372259 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:11.302693  1681 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:11.264691  1318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.019s	sys 0.019s
I20260709 13:13:11.313819 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:11.373574 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:11.261152  1578 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.261406  1667 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:13:11.381958 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 68271.9us
I20260709 13:13:11.258213  1606 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:11.394192 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 188766us
I20260709 13:13:11.398132 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:11.398990 28722 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 11. Ops: []
I20260709 13:13:11.305398  1666 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.402932 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:11.403072 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:11.323750  1577 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.404923 28730 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:13:11.244915  1496 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.407645 28726 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:11.381290  1432 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:11.253300  1550 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.422325 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:11.407188  1577 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:11.433965  1543 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.434877  1684 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:13:11.406945  1318 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:13:11.437480  1683 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.438040  1683 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.438508  1552 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.383273  1605 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:13:11.365518  1611 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.440419  1683 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.445504  1682 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:11.446297  1682 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:11.447197  1662 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.450381  1496 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.450591 28654 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:11.398773  1431 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:11.366293  1525 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:11.474990 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 97052us
I20260709 13:13:11.403976  1578 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:11.487152 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.488031 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:11.495850 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:11.488340 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:11.500685 28653 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:11.506886 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:11.507516 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:11.445305  1620 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:13:11.508735 28649 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:11.512506 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:11.474942  1594 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:11.514986 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:11.482825  1663 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:11.520674 28726 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:11.515618 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:11.526371 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:11.526656 28648 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:11.478958  1606 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:13:11.562489 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:11.418773  1667 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:13:11.566007 28655 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
W20260709 13:13:11.566972 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 70556.2us
I20260709 13:13:11.568178 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:11.571627 28726 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:11.570612 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 176698us
I20260709 13:13:11.491223  1552 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:13:11.533427  1620 consensus_queue.cc:1243] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:11.485894  1431 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.526450  1684 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:11.596524 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:11.599260 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:11.600036 28579 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:11.602833 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:11.499177  1578 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:11.605122 28580 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:11.572597   906 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.510327  1555 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:13:11.527498  1689 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.606030 28573 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:11.617982 28652 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:11.530965  1496 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:13:11.591727 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:11.602602  1520 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:11.603984  1684 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:11.654174 28726 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
W20260709 13:13:11.656224  1679 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:13:11.657337  1674 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:11.657884  1503 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.658761  1700 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:11.660359  1672 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:13:11.659658  1684 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.622591  1464 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.618665  1583 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:11.641812  1673 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.664987 28650 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:11.649770  1548 consensus_meta.cc:287] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.635s	user 0.004s	sys 0.008s
I20260709 13:13:11.674611  1661 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.624938   906 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:11.675354  1699 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:11.675500  1520 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:11.678480  1690 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:13:11.694001  1431 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.652554  1579 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.701064  1699 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:11.697191  1673 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.707886 28572 raft_consensus.cc:606] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:11.721926 28572 raft_consensus.cc:614] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:11.710731 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 203910us
W20260709 13:13:11.698199  1544 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.002s
I20260709 13:13:11.728781 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:11.702106  1684 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:11.673820  1464 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.699293  1548 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.778853  1571 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:11.657915  1674 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.782716 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.782997 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1591) took 1108 ms. Trace:
I20260709 13:13:11.783541 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.784968   906 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.801244 29256 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:11.785573 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.805877 29259 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:13:11.787317 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.791067  1673 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.791883  1699 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.800108 29254 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:11.802515  1682 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.802969 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.762051  1525 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.800794 28721 rpcz_store.cc:276] 0709 13:13:10.674998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.678449 (+  3451us) service_pool.cc:224] Handling call
0709 13:13:10.678709 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.085186 (+406477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.782758 (+697572us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54001b9754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:11.782939 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820828544}
I20260709 13:13:11.808727  1674 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.809501  1171 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.826931 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.827795 29260 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:11.827899  1569 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:11.827996 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.828408  1569 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:11.810359 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.811720  1464 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.712705  1520 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.818400 29255 raft_consensus.cc:2393] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 11: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:11.820097 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:11.830914  1520 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.826642  1171 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.798944  1571 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:11.833711  1571 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:11.835235  1571 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:11.836015  1548 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.836808 29259 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:11.837118  1699 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:11.837814  1171 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:11.793637  1578 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.845326 28654 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:11.846091 28650 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:11.854738  1569 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.855916  1569 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:11.714195  1577 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.859427  1577 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.861656 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:11.862308 28574 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:11.867115 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 138455us
I20260709 13:13:11.867964 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:11.870481  1520 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:11.871068  1520 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:11.873673  1520 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.898494 28652 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:11.904109 28574 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
W20260709 13:13:11.856913  1669 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.415s	user 0.002s	sys 0.000s
W20260709 13:13:11.889921  1582 consensus_meta.cc:287] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.004s
I20260709 13:13:11.924885 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:11.927579 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:11.909595  1657 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:13:11.926456  1475 consensus_meta.cc:287] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:13:11.950277  1668 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:11.954295  1475 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.957509  1496 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:11.958123  1496 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:11.959236  1475 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.959980  1475 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.960393  1496 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:11.940694  1582 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.958129 28729 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:11.963317  1582 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:11.964389  1263 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:11.964835  1263 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:11.965729  1263 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:11.967068  1263 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:11.999092  1619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.934s	user 0.013s	sys 0.016s
I20260709 13:13:12.010560  1571 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:12.023175 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 428894us
W20260709 13:13:12.020419  1619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.955s	user 0.013s	sys 0.016s
W20260709 13:13:12.033169 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 459316us
I20260709 13:13:12.029184 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:12.041194 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.012s
I20260709 13:13:12.028623  1571 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:12.072256 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.004s	sys 0.012s
I20260709 13:13:12.073622 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:12.075173 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 622158us
I20260709 13:13:12.079245 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:12.080034 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.080670 28574 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:12.081683 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:12.081902 28581 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 18: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:12.082261 28575 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:12.083180 28647 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:12.072669 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.080216 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.084146 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.085693 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 56669.3us
I20260709 13:13:12.086189 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.086804 28654 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:12.087597 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.088235 28650 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
W20260709 13:13:12.088423  1666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.003s	sys 0.013s
I20260709 13:13:12.090517 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.092195 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.092849 28654 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:12.111677 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:12.120072 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 192622us
W20260709 13:13:12.121323 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.124042 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:12.124531 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:12.139421  1581 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:12.139910  1581 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.140314  1581 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:12.140918  1691 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:12.144182  1547 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.144728  1547 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.085227  1626 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:12.145704  1626 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:12.088784  1666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.003s	sys 0.013s
I20260709 13:13:12.140056  1700 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:12.149655 28575 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:12.149940 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:12.151847  1691 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:12.164765  1571 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.165185  1691 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:12.166548  1691 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:12.110976  1550 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:12.168378  1550 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.152611 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.121966  1609 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:12.169533  1609 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.170419  1677 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.171504  1609 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.171155  1677 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.152060  1694 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:13:12.173734  1694 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:12.174091  1694 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:12.174902  1694 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:12.176097  1694 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:12.162302  1686 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:12.179524  1686 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.179991  1686 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.162761 29259 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:13:12.181105 29259 pending_rounds.cc:85] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 10
I20260709 13:13:12.180879 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.181413 29259 pending_rounds.cc:107] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:13:12.181715 29259 raft_consensus.cc:2889] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:12.149840  1171 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:12.182683 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.183403 29254 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:12.149206  1569 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:12.184015 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.183949  1569 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:12.186303  1569 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.163509  1548 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:12.149642  1543 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.164158  1475 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:12.117338  1667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.027s	sys 0.079s
I20260709 13:13:12.200739 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.178979  1547 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.201505 28649 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:12.203593 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:12.121023  1570 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.335s	user 0.002s	sys 0.018s
I20260709 13:13:12.183058  1171 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.187510 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.192273  1673 raft_consensus.cc:2764] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:13:12.119269   906 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:12.188915 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 77352us
I20260709 13:13:12.193794 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.160794 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:12.195377 29224 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:12.204859 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 55003.9us
I20260709 13:13:12.215909 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:12.216085 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:12.197115  1667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.027s	sys 0.080s
I20260709 13:13:12.170564  1550 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.209848 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.211285 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:12.231633 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 70925.2us
I20260709 13:13:12.204775 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:12.233687 29251 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:12.211964  1570 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.458s	user 0.003s	sys 0.018s
I20260709 13:13:12.220259  1713 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:12.224865 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.241380  1713 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.242625 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.243893  1713 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.243592 29254 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:12.230139 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.234354 28728 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:13:12.246964 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:12.247537 28728 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.203326  1674 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.235991 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.249384  1674 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.250429 28721 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:12.236657 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.245740 29260 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:12.252048  1674 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.269229  1719 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:12.270182  1719 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.274905  1719 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:12.278649 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65864.5us
W20260709 13:13:12.278757 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62930.7us
I20260709 13:13:12.280059 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:12.280257 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.280357 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:12.280941 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 69760.3us
I20260709 13:13:12.213932  1496 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:12.289358 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.196440  1543 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.196624  1548 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.296375 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:12.228469  1667 consensus_queue.cc:1243] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:12.280059 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.290047 28656 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:12.287765 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:12.290940 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.292699 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.296361 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.320417 28726 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:12.323226 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:12.295994 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.296491 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:12.300895  1704 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:13:12.302637  1543 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.304186  1367 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:12.305353   909 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:12.305416  1464 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:12.313180  1649 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.026s	sys 0.068s
I20260709 13:13:12.292410  1699 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:12.314033 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2771) took 1912 ms. Trace:
I20260709 13:13:12.315583 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.316162 28728 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:12.317665  1171 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.319491 29256 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.300289  1687 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:12.330355 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.235447  1684 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.279369  1317 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:12.278209  1609 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:12.335906 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:12.212033  1594 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:13:12.344870 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.346261 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:12.293116  1496 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.385550 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.386588 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.436252 28580 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:12.393769 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.392416 28722 rpcz_store.cc:276] 0709 13:13:10.401369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.402863 (+  1494us) service_pool.cc:224] Handling call
0709 13:13:10.403249 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.399454 (+996205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.313756 (+914302us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b54001ba154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:12.313970 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2289490176}
I20260709 13:13:12.437654 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.438617 28722 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:12.332772  1571 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:13:12.324574  1719 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:12.347029  1674 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.401938 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.292692  1673 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:13:12.349712  1520 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.320185  1569 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:13:12.430243 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.433266 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:12.415208 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.378198  1677 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:12.436256 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 90232.1us
I20260709 13:13:12.349789  1613 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:12.388383 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:12.399217  1649 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.028s	sys 0.068s
I20260709 13:13:12.395335  1699 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:12.452142 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.398718  1700 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.397143  1666 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:12.447736 29256 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:12.378466  1367 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.387434   909 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.399147  1626 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.472662 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:12.473635 29251 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:13:12.476254 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 88008.2us
I20260709 13:13:12.445833  1496 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.407972  1684 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.478379 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.446312  1543 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.392755  1464 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.478261  1609 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:12.480206  1715 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:12.448647  1725 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:12.480639  1700 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.480566 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:12.446626  1317 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:12.448966  1171 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:12.500278 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2533) took 1004 ms. Trace:
I20260709 13:13:12.476827  1520 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.479208  1699 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:12.440343  1687 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.498203  1666 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:12.521746 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.522156  1691 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:12.523056  1609 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.523959  1543 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.525090  1701 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:12.527128  1464 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.572626 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.482663  1570 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:12.538820 28730 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:13:12.481464  1709 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:13:12.478941  1568 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:13:12.519727  1686 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:12.485642  1613 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.559094 28655 rpcz_store.cc:276] 0709 13:13:11.496187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.572325 (+ 76138us) service_pool.cc:224] Handling call
0709 13:13:11.603500 (+ 31175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.603712 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:12.029548 (+425836us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.498624 (+469076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.499985 (+  1361us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:12.500036 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.500101 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.500221 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":596754,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"thread_start_us":875910,"threads_started":2}
I20260709 13:13:12.570861 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:12.628279 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 57479.8us
I20260709 13:13:12.532773  1725 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:12.610430 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.630463 28572 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:12.631508 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.471827  1674 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.622205  1621 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:12.629221 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:12.631882 28620 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:12.570238  1584 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:12.575946  1691 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:12.575817  1570 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.653748 28574 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:12.643105 28580 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:12.564090  1171 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.640554 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:12.564745  1715 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:12.674103 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.635285  1701 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:12.639346  1548 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:12.697468 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.640057  1464 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:12.677721 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.636286  1725 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:12.646072  1658 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:12.680142 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.721527 29251 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:12.651862  1619 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:12.641386  1621 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:12.725915 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1840) took 1271 ms. Trace:
I20260709 13:13:12.656958  1570 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:12.733490  1738 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:12.738235 29258 rpcz_store.cc:276] 0709 13:13:11.455016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.455219 (+   203us) service_pool.cc:224] Handling call
0709 13:13:11.485151 (+ 29932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.507944 (+ 22793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.507985 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.516858 (+  8873us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.037563 (+520705us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:12.037621 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.037692 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.721760 (+684068us) raft_consensus.cc:1685] finished
0709 13:13:12.721779 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.725822 (+  4043us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40861,"raft.queue_time_us":98139,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":8517,"thread_start_us":437962,"threads_started":1,"wal-append.queue_time_us":714479}
I20260709 13:13:12.726567 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:12.742081 29259 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:12.658852  1584 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.698601  1701 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:12.700555  1718 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:12.675680  1317 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:12.876789  1520 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:12.812788 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 180944us
W20260709 13:13:12.866645 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.950670 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:12.788358  1581 consensus_meta.cc:287] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.001s
I20260709 13:13:12.785285  1525 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.870604  1663 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:12.786644  1171 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:12.955811  1663 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.963425  1663 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.955760  1525 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:12.965342  1733 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.228s	user 0.003s	sys 0.000s
I20260709 13:13:12.968230 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2524) took 1480 ms. Trace:
I20260709 13:13:12.968639 28647 rpcz_store.cc:276] 0709 13:13:11.488238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.489971 (+  1733us) service_pool.cc:224] Handling call
0709 13:13:12.082937 (+592966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.083701 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.968024 (+884323us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003a9dd0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:12.968161 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362821504}
I20260709 13:13:12.819716  1673 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:12.954679  1581 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:12.974059 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.899394  1742 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:13:12.786931  1724 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260709 13:13:12.840982  1720 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
W20260709 13:13:12.785823  1727 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:13:12.970822 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.737094  1619 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:12.833261  1716 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
W20260709 13:13:12.769699  1721 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:13:12.875862  1730 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:13:12.896149  1734 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:13:12.880901  1731 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:13:12.869204  1722 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:13:12.930893  1694 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.008s
I20260709 13:13:12.975008  1452 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.014814  1452 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.983011  1496 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.018174 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2790) took 1645 ms. Trace:
I20260709 13:13:13.021734 28572 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
W20260709 13:13:12.787454  1728 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 13:13:12.925571  1726 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:13:12.897950  1666 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.018694 28651 rpcz_store.cc:276] 0709 13:13:11.372860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.372991 (+   131us) service_pool.cc:224] Handling call
0709 13:13:11.873599 (+500608us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:13:11.873835 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.874188 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.874219 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.874765 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.088201 (+213436us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:12.088242 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.088305 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.017850 (+929545us) raft_consensus.cc:1685] finished
0709 13:13:13.017874 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.018112 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":3377920,"thread_start_us":213068,"threads_started":1,"wal-append.queue_time_us":538287}
I20260709 13:13:12.901288  1611 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:13.038151  1553 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.787536  1701 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.837709  1621 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.039816  1701 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:12.787920  1729 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:13:12.747476  1738 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:13.041369  1738 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.772102  1658 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:12.788139  1584 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.786512  1684 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.957302  1687 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:12.992359 28622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.000s
I20260709 13:13:12.881027  1543 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.976087  1520 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:12.875674  1700 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.979801  1606 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:12.976550  1686 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.013566  1525 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:12.993345  1613 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:13.063354 28622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.009s	sys 0.001s
W20260709 13:13:13.083142 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 747261us
I20260709 13:13:13.084007 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:13.063563 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:12.982672  1673 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.072489 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2261) took 1774 ms. Trace:
I20260709 13:13:13.095486 28729 rpcz_store.cc:276] 0709 13:13:11.298443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.302477 (+  4034us) service_pool.cc:224] Handling call
0709 13:13:11.302789 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.961316 (+658527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.072145 (+1110829us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54001270d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:13.072404 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506678016}
I20260709 13:13:13.097543 28581 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:13.082036  1570 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:12.783258  1691 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.100294  1683 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:13.082424  1606 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.009356  1516 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:13.101881  1516 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.020213  1741 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.105400  1683 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:13.013571  1619 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.078666  1496 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:12.789587  1718 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:13.105352  1741 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:13.120638 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.070147  1658 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.149021  1619 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:13.218281 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.254797  1551 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.156296  1678 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:13.283044  1525 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:13.153966  1658 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.255061  1687 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.297231  1520 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:13.297034  1637 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:13.341921 28621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.017s	sys 0.029s
W20260709 13:13:13.329327 28547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.017s	sys 0.013s
I20260709 13:13:13.466246 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2987) took 1140 ms. Trace:
W20260709 13:13:13.477782 28547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.026s	sys 0.028s
W20260709 13:13:13.373812 28655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.014s	sys 0.011s
W20260709 13:13:13.478505 28655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.015s	sys 0.014s
I20260709 13:13:13.306631  1582 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:13.391829 28724 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.004s	sys 0.028s
W20260709 13:13:13.462107 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 320421us
W20260709 13:13:13.479681 28724 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.006s	sys 0.029s
W20260709 13:13:13.462031 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 378095us
W20260709 13:13:13.470278 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.474486 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:13.477732 28621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.021s	sys 0.031s
I20260709 13:13:13.481983 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:13.465540 29223 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.663s (SENT) [suppressed 6 similar messages]
I20260709 13:13:13.481647 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:13.481594 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:13.484637 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.483842 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:13.486805 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:13.487516  1751 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:13.487861 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.488462 29260 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:13.488222  1751 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.489506 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.490326  1751 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.487566 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1338) took 1155 ms. Trace:
I20260709 13:13:13.490859 28577 rpcz_store.cc:276] 0709 13:13:12.331884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.018391 (+686507us) service_pool.cc:224] Handling call
0709 13:13:13.487511 (+469120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:13.491885 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:13.482717 28573 rpcz_store.cc:276] 0709 13:13:12.325338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.325510 (+   172us) service_pool.cc:224] Handling call
0709 13:13:12.325904 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.334989 (+  9085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.335024 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.378238 (+ 43214us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.635305 (+257067us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:12.635368 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.635463 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.465954 (+830491us) raft_consensus.cc:1685] finished
0709 13:13:13.465978 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.466160 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8651,"raft.queue_time_us":9073,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":35826,"thread_start_us":236505,"threads_started":1,"wal-append.queue_time_us":344949}
W20260709 13:13:13.493871 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.494230 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2267) took 1171 ms. Trace:
I20260709 13:13:13.497905 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.498255 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.498459 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:13.499132 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.309196   906 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.510239 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:13.511103 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:13.511477 28579 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:13.494843 28724 rpcz_store.cc:276] 0709 13:13:12.322919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.324326 (+  1407us) service_pool.cc:224] Handling call
0709 13:13:12.385025 (+ 60699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.560493 (+175468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.560524 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.575626 (+ 15102us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.748256 (+172630us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:13.493509 (+745253us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.493818 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.493917 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.493976 (+    59us) raft_consensus.cc:1685] finished
0709 13:13:13.493994 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.494150 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183550,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":13088,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":926248,"threads_started":3,"wal-append.queue_time_us":155539}
I20260709 13:13:13.513962 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:13.515201 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.283743  1718 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.432701  1753 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.519642 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.524791 28696 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:13.474704  1715 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.522017 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.525381 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:13.512899  1555 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:13.533213 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:13.535760 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:13.468786  1516 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.492173  1452 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:13.538756 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:13.311990  1551 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.510263  1752 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:13.514617  1747 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:13.514326  1754 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.517874  1674 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.551726 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.463371  1738 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.553678 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2998) took 1104 ms. Trace:
I20260709 13:13:13.519675  1570 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.558074 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.313954  1678 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.559463 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:13.333225  1525 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.562249 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.529721  1611 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:13.574420  1611 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:13.574836  1611 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:13.542869  1496 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.567965 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:13.579955 29258 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:13.567121 28577 rpcz_store.cc:276] 0709 13:13:12.449314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.516427 (+1067113us) service_pool.cc:224] Handling call
0709 13:13:13.553570 (+ 37143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:13.571938 28573 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:13.551733  1581 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.581434 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2994) took 1253 ms. Trace:
I20260709 13:13:13.581904 28573 rpcz_store.cc:276] 0709 13:13:12.327697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.541327 (+1213630us) service_pool.cc:224] Handling call
0709 13:13:13.581362 (+ 40035us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:13.517102   906 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.512259  1687 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.573837 29251 raft_consensus.cc:2410] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:13:13.576460 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:13.554798  1694 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:13.551975  1751 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:13.557906  1609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.061s	sys 0.084s
I20260709 13:13:13.493235  1637 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.551573  1666 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:13.637897  1575 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:13.638080  1666 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.638460  1575 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.638984 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:13.639253  1701 consensus_meta.cc:287] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:13:13.640699  1693 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.640906  1588 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:13.641268  1693 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.641538  1588 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.563499  1752 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.598287 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1556) took 3141 ms. Trace:
I20260709 13:13:13.598033 29259 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:13.528749  1757 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:13:13.570442  1700 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:13.567139  1516 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:13.565231  1750 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:13.576226  1740 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.537050  1753 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.613052 28723 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:13:13.613292  1699 consensus_meta.cc:287] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.037s	user 0.009s	sys 0.004s
I20260709 13:13:13.613510  1741 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.576623  1520 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.586695  1496 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.614298  1606 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:13.565464  1754 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.725539  1752 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.720852  1605 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.726706  1496 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.726636  1605 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.727051  1754 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.619127  1551 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.621455   906 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:13.598860  1676 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 2.191s	user 0.006s	sys 0.000s
I20260709 13:13:13.623107  1525 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.629184  1554 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.631839  1736 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:13.632400  1725 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.003s
I20260709 13:13:13.634138 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.729513 28650 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:13.641809 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.570631  1673 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.643343  1693 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:13.683821 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:13.691494 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.737625 29254 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
W20260709 13:13:13.637365  1609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.062s	sys 0.085s
I20260709 13:13:13.685927  1583 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:13.703749  1740 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.708352  1588 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.713449 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:13.730662  1582 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:13.750936 28651 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
W20260709 13:13:13.751185 28723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 2270) took 1427 ms (client timeout 1610 ms). Trace:
W20260709 13:13:13.751613 28723 rpcz_store.cc:269] 0709 13:13:12.323919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.383918 (+ 59999us) service_pool.cc:224] Handling call
0709 13:13:13.751026 (+1367108us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400030a54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:13.751131 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2649499392}
I20260709 13:13:13.603657  1694 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:13.721776  1699 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.752646  1694 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:13.643579 29253 rpcz_store.cc:276] 0709 13:13:10.445222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.452281 (+  7059us) service_pool.cc:224] Handling call
0709 13:13:10.691373 (+239092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.716872 (+ 25499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.716901 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.730933 (+ 14032us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.947030 (+1216097us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b180022b940. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:12.205501 (+258471us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:12.205543 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.205625 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:13.039012 (+833387us) raft_consensus.cc:1685] finished
0709 13:13:13.039033 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.584836 (+545803us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54006da1d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:13.587012 (+  2176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90086,"raft.queue_time_us":36083,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8690,"spinlock_wait_cycles":560820992,"thread_start_us":258282,"threads_started":1,"wal-append.queue_time_us":1665433}
W20260709 13:13:13.717068 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 203715us
I20260709 13:13:13.603493  1751 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:13.753527  1751 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:13.753701 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:13.754267  1699 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.755048  1582 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:13.755930  1688 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:13.723807  1658 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:13.640650  1575 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:13.731992 29259 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:13.733203 28654 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:13.734019 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:13.763537 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 123437us
I20260709 13:13:13.728965  1736 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.649646  1750 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:13.728776  1605 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:13.736039 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:13.768898 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 244241us
I20260709 13:13:13.730626  1725 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.769434 29255 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:13.769698 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:13.743692 29258 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
W20260709 13:13:13.680531 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 166625us
I20260709 13:13:13.745460 28652 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:13.722026  1317 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:13.781229  1317 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:13.781687  1317 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:13.783263  1611 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.714497  1637 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:13.715027 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 249502us
I20260709 13:13:13.755085 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:13.763075 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:13.774511 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:13.756467  1688 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.748816  1606 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:13.748523  1551 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:13.775765 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.787204 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:13.772184  1725 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:13.797159 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:13.798260 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:13.799223  1699 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:13.788120 29255 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:13.789290 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:13.801523  1582 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:13.802153  1582 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.803493  1582 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:13.806541 29254 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:13.772852  1750 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:13.792676 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:13.761801  1583 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.810160 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.814092 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:13.814813 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.815755 29255 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 6.
I20260709 13:13:13.811784 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:13.808636  1758 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:13:13.790932  1371 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:13.767117  1658 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.808530  1496 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:13.799844  1699 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:13.836913 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.839428 28650 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:13:13.792313 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53459us
I20260709 13:13:13.840698 28647 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:13.841418  1699 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.815812  1691 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:13:13.824157 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 58575.4us
I20260709 13:13:13.795904  1559 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:13.825188  1754 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.825580 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.824199  1673 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:13.823392  1760 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:13.834700  1741 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.812767  1605 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:13.851862 28576 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 8.
I20260709 13:13:13.825321  1371 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.822993   906 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:13:13.825392 28577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:13.865424 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.866206 28647 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 13:13:13.866439 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.826156  1525 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:13.800352  1606 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.810726  1551 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.825960  1738 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.826166  1762 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:13.836947  1496 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.835485  1752 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:13.871718 29254 raft_consensus.cc:2410] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:13:13.872155 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 101012us
I20260709 13:13:13.873054 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.873443 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.875386  1662 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:13.876143 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.877068 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:13.878294 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.837476  1701 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:13.838007  1687 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:13.884395 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.869599  1753 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:13.876595  1725 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.871194  1673 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.852679  1374 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:13:13.888270 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:14.014380 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:13.884855  1371 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:13.883862  1741 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:14.384099 28650 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:14.383754 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:13.879848  1611 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:14.013875 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50558.3us
W20260709 13:13:14.177903 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.394158 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 517153us
W20260709 13:13:13.950299 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.407388 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.882908 28577 raft_consensus.cc:606] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:14.408128 28577 raft_consensus.cc:614] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:13.879293  1678 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:14.397750 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:14.448227 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:14.254539 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2807) took 1623 ms. Trace:
I20260709 13:13:14.461396 28655 rpcz_store.cc:276] 0709 13:13:12.631091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.631242 (+   151us) service_pool.cc:224] Handling call
0709 13:13:12.631595 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:12.631914 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.631945 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.644495 (+ 12550us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.508808 (+864313us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:13.508874 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.508968 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.254273 (+745305us) raft_consensus.cc:1685] finished
0709 13:13:14.254299 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.254470 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101324,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":753028,"threads_started":1,"wal-append.queue_time_us":872126}
I20260709 13:13:14.397224 28647 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:14.465880 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:14.295528 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:14.294492 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.385552 29251 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:14.396641 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:14.488094 28729 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
W20260709 13:13:14.047905  1770 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:13:14.378756  1740 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:14.160730  1551 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:14.056463  1606 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:13.887769  1605 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:14.390376  1496 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:13.876392  1754 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:13.878703  1750 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:13.895711  1525 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:14.063520  1582 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:14.631083 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:14.917032 28577 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:14.918020 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2990) took 2591 ms. Trace:
I20260709 13:13:14.918429 28577 rpcz_store.cc:276] 0709 13:13:12.326392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.686985 (+2360593us) service_pool.cc:224] Handling call
0709 13:13:14.904397 (+217412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.917682 (+ 13285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.917949 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:14.864598 28729 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:14.824837 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:14.927711 29251 raft_consensus.cc:2410] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:13:14.831758 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.943850 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.947296 28545 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.014s	sys 0.037s
W20260709 13:13:14.665940 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 259298us
I20260709 13:13:14.947350 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:14.949373 29255 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:14.949918 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:14.782560 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:14.952090 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1222) took 1086 ms. Trace:
I20260709 13:13:14.447332  1753 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:14.952657 28650 rpcz_store.cc:276] 0709 13:13:13.865642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.866130 (+   488us) service_pool.cc:224] Handling call
0709 13:13:14.951860 (+1085730us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540025a154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:14.952014 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151057664}
I20260709 13:13:14.343319  1583 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:14.448079  1688 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:14.447772   906 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:14.948058 28545 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.014s	sys 0.037s
I20260709 13:13:14.468147  1687 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:14.980546 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 1.06651e+06us
I20260709 13:13:14.331195  1736 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:14.536942  1678 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:15.007139 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2995) took 2675 ms. Trace:
I20260709 13:13:15.007743 28577 rpcz_store.cc:276] 0709 13:13:12.331920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.955593 (+2623673us) service_pool.cc:224] Handling call
0709 13:13:15.006494 (+ 50901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.006713 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.006747 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:15.006805 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:15.006849 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.006919 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.007068 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:14.860031  1317 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.078s	user 0.012s	sys 0.001s
W20260709 13:13:14.996767 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.567077  1673 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:14.958237  1753 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:15.013804  1753 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.004529   906 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.019559   906 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:14.464033  1662 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:14.400381  1752 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:14.930750  1658 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:14.451517  1701 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:14.988935  1432 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:15.030668  1741 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.011986  1736 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:15.049932 28695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.038s	sys 0.049s
W20260709 13:13:15.054158 28695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.038s	sys 0.049s
W20260709 13:13:15.041915  1691 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.028s	sys 0.044s
W20260709 13:13:15.055404 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.20396e+06us
I20260709 13:13:14.625813  1725 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.058939 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:15.041530  1738 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:15.012790  1687 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.022188  1678 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:15.051012  1751 consensus_meta.cc:287] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.297s	user 0.010s	sys 0.002s
I20260709 13:13:15.050657  1432 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.072187 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.072858  1583 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:15.072724  1700 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:15.073468 28694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.047s	sys 0.049s
W20260709 13:13:15.106294 28694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.048s	sys 0.050s
I20260709 13:13:15.104214 28721 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:15.075433 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.107445 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:15.108057 28721 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:15.051436  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.039s	sys 0.030s
I20260709 13:13:15.083218  1525 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:15.213065 28721 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
W20260709 13:13:15.083514  1694 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.320s	user 0.006s	sys 0.003s
I20260709 13:13:15.084564  1754 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:15.087144 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.048902  1657 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:15.022446  1317 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.059669  1688 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.094697  1662 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:15.061412  1691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.029s	sys 0.044s
I20260709 13:13:15.105886  1583 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.095469 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:15.096424  1540 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:13:15.097772 28572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2989) took 2771 ms (client timeout 1935 ms). Trace:
I20260709 13:13:15.236974  1703 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:15.100910  1723 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 2.376s	user 0.011s	sys 0.040s
I20260709 13:13:15.078140 28729 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:13:15.253331 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.060611  1736 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.058076  1605 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.106353  1751 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.106149  1432 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:15.101478  1738 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.205931  1687 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:15.206874  1725 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.210323  1683 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.210855  1678 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:15.212970 28726 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:15.109433  1371 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.000s
W20260709 13:13:15.227770 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.234236 28573 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:15.246953  1583 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:15.096437  1752 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:15.237712 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:15.213330  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.039s	sys 0.030s
I20260709 13:13:15.214075  1584 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.245124  1753 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.099332 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:15.289881 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:15.192610  1576 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:15.213836  1773 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.246585  1688 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.239439  1694 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.243925 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1575) took 1438 ms. Trace:
I20260709 13:13:15.264189 28724 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:15.273463 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.246140  1540 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:15.277109 29256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1572) took 3045 ms (client timeout 2108 ms). Trace:
W20260709 13:13:15.246271 28572 rpcz_store.cc:269] 0709 13:13:12.326092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.631255 (+305163us) service_pool.cc:224] Handling call
0709 13:13:15.097530 (+2466275us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54000ec9d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:15.097686 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895945600}
I20260709 13:13:15.290549 28729 raft_consensus.cc:2376] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11. Re-sending same reply.
W20260709 13:13:15.264750 28574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2993) took 2937 ms (client timeout 1552 ms). Trace:
I20260709 13:13:15.272087 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:15.272478 29224 connection.cc:256] RPC call timeout handler was delayed by -1.328368115999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:13:15.425392 29224 connection.cc:256] RPC call timeout handler was delayed by -1.2050681159998931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:13:15.400846 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.426054 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1903476269999373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:13:15.426376 29224 connection.cc:256] RPC call timeout handler was delayed by -1.1021476270000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:13:15.426641 29224 connection.cc:256] RPC call timeout handler was delayed by -1.0391476269999202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:13:15.426911 29224 connection.cc:256] RPC call timeout handler was delayed by -1.0299896790002094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:13:15.423662 29256 rpcz_store.cc:269] 0709 13:13:12.207495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.279805 (+ 72310us) service_pool.cc:224] Handling call
0709 13:13:15.252658 (+2972853us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b5400661cd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:15.252771 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89163136}
W20260709 13:13:15.373679 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.428853 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.429050 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.274789 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:15.260957  1762 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.001s
I20260709 13:13:15.417459 29259 rpcz_store.cc:276] 0709 13:13:13.805572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.806390 (+   818us) service_pool.cc:224] Handling call
0709 13:13:13.806687 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.061372 (+254685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.061418 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:14.061474 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:14.061518 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.243669 (+1182151us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400750154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:15.243724 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.243865 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585084800}
I20260709 13:13:15.238462  1657 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:15.424350 28574 rpcz_store.cc:269] 0709 13:13:12.327365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.432473 (+105108us) service_pool.cc:224] Handling call
0709 13:13:15.264539 (+2832066us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54000eddd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:15.264674 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435013504}
I20260709 13:13:15.241794  1691 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:15.429749 28573 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:15.427785 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:15.270725  1683 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:15.434019 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.443156 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1617) took 3263 ms. Trace:
I20260709 13:13:15.270009  1738 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.432889 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.442732 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.435168 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.443735 28572 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:15.456415 28729 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:15.454970 28573 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:15.262681  1317 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.266629  1736 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.443727 29252 rpcz_store.cc:276] 0709 13:13:12.180214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.184978 (+  4764us) service_pool.cc:224] Handling call
0709 13:13:12.185770 (+   792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.221347 (+ 35577us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:12.285240 (+ 63893us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.531484 (+246244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.531557 (+    73us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:12.531623 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.442836 (+2911213us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b5400215f54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:15.442909 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.443081 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":537,"prepare.queue_time_us":63678,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":17418,"raft.queue_time_us":150,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":27398,"spinlock_wait_cycles":81089920,"thread_start_us":229189,"threads_started":1,"wal-append.queue_time_us":370506,"wal-append.run_cpu_time_us":16106,"wal-append.run_wall_time_us":1371144}
I20260709 13:13:15.458091 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.454739  1616 raft_consensus.cc:2764] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:13:15.268105  1751 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.457896 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2999) took 2974 ms. Trace:
I20260709 13:13:15.462733 28574 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:15.465930 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.468155 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2766) took 2907 ms. Trace:
I20260709 13:13:15.467772 28573 rpcz_store.cc:276] 0709 13:13:12.483380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.453793 (+2970413us) service_pool.cc:224] Handling call
0709 13:13:15.454167 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.457582 (+  3415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.457841 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382144}
I20260709 13:13:15.468629 28574 rpcz_store.cc:276] 0709 13:13:12.561049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.462263 (+2901214us) service_pool.cc:224] Handling call
0709 13:13:15.462561 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.467870 (+  5309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.468097 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:15.462553 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:15.469869 28574 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:15.427666  1725 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.470556 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2769) took 2905 ms. Trace:
I20260709 13:13:15.471014 28574 rpcz_store.cc:276] 0709 13:13:12.566021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.469409 (+2903388us) service_pool.cc:224] Handling call
0709 13:13:15.469706 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.470275 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.470489 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:15.469892 28573 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:15.274875  1772 raft_consensus.cc:476] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 13:13:15.263630  1703 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.369742  1576 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.369730  1432 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.475247 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2768) took 2913 ms. Trace:
I20260709 13:13:15.523729 28573 rpcz_store.cc:276] 0709 13:13:12.561538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.468984 (+2907446us) service_pool.cc:224] Handling call
0709 13:13:15.469757 (+   773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.474882 (+  5125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.475166 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:15.469051  1764 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.101s	sys 0.167s
I20260709 13:13:15.448146  1762 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:15.453778  1752 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:15.482972 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:15.266063  1496 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.513212 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:15.527566 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.416880  1773 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.546861  1694 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.548251  1753 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.371356  1584 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:15.272397  1371 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:15.528703  1764 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.103s	sys 0.167s
I20260709 13:13:15.558152 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:15.559049 28722 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.517359  1725 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:15.581405 28622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.014s	sys 0.026s
W20260709 13:13:15.582508 28622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.014s	sys 0.026s
I20260709 13:13:15.525861  1616 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:15.469646  1551 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:13:15.439851  1700 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.550904 28726 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
W20260709 13:13:15.553334 29254 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.001s	sys 0.028s
W20260709 13:13:15.583693 28723 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.011s	sys 0.032s
I20260709 13:13:15.584921 28721 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:15.543255 28729 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:15.590546 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:15.541638  1540 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:15.591763 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:15.592752 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:15.632565 29251 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:15.621958 29254 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.007s	sys 0.034s
I20260709 13:13:15.622653 29259 raft_consensus.cc:2368] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:15.634821 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:15.635583 29259 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.591274 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:15.637264 29258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.017s	sys 0.029s
W20260709 13:13:15.637758 29258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.017s	sys 0.029s
I20260709 13:13:15.637629 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:15.638772 29256 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:15.545356  1752 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:15.641575 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.642311 28726 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:15.643985 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.644155 28722 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:15.644857 28726 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:13:15.629272 28723 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.011s	sys 0.038s
I20260709 13:13:15.632740 29252 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:15.650849 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.651705 28726 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:15.651841 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.623525 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:15.651028 28545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.005s	sys 0.007s
I20260709 13:13:15.652810 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:15.653337 28722 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
W20260709 13:13:15.652895 28545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.006s	sys 0.007s
I20260709 13:13:15.653672 28726 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
W20260709 13:13:15.656001 28727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.025s	sys 0.041s
I20260709 13:13:15.657374 28722 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:15.580240  1691 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:15.656257  1540 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:15.660907 28729 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:15.664953 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:15.666993 28722 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
W20260709 13:13:15.664244 28727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.025s	sys 0.043s
I20260709 13:13:15.674880 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1841) took 3528 ms. Trace:
I20260709 13:13:15.698164 29251 raft_consensus.cc:2410] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:13:15.697456 29257 rpcz_store.cc:276] 0709 13:13:12.146158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.146899 (+   741us) service_pool.cc:224] Handling call
0709 13:13:12.149324 (+  2425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.171117 (+ 21793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.171149 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.171190 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:12.171232 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.674557 (+3503325us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400640ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:15.674629 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.674799 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49684224}
I20260709 13:13:15.699975 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:15.621634  1700 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:15.706707  1655 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:15.707638  1655 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:15.707985  1655 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:15.708379  1655 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.708866 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1218) took 1872 ms. Trace:
I20260709 13:13:15.709609  1432 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.710484  1703 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:15.710649 28581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1336) took 3558 ms (client timeout 2134 ms). Trace:
W20260709 13:13:15.711042 28581 rpcz_store.cc:269] 0709 13:13:12.152223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.152360 (+   137us) service_pool.cc:224] Handling call
0709 13:13:15.710444 (+3558084us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54001f8954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:15.710574 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134549248}
I20260709 13:13:15.715018 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1580) took 1892 ms. Trace:
I20260709 13:13:15.715485 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2774) took 2084 ms. Trace:
I20260709 13:13:15.709285 28651 rpcz_store.cc:276] 0709 13:13:13.836546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.838025 (+  1479us) service_pool.cc:224] Handling call
0709 13:13:13.868311 (+ 30286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.064798 (+1196487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.064843 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:15.064905 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:15.064956 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.708615 (+643659us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540023e954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:15.708662 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.708806 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2750999296}
I20260709 13:13:15.716176 28581 rpcz_store.cc:276] 0709 13:13:13.631542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.711861 (+2080319us) service_pool.cc:224] Handling call
0709 13:13:15.714982 (+  3121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.715175 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.715204 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:15.715245 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:15.715281 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.715336 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.715435 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:15.589995  1616 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:15.715569 29258 rpcz_store.cc:276] 0709 13:13:13.822601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.545861 (+723260us) service_pool.cc:224] Handling call
0709 13:13:14.944755 (+398894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:14.970970 (+ 26215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.971018 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:14.988307 (+ 17289us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.638403 (+650096us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:15.638465 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.638564 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:15.714789 (+ 76225us) raft_consensus.cc:1685] finished
0709 13:13:15.714819 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.714959 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":624321,"threads_started":1,"wal-append.queue_time_us":698914}
I20260709 13:13:15.720193 29259 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
W20260709 13:13:15.730885 28580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 2992) took 3403 ms (client timeout 1896 ms). Trace:
I20260709 13:13:15.731033 28573 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:15.687680  1688 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:15.732239 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 221811us
W20260709 13:13:15.731439 28580 rpcz_store.cc:269] 0709 13:13:12.327047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.560744 (+233697us) service_pool.cc:224] Handling call
0709 13:13:15.730625 (+3169881us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b54000ec4d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:15.730802 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159931648}
W20260709 13:13:15.734980 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 272477us
I20260709 13:13:15.749892 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:15.703291  1657 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:15.732152  1616 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.797040 28728 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:15.805145 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:15.805450 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.805966 28649 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.806464 28650 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:15.808152 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:15.809065 28647 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:15.812125 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:15.891969 28653 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:15.820665 29255 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.022s
W20260709 13:13:15.893150 29255 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.015s	sys 0.023s
I20260709 13:13:15.855199 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:15.867725 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.893337 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 303422us
W20260709 13:13:15.894436 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.894528 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:15.821138 28695 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.007s	sys 0.024s
I20260709 13:13:15.895160 28652 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:15.895448 28695 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.012s	sys 0.027s
I20260709 13:13:15.855257 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.896926 28655 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
W20260709 13:13:15.895800 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 656347us
I20260709 13:13:15.906522 28647 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:15.913841 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.914139 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:15.915007 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.918026 28650 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:15.855396 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.919330 28648 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:15.920753 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.921733 28649 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:15.924930  1464 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:15.925493  1464 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:15.925894  1464 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:15.804553  1496 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.929409 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.930089 28580 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:15.932494 28652 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:15.884704 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1854) took 1212 ms. Trace:
I20260709 13:13:15.934348 28622 leader_election.cc:400] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:15.934706 28622 leader_election.cc:403] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:13:15.935928 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:15.933945 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 162559us
I20260709 13:13:15.933815 29254 rpcz_store.cc:276] 0709 13:13:14.672424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.925203 (+252779us) service_pool.cc:224] Handling call
0709 13:13:14.976639 (+ 51436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.976962 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:15.642955 (+665993us) log.cc:844] Serialized 14 byte log entry
0709 13:13:15.884158 (+241203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:15.884244 (+    86us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:15.884329 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.884432 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.884614 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":735335,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":141,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":25412,"thread_start_us":906091,"threads_started":2}
I20260709 13:13:15.770792  1576 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.945894 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.946656 28652 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:15.946954 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.947598 28649 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:15.948159 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.948843 28650 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:15.781275  1688 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:15.940737  1605 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.944314 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:15.845288  1371 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:15.953558 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.952347  1688 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.954492 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1858) took 1123 ms. Trace:
I20260709 13:13:15.987802 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:15.989308 29255 rpcz_store.cc:276] 0709 13:13:14.831517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.254615 (+423098us) service_pool.cc:224] Handling call
0709 13:13:15.254914 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.255126 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:15.908638 (+653512us) log.cc:844] Serialized 14 byte log entry
0709 13:13:15.954088 (+ 45450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:15.954147 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:15.954203 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.954273 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.954431 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":457490,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":884,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":677429,"threads_started":2}
I20260709 13:13:15.969551 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.991343 28650 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:15.992308 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:15.992980 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:15.993664 29254 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:15.952344 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 251137us
W20260709 13:13:15.974017 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.975036  1700 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:15.976732  1666 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:15.977659 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.979250  1630 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:15.921986  1725 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.987073 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:16.018504 29258 raft_consensus.cc:2376] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13. Re-sending same reply.
I20260709 13:13:16.018597 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:16.003820 28653 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:16.021652 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:15.966921  1762 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:15.830680  1584 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:15.844313  1773 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:15.942664  1787 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:15.995751 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:15.982281  1432 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:16.022514 28656 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:16.024008 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.017669 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:15.994639  1688 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:16.031431 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:16.032456 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.993602 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:16.032459 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.035370 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2985) took 3730 ms. Trace:
I20260709 13:13:16.035949 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:15.994606  1752 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:15.994930  1753 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:16.042349 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:16.016821   909 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:16.040539 28580 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:16.039821 28575 rpcz_store.cc:276] 0709 13:13:12.304667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.308452 (+  3785us) service_pool.cc:224] Handling call
0709 13:13:12.308881 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.527848 (+218967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:12.527882 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:12.527931 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:12.527961 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.035029 (+3507068us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540031ef54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:16.035112 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.035292 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503100672}
I20260709 13:13:16.043238 28650 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:16.023707  1630 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:16.052345 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:16.053136 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.026202  1762 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.055534 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:16.061851 28650 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:16.017633  1797 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:16.063632 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:16.036191  1371 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:16.058871 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:16.069957 28652 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:13:16.038857  1699 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.013s	sys 0.006s
I20260709 13:13:16.068166 28649 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:16.056684 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:15.983788  1605 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:16.042469  1626 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:16.077761 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.079352 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.079906 28546 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:16.083272 28649 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:16.058339   909 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:16.066753  1762 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:16.077203  1699 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.014s	sys 0.006s
I20260709 13:13:16.120973 28581 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:16.102099 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.058079  1367 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:16.104995  1616 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:16.105825  1801 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:13:16.110536 28546 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:16.114778  1750 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:16.065304  1797 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:16.171191 28650 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:16.066306  1753 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:16.037634  1432 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:16.122462 28579 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
W20260709 13:13:16.125463  1798 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.218s	user 0.000s	sys 0.003s
W20260709 13:13:16.133898  1673 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.084s	user 0.012s	sys 0.002s
I20260709 13:13:16.134526 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:16.137784  1718 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:16.139019  1791 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:13:16.140410 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:16.141893 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:16.088563  1804 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:13:16.146014  1583 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.002s
I20260709 13:13:16.146538  1630 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.149554 28729 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:16.063450  1655 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:16.084205  1789 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:16.082911  1626 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:16.153781  1683 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.694s	user 0.012s	sys 0.000s
I20260709 13:13:16.155193 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2274) took 1768 ms. Trace:
W20260709 13:13:16.359987 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.127961 28724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 2280) took 1590 ms (client timeout 1793 ms). Trace:
I20260709 13:13:16.130735  1605 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:16.103174 29254 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:16.164579 28652 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
W20260709 13:13:16.227478 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 117016us
I20260709 13:13:16.226691 28655 raft_consensus.cc:2410] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:13:16.228349 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.634075 28579 raft_consensus.cc:2368] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:16.118103  1621 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:16.350878 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.356281 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 298502us
W20260709 13:13:16.635409 28725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2783) took 4402 ms (client timeout 1935 ms). Trace:
W20260709 13:13:16.635890 28725 rpcz_store.cc:269] 0709 13:13:12.233083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.233280 (+   197us) service_pool.cc:224] Handling call
0709 13:13:16.635155 (+4401875us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002d9954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:16.635301 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3174271232}
I20260709 13:13:16.636209 29224 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:16.637629 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:16.638454  1683 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:16.638552 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:16.638871  1683 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.639050 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.639245  1683 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:16.639333  1530 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:16.639818  1530 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:16.640163  1530 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:16.640195 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:16.641115  1687 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:16.641505  1687 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:16.641899  1687 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:16.642035  1171 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:16.642517  1171 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.642838  1171 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:16.642894 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2799) took 1566 ms. Trace:
W20260709 13:13:16.360939 28724 rpcz_store.cc:269] 0709 13:13:14.537722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.546206 (+  8484us) service_pool.cc:224] Handling call
0709 13:13:16.127685 (+1581479us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54000cf154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:16.127890 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716096896}
I20260709 13:13:16.236686  1459 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:16.358556 28723 rpcz_store.cc:276] 0709 13:13:14.386567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.386696 (+   129us) service_pool.cc:224] Handling call
0709 13:13:14.535774 (+149078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.536048 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:15.649225 (+1113177us) log.cc:844] Serialized 14 byte log entry
0709 13:13:15.892162 (+242937us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.154725 (+262563us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b1800479e00. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:13:16.154863 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.154904 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:16.154952 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.155024 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.155140 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378883,"prepare.queue_time_us":1122805,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":3361,"raft.queue_time_us":356561,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":67989,"spinlock_wait_cycles":20133120,"thread_start_us":1157634,"threads_started":2,"wal-append.queue_time_us":333520}
W20260709 13:13:16.442654 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.667099 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 155219us
W20260709 13:13:16.668519 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.669420 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.669665 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:16.669930  1548 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.670225 28726 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:16.670714 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.671277  1459 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:16.672207  1459 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:16.669260 28620 connection.cc:256] RPC call timeout handler was delayed by -1.5743903179998142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:13:16.677348 28620 connection.cc:256] RPC call timeout handler was delayed by -1.4480650760001481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:13:16.444041 28622 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:16.449858 28651 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:16.677650 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.678387 28726 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:16.679320 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:16.378515 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.681208 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.235970  1804 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.442219  1533 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:16.361341  1750 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.357969  1626 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:16.236083  1673 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:16.471772  1707 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.402s	user 0.032s	sys 0.032s
W20260709 13:13:16.512760  1808 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:13:16.353996  1583 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.608994 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2771) took 2978 ms. Trace:
I20260709 13:13:16.606364  1630 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:16.612649  1791 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:13:16.643301 28730 rpcz_store.cc:276] 0709 13:13:15.076214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.076352 (+   138us) service_pool.cc:224] Handling call
0709 13:13:15.076675 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.265616 (+188941us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:15.729991 (+464375us) log.cc:844] Serialized 14 byte log entry
0709 13:13:16.358208 (+628217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:16.358268 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:16.358320 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.642663 (+284343us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002814d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:16.642721 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.642841 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":428174,"prepare.queue_time_us":492165,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":337487,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":85357,"spinlock_wait_cycles":434022272,"thread_start_us":758373,"threads_started":2,"wal-append.queue_time_us":373484}
I20260709 13:13:16.647188 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:16.703346 28649 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:16.652027 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.670506  1548 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.226552  1797 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:16.686616 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.706327 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.687546 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.683218  1655 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:16.622802  1753 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.709475 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.710278 28728 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
W20260709 13:13:16.711800 28653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.062s	sys 0.133s
I20260709 13:13:16.665988  1609 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.696259 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.631922  1432 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:16.700021 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:16.699774 28574 rpcz_store.cc:276] 0709 13:13:13.630639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.505793 (+1875154us) service_pool.cc:224] Handling call
0709 13:13:15.506246 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:15.506765 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.506802 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:15.521585 (+ 14783us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.751707 (+230122us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:15.751836 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.752043 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.124759 (+372716us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:16.597098 (+472339us) raft_consensus.cc:1685] finished
0709 13:13:16.597127 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.608900 (+ 11773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29031168,"thread_start_us":205367,"threads_started":1,"wal-append.queue_time_us":356767}
I20260709 13:13:16.717471 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.688997  1804 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:16.677670 28620 connection.cc:256] RPC call timeout handler was delayed by -1.2604131509999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:13:16.712337 28653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.062s	sys 0.133s
W20260709 13:13:16.700522  1464 consensus_meta.cc:287] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
W20260709 13:13:16.720310 28620 connection.cc:256] RPC call timeout handler was delayed by -1.099940320000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 13:13:16.720726 28620 connection.cc:256] RPC call timeout handler was delayed by -1.074565075999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:13:16.721287 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:16.721501 28722 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:16.707093 28726 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
W20260709 13:13:16.697309  1707 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.634s	user 0.032s	sys 0.033s
I20260709 13:13:16.714823 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:16.688755  1533 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:16.700203  1688 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.002s
W20260709 13:13:16.712924  1703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.047s	sys 0.047s
I20260709 13:13:16.719031 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:16.720006  1540 consensus_meta.cc:287] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.015s	user 0.012s	sys 0.000s
I20260709 13:13:16.719574 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.735554 28574 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:16.736778 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.711545 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.738101 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.721604 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:16.723374 28620 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:16.726567 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:16.739595 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:16.733237 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.693486  1750 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.741465 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2796) took 1670 ms. Trace:
I20260709 13:13:16.741982 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:16.746577 28575 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:16.747926 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:16.748183 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.744195 28727 rpcz_store.cc:276] 0709 13:13:15.071274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.071439 (+   165us) service_pool.cc:224] Handling call
0709 13:13:15.077585 (+  6146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:15.078004 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.078035 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:15.078552 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.696834 (+618282us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:15.704870 (+  8036us) log.cc:844] Serialized 14 byte log entry
0709 13:13:15.705134 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.705214 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.138382 (+433168us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:16.730801 (+592419us) raft_consensus.cc:1685] finished
0709 13:13:16.741179 (+ 10378us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.741388 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10503,"prepare.queue_time_us":61573,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":62,"raft.queue_time_us":4582,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":202,"spinlock_wait_cycles":27865472,"thread_start_us":617819,"threads_started":1,"wal-append.queue_time_us":705121}
I20260709 13:13:16.749362 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.727274  1432 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:13:16.740281  1703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.048s	sys 0.048s
I20260709 13:13:16.725162  1696 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:16.752267 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.754875 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:16.768952 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:16.769884 28730 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:13:16.748906  1496 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:16.771752 28580 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 18: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:16.750540   909 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:16.748440  1655 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:16.718688  1609 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.784482  1609 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:16.753206  1578 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:16.776628 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:16.791343 28574 raft_consensus.cc:2376] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11. Re-sending same reply.
I20260709 13:13:16.734198  1688 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.779071   909 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.780974  1683 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.799733  1548 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:16.800288  1548 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.782032  1655 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:16.800721  1548 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.801712  1655 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:16.802855  1548 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:16.777396 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.805429 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.806139 28580 raft_consensus.cc:2368] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:16.806958 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.807991 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:16.808460 28580 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:16.728209  1464 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.810930  1464 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:16.792615 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.812016 28574 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:16.812969 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.813910 28574 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:16.814850 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:16.815083  1813 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:13:16.816181 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.773849  1696 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:16.799368   909 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:16.823418  1673 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:16.825416  1750 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:16.825647  1530 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.826210  1750 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:16.826818  1750 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:16.822176 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.791086  1578 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.836568 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:16.792438  1496 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:16.827839  1530 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:16.845937 28574 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:16.773905  1533 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.839944  1578 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:16.839574  1683 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:16.858454 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.860260 29223 connection.cc:256] RPC call timeout handler was delayed by -2.3327535809999063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:13:16.860705 29223 connection.cc:256] RPC call timeout handler was delayed by -2.2932072330002029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:13:16.861095 29223 connection.cc:256] RPC call timeout handler was delayed by -2.2706535810000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:13:16.861246 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 494001us
W20260709 13:13:16.862295 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 73638.7us
I20260709 13:13:16.867090 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:16.868076 29255 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:16.872534 28580 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:16.872498  1530 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:16.876435  1530 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:16.925117 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 166703us
I20260709 13:13:16.931983  1530 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:16.970981 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.972141 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:16.973682  1530 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:16.976867  1432 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:16.978340  1432 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.978168  1753 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:13:16.982259 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 54312.3us
I20260709 13:13:16.989248 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:16.992079 28621 leader_election.cc:400] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:16.823477  1171 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.817864  1696 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.014539 29224 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:17.015199  1459 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:17.020314  1818 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:13:17.114028  1459 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:16.827855  1750 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:17.028278 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 305003us
I20260709 13:13:17.116875  1459 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.117628 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:17.014464  1533 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.038367 29255 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:17.112087  1171 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.061638 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1614) took 1814 ms. Trace:
I20260709 13:13:17.068188 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 2997) took 4669 ms. Trace:
I20260709 13:13:17.069768 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:17.071919 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 3003) took 1048 ms. Trace:
I20260709 13:13:17.120903 28577 rpcz_store.cc:276] 0709 13:13:12.398817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.009393 (+2610576us) service_pool.cc:224] Handling call
0709 13:13:15.044108 (+ 34715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:15.855913 (+811805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.855945 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:15.894278 (+ 38333us) log.cc:844] Serialized 26 byte log entry
0709 13:13:15.963745 (+ 69467us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:15.963797 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.067628 (+1103831us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54000ee2d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:17.067702 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.067774 (+    72us) raft_consensus.cc:1685] finished
0709 13:13:17.067796 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.068108 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17352,"raft.queue_time_us":12665,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":17488,"spinlock_wait_cycles":1838460800,"thread_start_us":34309,"threads_started":1,"wal-append.queue_time_us":112138}
I20260709 13:13:17.122512 28581 rpcz_store.cc:276] 0709 13:13:16.023621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.023749 (+   128us) service_pool.cc:224] Handling call
0709 13:13:17.071657 (+1047908us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54001aa254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.071803 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198938368}
I20260709 13:13:17.072746 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.112737 28621 leader_election.cc:403] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:17.073884 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.079669  1772 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:17.127147  1772 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:17.129925  1772 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:17.085541 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2773) took 3454 ms. Trace:
I20260709 13:13:17.130707 28573 rpcz_store.cc:276] 0709 13:13:13.631294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.525061 (+1893767us) service_pool.cc:224] Handling call
0709 13:13:15.730793 (+205732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:15.735695 (+  4902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.085237 (+1349542us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54000ec4d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.085446 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471821696}
I20260709 13:13:17.086791  1616 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:17.089887  1771 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.026s	user 0.003s	sys 0.019s
W20260709 13:13:17.090915 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 221166us
W20260709 13:13:17.111469 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.120808 28722 rpcz_store.cc:276] 0709 13:13:15.247602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.697471 (+449869us) service_pool.cc:224] Handling call
0709 13:13:15.697805 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.727853 (+1030048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.061216 (+333363us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000343d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:17.061530 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353676672}
I20260709 13:13:17.050887  1701 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:17.132917  1771 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.072s	user 0.004s	sys 0.020s
I20260709 13:13:17.141849 29255 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:17.147154 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.155313 29254 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:17.020722  1582 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.156694 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:17.158687 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 296979us
W20260709 13:13:17.162392 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 148981us
I20260709 13:13:17.162886 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.163403 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:17.028214  1575 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.174723 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:17.179026 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.178761 29253 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
W20260709 13:13:17.173120 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55577.7us
I20260709 13:13:17.182925 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:17.183139 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.179549 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:17.183970 29253 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:17.191191 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.194164 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:17.195036 28573 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:17.195071 28581 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:17.170025  1762 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.020s	user 0.010s	sys 0.002s
I20260709 13:13:17.200359 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.200675 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.154282  1583 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.204316 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:17.205397 28573 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:13:17.206990 29253 raft_consensus.cc:2410] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:13:17.207890 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:17.208731 28579 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.210398 28574 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:17.212383 29255 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:13:17.172686  1825 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:17.171439  1171 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:17.219422 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:17.217458 29223 connection.cc:256] RPC call timeout handler was delayed by -1.7075320260000808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:13:17.217857 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:17.225821 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.222400  1703 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.177968  1823 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:17.020785  1496 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.239265 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:17.195972  1548 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:17.176010  1772 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:17.185947  1665 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:17.237798 28654 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 2547) took 3722 ms (client timeout 1690 ms). Trace:
I20260709 13:13:17.218771  1582 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
W20260709 13:13:17.248770 29223 connection.cc:256] RPC call timeout handler was delayed by -1.5761320260000957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:13:17.253073 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:17.254232 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 139747us
I20260709 13:13:17.227905  1432 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:17.221592  1616 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:17.219660  1825 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:17.238482  1750 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:17.223704  1171 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:17.202510  1551 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:13:17.238238  1833 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.187824  1575 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.259769  1824 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:17.271656 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.254114  1688 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.209128  1762 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.267166  1665 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:17.309834  1665 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:17.312119  1371 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.235s	user 0.008s	sys 0.004s
I20260709 13:13:17.271582 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:17.313966 29224 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:17.291462  1833 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.273132   909 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:17.319355  1833 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:17.320422   909 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.321408  1530 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:17.321898  1530 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.322281  1530 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.331907  1762 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.286010  1692 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:17.333809  1692 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.336225  1692 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:17.338810  1621 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.687s	user 0.006s	sys 0.007s
I20260709 13:13:17.339555 29260 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
W20260709 13:13:17.340989 29260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 1853) took 3811 ms (client timeout 1999 ms). Trace:
W20260709 13:13:17.341461 29260 rpcz_store.cc:269] 0709 13:13:13.530244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.530592 (+   348us) service_pool.cc:224] Handling call
0709 13:13:17.340784 (+3810192us) spinlock_profiling.cc:243] Waited 3.76 s on lock 0x7b540003edd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.340913 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8658940160}
I20260709 13:13:17.342717  1609 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.343343  1609 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:17.340889  1687 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.698s	user 0.004s	sys 0.007s
I20260709 13:13:17.347681  1687 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.288616  1830 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:17.358570  1830 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.312563  1371 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:17.304252  1821 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:13:17.289099  1171 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.259287  1703 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.361976  1830 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.303891  1836 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:17.289456  1616 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.362988  1836 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:17.363687  1836 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.364718  1616 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:17.307605  1575 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.317260  1814 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:17.320516  1833 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:17.288864  1750 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:17.366266  1750 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:17.367666  1626 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.002s
I20260709 13:13:17.368151  1626 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.308538  1825 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.370045  1825 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:17.353174  1797 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
W20260709 13:13:17.301920  1817 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:13:17.373272  1797 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:17.347062  1804 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.002s
I20260709 13:13:17.282397  1683 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:17.374642  1804 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:17.375501  1797 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.266129  1772 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.282014  1432 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:17.376336  1432 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.377631  1772 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.366281  1833 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:17.379289  1833 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.377667  1804 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.359885  1687 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:17.306365  1845 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:17.383809  1845 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.384207  1845 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.355794  1665 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:17.385975  1630 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.004s
I20260709 13:13:17.387080  1665 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.387485  1609 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.363102  1703 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:17.392172  1626 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:17.384359  1578 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:17.393721  1750 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:17.399317  1750 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.392554  1845 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.403613  1845 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.394249  1836 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.415520  1836 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:17.455669 28576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2772) took 3824 ms (client timeout 1607 ms). Trace:
I20260709 13:13:17.237848 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.458052 28578 raft_consensus.cc:2410] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:13:17.459939 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 221000us
W20260709 13:13:17.462774 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 470716us
W20260709 13:13:17.264655 28654 rpcz_store.cc:269] 0709 13:13:13.498123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.498906 (+   783us) service_pool.cc:224] Handling call
0709 13:13:17.220440 (+3721534us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540003fcd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.220563 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536532864}
I20260709 13:13:17.466178 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1236) took 1486 ms. Trace:
W20260709 13:13:17.474174 28575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 3004) took 1441 ms (client timeout 1621 ms). Trace:
I20260709 13:13:17.546830  1578 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:17.547253 28575 rpcz_store.cc:269] 0709 13:13:16.035046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.052831 (+ 17785us) service_pool.cc:224] Handling call
0709 13:13:17.473717 (+1420886us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400351bd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.473947 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592718080}
I20260709 13:13:17.270673 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:17.550201 28722 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:17.552364 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.476536 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.553686 28725 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.477675 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:17.557734 28724 raft_consensus.cc:2410] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:13:17.559033 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:17.560154 28724 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:17.271867 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:17.540606 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.562144 28730 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:17.546466 28653 rpcz_store.cc:276] 0709 13:13:15.979547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.107233 (+127686us) service_pool.cc:224] Handling call
0709 13:13:16.107697 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:16.108171 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:16.108205 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:16.108851 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:13:16.720514 (+611663us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:16.720573 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:16.720653 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:17.465367 (+744714us) raft_consensus.cc:1685] finished
0709 13:13:17.465426 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:17.465820 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3445,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":601166,"threads_started":1,"wal-append.queue_time_us":908837}
I20260709 13:13:17.562510 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.312541 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:17.314911 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:17.563337 28726 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:17.563191 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.454192 28474 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 13, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 13 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:17.492141 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:17.565217 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 250152us
I20260709 13:13:17.543552 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.566896 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.568449 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:17.488634  1533 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:17.374679  1530 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.562232  1606 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:13:17.565186 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 252573us
I20260709 13:13:17.568743 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:17.564550  1665 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:17.570360 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:17.575162 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.533010 28576 rpcz_store.cc:269] 0709 13:13:13.631034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.732118 (+101084us) service_pool.cc:224] Handling call
0709 13:13:17.455037 (+3722919us) spinlock_profiling.cc:243] Waited 87.3 ms on lock 0x7b540036db54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.455351 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200708864}
I20260709 13:13:17.570107 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.565582  1609 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:17.585079 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:17.586052 28728 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:17.583683  1533 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.590353  1533 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.572284  1703 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.575078  1829 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:13:17.591948 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:17.592170  1703 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.592792  1829 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:17.576362  1665 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:17.595232  1665 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:17.595309 28721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 1615) took 2342 ms (client timeout 1648 ms). Trace:
I20260709 13:13:17.595995  1703 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:17.595919 28721 rpcz_store.cc:269] 0709 13:13:15.252515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.274411 (+ 21896us) service_pool.cc:224] Handling call
0709 13:13:17.594910 (+2320499us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400280fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.595122 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355746688}
I20260709 13:13:17.591964  1530 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.593240  1829 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:17.605067 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:17.582494  1578 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:17.573705  1606 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:17.612826 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44865.8us
W20260709 13:13:17.617971 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 73114.9us
I20260709 13:13:17.620433 28727 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:13:17.621218 28724 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:17.621906 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1616) took 2368 ms. Trace:
I20260709 13:13:17.622511 28729 rpcz_store.cc:276] 0709 13:13:15.253093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.728506 (+475413us) service_pool.cc:224] Handling call
0709 13:13:16.149289 (+420783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:16.245991 (+ 96702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:17.621439 (+1375448us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54000cf150. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.621680 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966520064}
I20260709 13:13:17.620625  1836 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:17.624064  1836 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:17.624737  1836 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.628759 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:17.629400  1575 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:17.618021  1855 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:17.631310  1855 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.632661  1692 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:17.633216  1692 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.633416  1575 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:17.633616  1692 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:17.634217  1575 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:17.633224 28578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 3000) took 1613 ms (client timeout 1594 ms). Trace:
W20260709 13:13:17.637666 28578 rpcz_store.cc:269] 0709 13:13:16.020227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.020749 (+   522us) service_pool.cc:224] Handling call
0709 13:13:17.598521 (+1577772us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000ebad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:17.633135 (+ 34614us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3260777728}
I20260709 13:13:17.639505  1609 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:17.641640  1630 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:17.642103  1630 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:17.642957 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.643388 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:17.643777 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:17.643496  1630 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.644575 29254 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.644170 29255 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.636021  1575 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.633507 28730 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:17.644783 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.648648 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.653371  1703 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.653723  1582 raft_consensus.cc:2764] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:13:17.647297  1630 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.656463 28725 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:17.656749  1829 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.661618  1855 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.662829 28474 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 10 to 12, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 12 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:17.665405  1829 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:17.670217 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:17.655448  1703 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.672273 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.619549  1530 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:13:17.673079  1703 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:17.664817 28474 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 10 to 14, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 14 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.679571 28474 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.682027 28581 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
W20260709 13:13:17.685890 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 129000us
I20260709 13:13:17.685475  1772 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:13:17.691931  1771 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:17.692399  1771 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:17.692085  1432 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:17.693763  1771 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.694595 29223 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:13:17.695138 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 438639us
I20260709 13:13:17.695031  1833 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:17.713699 28622 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:17.714385 29255 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:17.697886 28726 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:17.714980  1851 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:17.702533  1855 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:17.715477  1851 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.715015  1833 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:17.702584 28579 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:17.720948 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.682054 28573 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:17.715930  1851 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.702742  1701 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:17.719756 29253 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:17.720105 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:17.720444 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:17.721333 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.738149 28621 leader_election.cc:400] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:17.741326 28621 leader_election.cc:403] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:17.696722 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:17.743391 29254 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
W20260709 13:13:17.744385 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.744710 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.745157 28580 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.745802 29251 raft_consensus.cc:2368] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
I20260709 13:13:17.746953 29260 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:17.747123 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:17.748063 29257 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:17.744737 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:17.750335 29258 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:17.724611  1575 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.750301 29259 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:17.743137  1771 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.740895  1701 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:17.756876 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62399.7us
W20260709 13:13:17.758458 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 61974.2us
I20260709 13:13:17.676007  1606 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.759163 28578 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:17.759896  1533 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.763459  1692 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.764312  1432 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.759632  1855 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:17.763345  1533 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.761620  1772 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:17.760579  1701 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:17.774127  1665 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.783522 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.784642 29253 raft_consensus.cc:2368] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:13:17.770875  1578 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:17.785790  1693 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:17.788411  1693 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:17.788085  1475 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:17.788952  1692 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.788990  1693 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:17.791392 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 119400us
I20260709 13:13:17.776456  1665 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.790271 29254 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:17.789590  1588 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:13:17.793608 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55732.1us
I20260709 13:13:17.771505  1772 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:17.795419 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.793030 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:17.794559 28474 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 8 to 10, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 10 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:17.796604 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.801771 28580 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:17.802613 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.793187  1588 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:17.804807  1693 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.805565  1588 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:17.806356  1693 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.796782  1606 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.799388  1772 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:17.809538 28578 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:17.812826  1533 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.810523  1665 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:17.815146  1569 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:17.818132 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49965.2us
I20260709 13:13:17.810523  1588 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.821452 28621 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.799165 28474 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:17.831094  1569 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:17.817860  1692 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:13:17.824990  1668 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:17.843252 29258 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:17.836725  1668 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:17.844444  1668 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:17.836548 28547 connection.cc:256] RPC call timeout handler was delayed by -1.9327905790000841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:13:17.846494 29255 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:17.848565 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:17.848189 29259 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:17.855316  1578 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:17.856400 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.857744 29253 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:17.859313 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.859862 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:17.861387 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 45992us
I20260709 13:13:17.855868  1578 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.862746 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:17.864506 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.866465 28573 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:13:17.864771 28478 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 379) took 51862 ms (client timeout 15000 ms). Trace:
I20260709 13:13:17.863646  1578 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.869263 28579 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:17.869347 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.870253 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:17.873662 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:17.831691 28474 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 9 to 11, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 11 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:17.878257  1851 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.878563 28474 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 12 to 14, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 14 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:17.880628  1851 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:17.881403  1855 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:17.885573 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.886009 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:17.886739 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.886896 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.887734 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:17.888612 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.889370 28580 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:13:17.867349 28478 rpcz_store.cc:269] 0709 13:12:25.942288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.942565 (+   277us) service_pool.cc:224] Handling call
0709 13:13:17.801470 (+51858905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:08.550260 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:08.551006 (+   746us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:08.551059 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:13:08.551094 (+    35us) tablet.cc:662] Decoding operations
0709 13:13:08.552137 (+  1043us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:08.552232 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:08.552263 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:13:08.592145 (+ 39882us) tablet.cc:701] Row locks acquired
0709 13:13:08.622576 (+ 30431us) write_op.cc:260] PREPARE: finished
0709 13:13:08.622805 (+   229us) write_op.cc:270] Start()
0709 13:13:08.622975 (+   170us) write_op.cc:276] Timestamp: P: 1783602788622735 usec, L: 0
0709 13:13:08.623029 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 13:13:08.670441 (+ 47412us) log.cc:844] Serialized 2830 byte log entry
0709 13:13:09.225309 (+554868us) op_driver.cc:464] REPLICATION: finished
0709 13:13:09.377389 (+152080us) write_op.cc:301] APPLY: starting
0709 13:13:09.462621 (+ 85232us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:09.683052 (+220431us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:09.742608 (+ 59556us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:09.755236 (+ 12628us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:09.755625 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:13:09.755717 (+    92us) write_op.cc:312] APPLY: finished
0709 13:13:09.756150 (+   433us) log.cc:844] Serialized 73 byte log entry
0709 13:13:09.801279 (+ 45129us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:09.807639 (+  6360us) write_op.cc:454] Released schema lock
0709 13:13:09.807754 (+   115us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:09.883895 (+ 76141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:09.889507 (+  5612us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4133590,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":123595,"apply.run_cpu_time_us":19382,"apply.run_wall_time_us":498731,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33373,"num_ops":7,"prepare.queue_time_us":214840,"prepare.run_cpu_time_us":16345,"prepare.run_wall_time_us":226751,"raft.queue_time_us":115951,"raft.run_cpu_time_us":51113,"raft.run_wall_time_us":120225,"replication_time_us":590571,"thread_start_us":345068,"threads_started":4,"wal-append.queue_time_us":90942,"wal-append.run_cpu_time_us":28088,"wal-append.run_wall_time_us":2046343}]]}
I20260709 13:13:17.895481 28651 raft_consensus.cc:2368] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:13:17.889348 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.904680 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:17.905827 28656 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:17.905367 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:17.906792 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:17.905606  1797 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.907426 28656 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:17.907831  1797 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:17.910552 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 56993.7us
I20260709 13:13:17.910904  1797 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:17.911134 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.905655 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.911509 28621 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.904944 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.904852 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.913081 28651 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:17.914723 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.914368 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.880352 28474 catalog_manager.cc:5697] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:13:17.924455 29223 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:17.929117  1665 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:17.934688 29253 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:17.935284 28655 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:17.927273 28654 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:17.871685  1475 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:13:17.948076 28653 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:17.948297 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.948613 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:17.946642 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 124404us
I20260709 13:13:17.949297 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.951073 28581 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:17.945798 28648 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
W20260709 13:13:17.954411 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.954416  1665 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:17.955006 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:17.925174 28474 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:17.957425 28474 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:17.962726 28650 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:17.949304 28647 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:17.964313 28656 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
W20260709 13:13:17.965325 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.966681 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.967602 28651 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:17.969475 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:17.972932  1496 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:17.974164 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49882.1us
I20260709 13:13:17.973691  1496 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.974539 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.975355 28649 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:17.973637  1753 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:17.977340 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:17.973704 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62301.7us
I20260709 13:13:17.978668 28578 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.979444 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.976763 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.921229  1171 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:17.985275 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:17.959651 28474 catalog_manager.cc:5697] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 5 to 14, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 14 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.981935 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:17.988584 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.989689 28647 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:17.976951  1762 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:17.994342 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.994834 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.997706 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.998322 28656 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:17.977231  1753 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:13:17.943254  1836 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:17.998997 29259 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:17.999277 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:17.999774 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.002986 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.004586 28648 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:18.005766 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.001586 28653 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:18.007054 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:18.007390 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.002799 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.010460 28649 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:18.012432 28579 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:17.994254  1762 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:18.016206  1762 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:18.012991  1836 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:18.022187 28652 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:18.022296 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:18.024858 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.025449 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.015530  1496 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:18.027822 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.032248  1693 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:18.041429 28653 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:18.042769 28653 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:18.044106 28653 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:13:18.046862 28653 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:13:18.057793  1630 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:18.065953 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.066346 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.066713 28726 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:18.067417 28721 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 11: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:18.068168 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.068413 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.038668  1693 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.069161 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.069412 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.070026 28722 raft_consensus.cc:2376] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11. Re-sending same reply.
I20260709 13:13:18.070128 28474 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 8 to 11, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 11 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.071192 28723 raft_consensus.cc:2368] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19.
I20260709 13:13:18.071089  1687 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:18.072325 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.072511  1687 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:18.073048  1687 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:18.073836 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.074512 28725 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:18.074030  1687 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.075346 28728 raft_consensus.cc:2410] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:18.075572  1687 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.078639 28656 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:18.079640 28578 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:18.081722 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.082197 28655 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:13:18.083474 28653 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:18.084141 28648 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:18.084582 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 150959us
I20260709 13:13:18.085942  1475 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:18.086169  1772 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.086920  1475 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:18.087323  1475 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.088531  1772 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:18.088646  1569 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:18.089125  1569 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:18.090178  1569 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:18.091833 28695 leader_election.cc:336] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.607s (SENT)
I20260709 13:13:18.092350 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:18.093400  1569 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:18.094873 28654 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:18.088395  1475 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:18.093457 28653 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:18.097645  1475 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:18.097762 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.099617  1692 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:18.100050 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.100795 28576 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:18.102240 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.103188 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.103825 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.104094 28721 raft_consensus.cc:2410] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:18.102429 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.105268  1753 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:18.105633 28576 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:13:18.106416 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.107599 28578 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:18.107877 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:18.105722  1753 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:18.108832  1753 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:18.104859 28728 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:18.117254 29224 leader_election.cc:400] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:13:18.117900 29224 leader_election.cc:403] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:13:18.121668 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.121892 28581 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:18.129904 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.133164 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.077245  1836 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:18.134982 29258 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:18.135133 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.135351  1851 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:18.135398 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.136262 29252 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.137045 29257 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:18.139374 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.139744 29256 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:18.140780 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:18.141407  1655 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:18.142163 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:18.142270 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:18.142436 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:18.143018 29251 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:18.143038 29258 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:18.143589 29256 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:18.140738 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.144237 29251 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:18.144702  1655 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.144865 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.145222 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.146420 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.146986 29259 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.147264 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.147065  1588 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:18.148631 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.134703 28725 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:18.152532  1588 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.157860  1588 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:18.158634 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.160609  1855 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:18.161320 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:18.161468 29256 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:18.162150 29260 raft_consensus.cc:2393] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:18.162221  1432 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:18.162657  1432 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:18.161489  1582 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:13:18.163954 28721 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.163736  1432 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.166790  1432 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:18.170410  1668 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.174088 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.174965 28728 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.175086 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.176049 28729 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:13:18.174635 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.177095 28723 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:18.177423 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.178054 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.178375 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.178834 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.179328  1496 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:18.179488 28730 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:18.181195 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.181108 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.182963 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.185616  1578 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:18.186461 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.186897 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.187557 29256 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:18.195909 29252 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:18.197608  1836 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:18.198258  1836 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.182956 29260 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:18.205780  1836 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:18.207625 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.208261  1753 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:18.188143 28650 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:18.188355  1171 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:18.189884 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:18.190387 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.226239 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.190907 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.227159 29259 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:18.193076 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.209643 28724 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:18.209978 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.211036 29251 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:18.213512 28474 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 11 to 12, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 12 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.214948 29258 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:18.229189 28622 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:18.227751 28576 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:18.230090 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.215019 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.230813 29257 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.216423  1575 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:18.187857  1578 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:18.113034  1701 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:18.219370 28728 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:18.245303 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:18.224454 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 178574us
I20260709 13:13:18.225451  1530 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12.
I20260709 13:13:18.225544 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:18.214534  1668 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:18.191927 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.227548 28730 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:18.249572 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.231626 29253 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:18.248808 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.232791 28721 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:18.226136 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.251349 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.252251 28622 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:18.252653 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.237939 29255 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:18.240366 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.246448 28579 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:18.254079 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:18.256208 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.257828 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.258044 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.258625 28724 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:18.258960 28722 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:18.261325 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:18.251493  1496 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:18.267235 28655 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:18.268746 28649 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:18.269131 28725 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:18.269397 28654 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:18.269974 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.271590 29256 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:18.271807 28654 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:18.233352  1582 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:13:18.273326 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.278023  1855 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:18.278710  1855 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:18.279202 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.279543  1582 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:18.280292 28651 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:18.279701  1855 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.280488 29257 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:18.283176 28649 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:18.283411 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51842.2us
I20260709 13:13:18.286397  1701 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:18.286509 29260 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:18.286805  1772 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:18.291072  1772 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.292099  1772 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.245308  1836 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:18.278795 28655 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:18.257056 28721 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:18.301254 28579 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:18.305606 29259 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:13:18.310161 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:18.293352  1772 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:18.321837 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:18.322947 28579 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:18.324952 28656 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:18.327394 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:18.330879 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 82172.1us
I20260709 13:13:18.342300 28721 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:13:18.345395 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50376.3us
I20260709 13:13:18.336511 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:18.335556 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:18.348106 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 138278us
I20260709 13:13:18.347935 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.349498 28656 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:18.336971  1753 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:18.353407 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.354094 28580 raft_consensus.cc:2368] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:18.355424 28474 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 8 to 13, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 13 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:13:18.357295 28474 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 9 to 11, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 11 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:18.330945  1771 raft_consensus.cc:2764] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:13:18.245554  1693 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:18.335491  1569 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:18.352516 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.335633  1630 raft_consensus.cc:2764] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:13:18.342013  1836 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:18.371578 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.326231  1762 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.362864  1655 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:18.382598 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.358938 28474 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:13:18.383551 29223 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.372996 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:18.385804 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.387229 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.391754 28648 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:18.371249  1575 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:18.371333  1668 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:18.385310  1665 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:18.396425  1578 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:18.397450 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.398247 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.399633  1856 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:13:18.400393 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 89594.4us
I20260709 13:13:18.401808 29260 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:18.405210 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:18.415266 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.434692 28653 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:18.415652 28649 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:18.415921 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:18.435456 28656 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:18.416994 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.417367 29223 leader_election.cc:400] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19.
I20260709 13:13:18.354362  1858 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:13:18.421487  1851 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:18.388718  1771 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.422369 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.452508 28650 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:18.421554 28474 catalog_manager.cc:5697] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 7, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 7 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:13:18.387061  1588 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.394395  1829 raft_consensus.cc:2764] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:13:18.394521  1575 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.394820  1530 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:18.437467 29223 leader_election.cc:403] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:13:18.441920 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.422156 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:18.456775 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.447307 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.446283 28578 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:18.432998 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.427556  1762 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:18.453729 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.454770 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.458873 28655 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:18.459136 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.458158 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.463637 28649 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:18.414124  1665 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:18.459969 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 211397us
I20260709 13:13:18.453785  1655 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:18.403995  1836 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.466952 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:18.468354 28726 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:18.471525  1496 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:18.493220 28474 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 8, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 8 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:18.495303  1533 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:18.495759  1533 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:18.496481  1533 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:18.462539 28654 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:18.457587  1575 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:18.471227  1687 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:18.498075  1687 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.498546  1687 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:18.501595 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 84403.9us
I20260709 13:13:18.461091 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:18.471772 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 66660.9us
I20260709 13:13:18.459084  1771 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:18.483047 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 52460.2us
I20260709 13:13:18.462133  1630 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19.
I20260709 13:13:18.460178  1856 consensus_queue.cc:1243] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:18.471401 28695 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:18.513643 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:18.496058  1693 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:18.517531  1872 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:18.518990  1771 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:18.468432  1655 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.521663 28651 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:18.502724 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:18.506132 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 45942.5us
I20260709 13:13:18.511515 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:18.524984 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 70968.6us
I20260709 13:13:18.525481 28547 leader_election.cc:400] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
I20260709 13:13:18.523690 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.526911 28547 leader_election.cc:403] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:18.495663 28474 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 9 to 10, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 10 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:18.528977 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.532287 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.533602  1857 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:13:18.534515 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.534873  1588 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:18.517329  1692 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:18.557559  1692 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:18.557318  1665 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.558414  1665 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:18.561033 29258 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
W20260709 13:13:18.545403 28546 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.606s (SENT) [suppressed 48 similar messages]
I20260709 13:13:18.546321  1171 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:18.547250  1857 raft_consensus.cc:3055] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:18.565222  1171 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.565400  1857 raft_consensus.cc:740] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.565762  1171 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:18.547750  1609 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:18.526706  1858 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:18.566916  1858 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.567003  1609 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:18.567889  1858 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.548754  1833 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:18.550012 29224 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.542102  1496 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:18.586349  1496 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.589463 28474 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 6 to 10, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 10 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.584321  1855 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:13:18.590756 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:18.591344 29254 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:18.537184  1829 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:18.591403 28474 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:18.570459  1872 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:18.540948  1475 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:18.552316 28723 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:13:18.568037  1609 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.549525  1753 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:13:18.571870 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 64721.8us
I20260709 13:13:18.540488  1856 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:18.592887  1872 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.526446  1655 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.553975  1588 consensus_queue.cc:1059] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:18.595604 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:18.603165 29258 raft_consensus.cc:2410] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:13:18.569353  1858 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.548487  1575 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:18.611290 28726 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:18.584539  1668 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:18.597263  1753 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:18.623896 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.627280 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.629434 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 79494us
W20260709 13:13:18.634907 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 83779us
I20260709 13:13:18.626102  1630 raft_consensus.cc:2804] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:18.623508  1668 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.625955  1829 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:13:18.638484 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 171625us
I20260709 13:13:18.631079  1475 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.640738 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.656317  1857 consensus_queue.cc:260] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.656162  1475 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.621798  1171 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:18.662045 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 65203.1us
W20260709 13:13:18.663101 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.673379 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:18.676860 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:18.676095 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 72362.2us
W20260709 13:13:18.680778 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 43575us
I20260709 13:13:18.681761 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:18.652398  1829 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:18.663208  1630 raft_consensus.cc:697] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:18.696375 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 131485us
I20260709 13:13:18.635198  1687 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.697386 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:18.697975 29254 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:18.697227  1856 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.661347  1753 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.641435  1880 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
I20260709 13:13:18.680373  1872 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.702706  1668 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.645210  1833 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:13:18.640990  1533 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:18.708317 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46013.5us
I20260709 13:13:18.702431  1857 raft_consensus.cc:3060] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:18.713328  1880 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:18.713078  1630 consensus_queue.cc:237] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.713856  1878 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:13:18.715224 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.742746 28727 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:18.592989 28474 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 8 to 10, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 10 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:13:18.702531  1873 log.cc:927] Time spent T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:18.702455  1530 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:18.712728  1881 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:18.764072 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 133240us
I20260709 13:13:18.717589  1496 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:18.769904 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 57994.7us
I20260709 13:13:18.771087 28695 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:18.771472 28695 leader_election.cc:403] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:13:18.767194 28696 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.737824  1753 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.726063  1575 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:18.777523  1668 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:18.777678 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62512.5us
I20260709 13:13:18.761715  1880 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:18.774096  1829 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.786734 28474 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 9 to 11, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 11 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.765740  1530 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.778345 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:18.802258  1886 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:18.794670  1881 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:18.802829  1687 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:18.803304  1881 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:18.804265  1881 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.782825  1171 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:18.802634 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.732496  1655 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:18.777707  1879 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:13:18.806267  1530 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:18.845328 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 60178.1us
W20260709 13:13:18.845932 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 45120.8us
I20260709 13:13:18.784261  1665 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:18.845947 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:18.849835 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.800372  1880 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:18.856587 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.846535  1886 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:18.859382  1829 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.842628  1496 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:18.873400 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.875567 28647 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:18.869799 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.878777 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:18.880087  1890 raft_consensus.cc:2764] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:13:18.880180  1877 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:13:18.881714  1886 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:18.882666 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:18.883416 28656 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:18.870479 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 207522us
I20260709 13:13:18.885761 28547 leader_election.cc:400] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:13:18.886168 28547 leader_election.cc:403] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:18.889801 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:18.882740  1886 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.870383  1606 raft_consensus.cc:2764] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:13:18.914332 29260 raft_consensus.cc:1240] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:18.850728  1856 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.926867  1630 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:18.870358  1884 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:13:18.928807  1496 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:18.870203  1883 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:18.933244  1892 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
W20260709 13:13:18.933408 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63666.2us
W20260709 13:13:18.934007 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.979148 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:18.933907 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:18.936430  1893 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:18.936712  1762 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:18.937748  1533 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:18.988224  1753 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:18.965404 28656 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
W20260709 13:13:18.966496 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 190324us
W20260709 13:13:18.967636 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 82118.3us
W20260709 13:13:18.994046 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 110121us
I20260709 13:13:19.001124 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:19.003950 28724 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:13:19.005168 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:19.005820 28725 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:19.009284 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.003407  1533 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:13:19.017339  1896 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:18.995497  1665 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:19.011744 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.020905 28725 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:19.011696 28647 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:18.995476  1762 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:19.002084  1892 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:19.023622 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:19.024561 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:19.029069 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:18.992642  1753 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.009303  1606 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:19.034832 28725 raft_consensus.cc:2368] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:19.033293 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:19.036216 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 102433us
I20260709 13:13:19.022325  1883 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.044713 28727 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:19.034512  1886 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:19.051594 29224 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.039429  1606 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.039077  1655 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:19.061113 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.048102  1569 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:19.073763  1569 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:19.074908  1569 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:19.075659  1894 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:13:19.076773  1894 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:19.052256  1855 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:13:19.055444  1606 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:19.064071  1886 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:19.070206  1665 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:19.101675 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:19.086159  1655 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:19.102742  1655 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:19.103699 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:19.103534  1655 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.105803 29254 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:19.107220 29259 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:13:19.109854 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 85775.4us
I20260709 13:13:19.110432 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:19.113305 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.115674 28620 leader_election.cc:400] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:19.115986 28620 leader_election.cc:403] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:13:19.116796  1892 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:19.104846  1655 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:19.135104  1530 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.114518  1665 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:19.137948  1665 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.125980  1886 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.127744  1753 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.128134 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:19.152104 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:19.130618  1905 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:19.131259  1888 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:19.132102  1907 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:19.133162  1874 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:19.118073  1771 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:19.136447  1875 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:19.048835  1883 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.146685 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.162163 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:19.172708 28725 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:19.145736  1851 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:19.140107  1582 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:13:19.179948 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 133263us
I20260709 13:13:19.192008 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:19.159238  1905 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:19.197844 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 69774.5us
I20260709 13:13:19.198853 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:19.093936  1762 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.151670  1432 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:13:19.190346  1833 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:19.185868  1875 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:19.151136  1855 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:13:19.203106 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56513.4us
I20260709 13:13:19.191256  1874 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:19.203959  1533 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:19.240482 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:19.246580 29254 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:19.207474  1496 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:19.245368 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:19.246974 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.248111 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:19.250470 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 71860.6us
I20260709 13:13:19.253376 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:19.210036  1896 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:19.259603 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:19.255844 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67963.8us
I20260709 13:13:19.256582 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:19.258363 29260 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:19.266885 29254 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
W20260709 13:13:19.266983 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 121528us
I20260709 13:13:19.270044 28656 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:19.254070  1913 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:19.271996  1910 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:19.272596  1910 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:19.273160  1910 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:19.272078  1875 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.274817  1875 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:19.278142  1630 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:19.245711  1892 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.279052  1905 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:19.280946  1905 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:19.280838  1874 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:19.269058 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:19.286054 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:19.287962 28725 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:19.286257 29224 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.294471  1877 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:19.295084  1877 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:19.295495  1496 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:19.305703 28725 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:19.256702  1833 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:19.256448  1533 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:19.304067 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:19.319463 29260 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:19.284909  1530 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:19.322312 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:19.323763 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:19.327978  1833 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.297362  1851 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:19.334666 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.301460  1888 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:19.296132  1877 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:19.245426  1899 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:13:19.286767  1883 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.329550 28580 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:19.337877 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:19.333385  1889 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:19.339550 28722 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:13:19.339838 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.342159 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:19.344928 28576 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:19.344949 28651 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:19.288326  1606 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.348107 28581 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:19.348837 28721 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:13:19.351382  1910 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.386219  1533 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.389897  1877 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:19.392278  1889 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.386312 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:19.394101 28648 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:19.394593  1888 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:19.395700  1888 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:19.397132  1904 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.109s	user 0.003s	sys 0.000s
I20260709 13:13:19.337657  1851 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:19.416261 28651 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:19.419333  1171 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:19.419140 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:19.343997  1829 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:19.419137 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 172253us
I20260709 13:13:19.428117 28576 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:19.431411 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.432225  1630 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:19.432791  1630 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:19.435742  1171 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:19.437328 28573 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:19.418452  1851 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:19.435765 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:19.440805 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:19.441390 28648 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:19.443521 28647 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:19.420943  1910 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.446976 28652 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:13:19.402140  1880 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.429370  1896 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:19.449470 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:19.456012 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:19.471683 28651 raft_consensus.cc:2376] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16. Re-sending same reply.
I20260709 13:13:19.471722 28650 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:19.469636 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:19.476464 28578 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:19.445427  1609 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:13:19.477761 28573 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:19.472950  1924 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.480729 28647 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:19.442131  1907 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:13:19.479945  1829 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:19.492607 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:19.497354 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61651.6us
I20260709 13:13:19.495951  1927 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:19.496722  1911 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:19.497105  1909 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:13:19.510538 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.520038  1930 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.521370 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.524701 28651 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:19.526954  1920 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.527482  1920 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.520871  1930 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.532779 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:19.540954 28651 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:13:19.546746 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:19.510241  1927 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:19.549662 28696 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:19.485536  1924 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:19.512233  1889 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:19.554606 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.561376 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:19.563122 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.564589 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:19.534889  1896 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:19.554947  1606 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:19.561599  1883 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:19.573899  1912 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
W20260709 13:13:19.574347  1925 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:13:19.574245  1929 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:13:19.548804  1609 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:13:19.576434 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.577617 29254 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:19.567059  1889 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:19.577111  1919 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:13:19.584889 28650 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:19.568482  1829 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.575479  1883 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.602586 28651 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:19.605647 28581 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:19.592587  1856 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.609301  1927 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.606580  1836 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:13:19.609858  1856 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:19.611204 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.606868  1883 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:19.601405  1880 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.611946  1856 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:19.614627  1930 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:19.617862 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:19.618582 28729 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:19.619678  1931 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:19.620098  1931 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:19.604126  1475 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.620890  1475 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:19.623164  1475 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:19.601253  1889 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.626380  1889 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:19.627398 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:19.629722  1931 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.633292 28651 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:19.638424  1913 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:19.639284 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:19.642983  1889 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.643703  1889 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.639899 28652 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:19.647666 28655 raft_consensus.cc:1275] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:13:19.649755 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.655371 29257 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:19.594751  1881 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:13:19.645051  1857 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.606868  1905 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:13:19.654942  1475 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.665398 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:19.681723 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.684902 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.658368  1888 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:13:19.720762 28729 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:19.673317  1857 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:19.722131 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 73642.5us
I20260709 13:13:19.676931  1475 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:19.730074 28579 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:19.718619  1888 consensus_queue.cc:1243] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:13:19.736732  1942 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:13:19.738425  1857 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.742784  1851 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.743801 28654 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:19.744050 28579 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:13:19.745801  1889 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:19.748283  1883 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.754112  1872 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:19.757879 28576 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:19.739982  1475 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:19.741506 28729 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:19.758025  1883 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.721946  1913 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.762851 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:19.738627 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:19.776268 29257 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:19.777464 28729 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:19.780128 28581 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:19.781338 28580 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:19.774824  1829 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.783766  1905 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:19.805292 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:19.793375 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:19.805716 28729 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:19.806216 29258 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:19.806639 29257 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:19.807772 28696 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:19.812991 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:19.816970  1475 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:19.806417  1883 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:13:19.796149  1829 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.843888 29258 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:19.846731 28696 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:19.847620 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 178786us
I20260709 13:13:19.848863  1856 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:19.834676  1475 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.852861 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:19.854123 28727 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:19.850375  1475 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:19.857682 28726 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:19.858379  1829 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:19.867635 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.868042 28580 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:19.870244  1851 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.875409 28579 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:19.881752 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.889148 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.886986 29258 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:13:19.891116 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:19.892472 28649 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:19.893731 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:19.852150  1856 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:19.894793 28547 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.893734 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:19.894445 28575 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:19.889683 28580 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:19.898883 28580 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:19.899588 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:19.901206  1926 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:19.888602  1872 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.901448 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:19.901942  1872 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.903028  1496 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:19.903713 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:19.904135  1872 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.904433 28723 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:19.905231 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:19.906941  1907 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:19.901705 29256 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:19.908489 29223 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:19.918107  1883 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:19.918869  1856 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.919798  1578 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.920349  1578 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.920750  1569 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.921191  1926 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:19.921257  1569 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:19.923619 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.899654 28580 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.915268 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:19.938321 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:19.895912  1880 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:19.972126 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 55236.6us
I20260709 13:13:19.972812 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:19.977766 29255 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:13:19.973151 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 48730.5us
I20260709 13:13:19.951347 28580 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:19.976027 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.912387  1851 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:19.978554  1171 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.013s	sys 0.011s
I20260709 13:13:19.980991 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:19.982008  1171 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.013s	sys 0.011s
I20260709 13:13:19.983413  1171 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:19.983676 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:19.929055  1899 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.928823  1665 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:19.986951 28722 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:13:19.989827 28722 pending_rounds.cc:85] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 9
I20260709 13:13:19.990301 28722 pending_rounds.cc:107] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:13:19.994774 28722 raft_consensus.cc:2889] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.994582  1899 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.979067  1907 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:13:19.986529  1851 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.001823  1851 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.994194  1496 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:19.989660 28696 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:20.004545  1899 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:19.992400  1894 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:13:20.011005 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 95855.5us
I20260709 13:13:19.980675  1606 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:20.015400 28580 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:20.015846 28649 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:19.992197  1171 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.929456  1889 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:13:19.981319  1578 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.017510  1857 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:19.986685  1883 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:19.986370  1944 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.028574 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:20.031306 28577 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:20.017726  1905 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 13:13:20.035274  1953 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:20.017059  1665 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:20.036619  1665 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:19.949717  1950 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:13:20.017969  1606 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.040114  1606 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:20.041770  1926 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:19.923092 28578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788a727f92304a5a9926b2f15933af88"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:20.045544 28578 raft_consensus.cc:606] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:20.046518 29256 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:20.022926  1857 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.049072 28580 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:20.045223  1496 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:20.051302 28580 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:20.051393  1496 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:20.055263 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.015568  1829 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:13:20.056010 28575 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:20.056993  1927 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.058138 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.059566 28580 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:20.075047 28727 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:13:20.052259  1857 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:20.079217 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 98698.6us
I20260709 13:13:20.078765  1927 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.084738 28578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:20.085357 28578 raft_consensus.cc:606] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:20.085676 28578 raft_consensus.cc:614] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:20.087345  1878 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:20.087759  1878 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:20.030437  1877 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:13:20.058758  1883 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.062253  1829 consensus_queue.cc:1243] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:13:20.094455 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 56862us
I20260709 13:13:20.031881  1944 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.106626 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:20.110908 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:20.112023 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 83513us
I20260709 13:13:20.112847 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:20.092049  1920 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:20.108079 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 68671.5us
W20260709 13:13:20.115541 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.088618  1878 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.082739  1905 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:13:20.107761  1836 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.122586 29254 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:13:20.116863 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:20.118220  1530 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:20.114840  1569 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:20.147527 28621 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:20.108026  1889 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:13:20.151929 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:20.150643  1920 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:20.120747  1851 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:13:20.146908  1530 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.154054  1578 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:20.118316  1496 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:20.171531  1630 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.175952  1630 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:20.177129  1475 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.178323 28722 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:20.172000  1896 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.146131  1836 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:20.189910 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.192014  1496 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:20.160993  1878 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:20.203158  1880 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:20.203704  1880 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:20.205641 28721 pending_rounds.cc:85] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 9
I20260709 13:13:20.206024 28721 pending_rounds.cc:107] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:13:20.206274 28721 raft_consensus.cc:2889] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:20.208031  1931 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:20.210182 28727 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:13:20.188985  1896 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.218320 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:20.221366 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:20.223004 29260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:13:20.225023  1896 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.226404  1944 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.229048  1927 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:20.229640  1609 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:20.231184  1929 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:20.238085  1924 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:20.168144  1530 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:20.256351 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:20.257128 28727 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
W20260709 13:13:20.262621  1964 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
W20260709 13:13:20.270749 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 123299us
I20260709 13:13:20.272817 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:20.279116 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:20.279501 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.280431 29257 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:20.281904 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:20.281412 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:20.286932 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:20.276923  1851 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:20.269562  1960 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:20.324231 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 172367us
I20260709 13:13:20.325062 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:20.325151 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.325301 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.326218 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2839) took 1154 ms. Trace:
I20260709 13:13:20.204610  1880 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.276839  1883 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:20.326164 29254 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:20.326808 28724 rpcz_store.cc:276] 0709 13:13:19.171923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.181193 (+  9270us) service_pool.cc:224] Handling call
0709 13:13:19.181642 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:19.199925 (+ 18283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.199973 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:19.237809 (+ 37836us) log.cc:844] Serialized 52 byte log entry
0709 13:13:19.337419 (+ 99610us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:19.343795 (+  6376us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.347329 (+  3534us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.386548 (+ 39219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.292739 (+906191us) spinlock_profiling.cc:243] Waited 9.92 ms on lock 0x7b54001b9c54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:20.292808 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.325967 (+ 33159us) raft_consensus.cc:1685] finished
0709 13:13:20.325993 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.326139 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39677,"prepare.queue_time_us":86660,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":12832,"raft.queue_time_us":42570,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":44272,"spinlock_wait_cycles":22822784,"thread_start_us":58522,"threads_started":1,"wal-append.queue_time_us":168311}
I20260709 13:13:20.284663  1856 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.333632 29258 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:20.342985 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.344677 29253 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:20.292260  1929 consensus_queue.cc:1048] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:13:20.269418  1606 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.329772  1833 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:20.284071  1578 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:13:20.284480  1920 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:13:20.284930  1916 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:13:20.284303  1857 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.339454  1889 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:20.346588  1944 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:20.351492  1833 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:20.395754 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.363037  1851 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.366227  1880 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:20.353565  1971 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:20.366245  1889 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.406592 28722 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:20.351656  1890 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:13:20.365765  1533 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:20.408308 29251 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:13:20.412775 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:20.346920  1970 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:13:20.379220  1924 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.415120  1896 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.384601  1833 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:20.437477 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.422705 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.416236  1569 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:20.452307 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.426532  1889 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:20.431381 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 106409us
I20260709 13:13:20.439260 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.427497  1475 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.449240 29258 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:20.438648 28575 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:20.468066 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:20.411582 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:20.477607 28722 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:20.479290 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.479935 28573 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:20.480224 28651 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:20.481194 28650 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:20.481398 28649 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:20.422968  1851 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.487859  1851 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.436079  1924 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:20.520937 28650 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:20.493937 28656 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:20.524080 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:20.451618  1569 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:20.527908 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 116459us
W20260709 13:13:20.528671 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 60725.5us
I20260709 13:13:20.565714  1888 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.566283  1888 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:20.566793  1972 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:13:20.567126  1974 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:13:20.563158  1916 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:20.568617  1916 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.569067  1888 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.569164  1916 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:20.569808  1578 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.570343  1578 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:20.572594  1578 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:20.566506  1963 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:13:20.579008 28580 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:20.582119  1966 log.cc:927] Time spent T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.385s	user 0.001s	sys 0.001s
I20260709 13:13:20.584921  1836 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.531419  1971 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:20.586297  1971 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:20.590914 28695 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:20.593560  1569 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:20.565419 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.595044  1569 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:20.595685 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:20.595955 29259 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:20.596279 28576 raft_consensus.cc:2376] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13. Re-sending same reply.
I20260709 13:13:20.598304 29259 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:20.600360  1899 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:20.435242  1533 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:20.604789 28695 leader_election.cc:400] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:20.489902  1857 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.531800  1875 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:20.615271 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:20.625379 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.451606  1896 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.627928 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.636451 28695 leader_election.cc:403] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:20.525748  1475 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:20.603199 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.562873  1910 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:13:20.637882 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:20.600963  1899 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:20.647482 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:20.639810 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:20.653208 28580 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:13:20.653640 28575 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:20.653821 28580 pending_rounds.cc:85] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 6
I20260709 13:13:20.654556 28580 pending_rounds.cc:107] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:13:20.655828 28580 raft_consensus.cc:2889] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:20.642318  1910 consensus_queue.cc:1243] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:20.659296 28581 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:13:20.659271 28656 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:20.663101 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:20.652225  1981 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:20.631032  1963 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:13:20.630785  1877 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:13:20.665513 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:20.666992 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62330.6us
I20260709 13:13:20.649967  1857 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:20.650345  1836 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.673295  1899 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:20.674175  1933 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:13:20.674546  1980 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:20.675559  1975 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 13:13:20.676367  1892 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:13:20.677887 28723 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:20.678012 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:20.643121  1606 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:20.679178  1872 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.684151  1981 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.680478 28725 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:20.681682  1896 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.691004 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:20.640214  1878 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:13:20.656456  1578 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:20.640415  1875 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.706017 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:20.723155 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.724022 28581 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:20.718065 28576 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:20.706378 28621 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:20.680006 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:20.760890 28726 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
W20260709 13:13:20.768550 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62288.8us
I20260709 13:13:20.769433 28621 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:20.739027  1836 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.766024  1578 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.773886  1578 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:20.705509  1833 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.776679  1833 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:20.706043  1530 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.784951 28580 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:20.710830  1533 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:20.672708  1916 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.706075  1432 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:13:20.794639 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 88699.5us
I20260709 13:13:20.810459 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:20.727505  1924 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:20.774048  1836 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.797412 29260 raft_consensus.cc:606] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:20.703311  1762 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:20.802378  1985 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:13:20.759802  1980 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:20.811865 28725 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:20.691802  1990 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:20.766755  1899 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:20.762626  1981 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:20.764000  1889 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.797796  1920 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:20.816545 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 47200.2us
I20260709 13:13:20.766108  1872 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:20.799198  1857 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:20.825726 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:20.814649 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 121841us
W20260709 13:13:20.850659 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.851125  2002 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:20.852707 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:20.829291  1762 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.853397 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:20.830467 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.816357  1999 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:20.856421  1999 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:20.855557 29257 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:20.860634 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:20.863087 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:20.864705 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:20.841183  1575 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:20.837909  1990 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:20.914870 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 65572.1us
W20260709 13:13:20.916460 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.919150 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:20.921244  1913 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:20.925230  1894 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:20.927019  1894 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:20.927526  1894 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.927982  1894 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:20.924660  1913 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:13:20.936787  1963 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:20.937427  1963 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:20.938512  1963 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.939891  1963 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:20.944895 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:20.945326 28576 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:20.848306  1920 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.961289 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:20.857661  1999 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:20.964931 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 139281us
I20260709 13:13:20.965516 28728 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:20.846024  1971 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:20.845256  1836 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:20.965866 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.963517 29254 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:20.973568  1967 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.791s	user 0.007s	sys 0.007s
I20260709 13:13:20.968189  1965 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:20.975517  1996 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:13:20.872335  1982 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.977370  1982 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.977752  1954 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:20.978840  1980 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.979760  1982 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:20.980304  1982 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:20.967935  1920 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:20.981843  1530 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:20.987835  1929 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.988621  1965 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:20.988417  1929 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:20.990253 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.911089  1851 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:21.000102  1171 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:21.000550  1171 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:20.957464  1990 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:21.001750 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:21.000241 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:21.005645 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:21.004019 29253 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:21.004781 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:21.009737 28576 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:21.010789 29257 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:21.002210  1533 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:20.964434  2003 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:21.014058 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 534942us
I20260709 13:13:21.008960 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:21.069916 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:21.070142 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:21.070679 28725 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:21.001399  1970 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.049678 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:21.051306 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:20.992832  1971 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.072359 29257 raft_consensus.cc:2410] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:13:21.072157 29253 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:20.970064  1913 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:13:20.998589  1836 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.016137  1171 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.017508  1762 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.075404 28721 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:20.993606  1982 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:21.083031  1894 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.086719  1872 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:21.040635  1833 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:21.009948  1926 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 13:13:21.089429 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 80579.6us
I20260709 13:13:21.040169  1665 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:21.137120 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.137274 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:21.136932  1665 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.138012 28655 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:21.138666  2002 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.139176  2002 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.099670 28576 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:21.141212  2002 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.006669  1851 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.143895  1851 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:21.075703  1880 consensus_meta.cc:287] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.004s
I20260709 13:13:21.087785  1916 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.144826  1931 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:21.037781  1530 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:13:21.076833  1970 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.122552  1171 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.071453  2003 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.130793  1920 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.077239  1965 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:13:21.143666  1578 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.145720 28649 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:21.119187 29253 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:21.147688 28725 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
W20260709 13:13:21.158506 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 187073us
I20260709 13:13:21.139688  1665 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.100867  1569 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:21.171537 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:21.162559  1875 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.159292  1889 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.255478  1916 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.256331  1916 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.260968  1916 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.261547  1929 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:21.158308  1931 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.265082  1982 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.266378  1982 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:21.267000  1971 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.265653  1931 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:21.174202  1569 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.149178  1833 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.270117  1875 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.275352  1569 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:21.278657  1872 raft_consensus.cc:2764] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:13:21.298923 29224 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:21.304440 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.309347 29253 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 13:13:21.316558 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.319968 28696 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:21.326527 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:21.327380 28725 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:21.406783 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:21.408775 28725 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:21.410707 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:21.414201 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 64153.7us
I20260709 13:13:21.421469 29255 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:21.429749 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:21.319324  1606 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:21.296598  1875 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.350265  1931 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:21.435303  1970 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.452180  1171 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:21.454376  1171 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:21.390923  2012 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:21.459825 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.419282  1930 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.413223  1965 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:21.419061  1872 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:21.440675  1999 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:21.481885 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.489205 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:21.485735 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:21.468196  2008 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:21.511276 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62136.7us
I20260709 13:13:21.460088  1665 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:21.466739  1894 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.468221  2012 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:21.518621 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 347155us
I20260709 13:13:21.484526  1910 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.479907  1920 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:21.515448  1981 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.002s
W20260709 13:13:21.529834 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.461282  1931 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:21.533727  2015 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:13:21.534601  2014 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:13:21.505811  2007 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:21.546795  2017 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:21.548599 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:21.553385 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 123976us
I20260709 13:13:21.554126  1886 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:21.556588  1833 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:21.560653  1475 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.924s	user 0.010s	sys 0.000s
I20260709 13:13:21.471230  1930 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.523873  2003 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.475490  1965 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.565761  2017 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.571426 28725 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:21.571806 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:21.572273 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:21.486078  1872 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.574517 28722 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:13:21.560902  1857 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.001s
W20260709 13:13:21.576217 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 49334.9us
I20260709 13:13:21.576427 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:21.519106  2008 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.588343  2019 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:21.589666  2008 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.521821  1665 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.589792  2019 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:21.590694  2019 consensus_queue.cc:1243] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:21.591825  1665 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:21.592633 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:21.593672 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:21.595082 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.595327 28655 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:21.580461 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:21.582691 28721 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:21.582803 28729 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.601960 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:21.569257  1990 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 13:13:21.537073  1910 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.605369  1990 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.595901 28647 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:21.596333 28648 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:21.607688 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:21.608369 28573 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:21.608525  1910 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:21.596711 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.596953 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.609444 28654 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:21.597506 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:21.606575 28652 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:13:21.569425  1899 consensus_meta.cc:287] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.003s
I20260709 13:13:21.611763 28656 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:21.616521 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:21.617424  1990 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.619297 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.620471 28729 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:21.485246  1999 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.622975 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:21.621932 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:21.577684  1475 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:21.541849  1981 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.585615  1892 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.643779 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.579231  2024 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:21.628662  1857 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:21.627458  2021 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:21.651155 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 102461us
I20260709 13:13:21.665112 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.666141 28647 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:21.668305 28648 pending_rounds.cc:85] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 9
I20260709 13:13:21.668803 28648 pending_rounds.cc:107] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:13:21.669173 28648 raft_consensus.cc:2889] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:21.669611 28648 pending_rounds.cc:107] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:13:21.669922 28648 raft_consensus.cc:2889] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:21.686264 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.580171  1833 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:13:21.715198 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.649237 28654 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
W20260709 13:13:21.750728 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.756506 28653 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:13:21.651854  1575 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.000s
W20260709 13:13:21.783272 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75708.3us
I20260709 13:13:21.785530  1171 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:13:21.795414 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:21.806254 28647 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:21.654717 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:21.813253 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.814950 28654 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:21.628047  2022 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.156s
W20260709 13:13:21.785077  2013 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:13:21.755798  1910 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:21.820034 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 165387us
I20260709 13:13:21.823143 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:21.826305 28647 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:21.795619  2008 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.836301  2008 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.838665  2008 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.839030  1630 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:21.759246  2021 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.839512  1630 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:21.839977  1630 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.843299  1896 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:21.843845  1896 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:21.846218  1896 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.847277 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1647) took 1505 ms. Trace:
I20260709 13:13:21.847631  1896 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.857472  1910 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.859913  1910 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.794968  1886 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:21.861166 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:21.861572  1886 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.862075 28581 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:13:21.863844  1886 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.861162  1630 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.864591  1886 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:21.816329  1857 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:21.867605  1997 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.896s	user 0.000s	sys 0.028s
I20260709 13:13:21.867816  1857 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.868237  1956 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:21.755522  1475 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:21.757859  2024 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:21.878103 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2329) took 1197 ms. Trace:
I20260709 13:13:21.847714 29254 rpcz_store.cc:276] 0709 13:13:20.341411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.341603 (+   192us) service_pool.cc:224] Handling call
0709 13:13:20.367429 (+ 25826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.973093 (+605664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.846973 (+873880us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54005398d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:21.847171 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249761152}
I20260709 13:13:21.796180  1894 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.875952 29224 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:21.839838  2021 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.812001  1913 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.903045 28581 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:13:21.907532 28581 pending_rounds.cc:85] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 11
I20260709 13:13:21.816417  1875 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.907783 28581 pending_rounds.cc:107] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:13:21.908185 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.651108  1892 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.919886 28581 raft_consensus.cc:2889] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:21.807613  1990 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:13:21.907743 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2330) took 1226 ms. Trace:
I20260709 13:13:21.919382 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:21.811412  1575 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:21.920769 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:21.922523 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56792 (request call id 4) took 1736 ms. Trace:
I20260709 13:13:21.925261 28654 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:21.885762 28727 rpcz_store.cc:276] 0709 13:13:20.680578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.680826 (+   248us) service_pool.cc:224] Handling call
0709 13:13:20.681135 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.681487 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.681517 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:20.681964 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:13:20.800649 (+118685us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:21.092508 (+291859us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.304035 (+211527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.304140 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.867018 (+562878us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:21.870117 (+  3099us) raft_consensus.cc:1685] finished
0709 13:13:21.877864 (+  7747us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.878040 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30299,"prepare.queue_time_us":116091,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":89201,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":60948,"spinlock_wait_cycles":23040256,"thread_start_us":579753,"threads_started":3,"wal-append.queue_time_us":163191}
I20260709 13:13:21.925325 29260 rpcz_store.cc:276] 0709 13:13:20.217922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.222841 (+  4919us) service_pool.cc:224] Handling call
0709 13:13:21.908761 (+1685920us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54007562d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e10853 00007f4a2cdde60a 00007f4a263647d4 00007f4a26364762 00007f4a26364691 00007f4a2636460c 00007f4a263638c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:21.908886 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319301888}
I20260709 13:13:21.925940 28728 rpcz_store.cc:276] 0709 13:13:20.680921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.706140 (+ 25219us) service_pool.cc:224] Handling call
0709 13:13:20.706497 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.965869 (+259372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.907415 (+941546us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54001e73d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:21.907664 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588324096}
I20260709 13:13:21.757086  2020 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.250s
I20260709 13:13:21.930073 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.934661 28654 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:21.930186  1857 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.880362  2008 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.921772  1913 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.885264  1886 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:21.629630  2012 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.884986  1956 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.896569  1665 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:21.935690 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.757709  2025 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.263s
I20260709 13:13:21.881397  1930 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.955322 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2334) took 1012 ms. Trace:
I20260709 13:13:21.931177  1606 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:21.950695 28580 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:21.951632 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.956205 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 2616) took 1089 ms. Trace:
I20260709 13:13:21.957082 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.956595 28649 rpcz_store.cc:276] 0709 13:13:20.862682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.862808 (+   126us) service_pool.cc:224] Handling call
0709 13:13:21.951675 (+1088867us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b540001d1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:21.951792 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648107264}
I20260709 13:13:21.955754 28726 rpcz_store.cc:276] 0709 13:13:20.942817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.943023 (+   206us) service_pool.cc:224] Handling call
0709 13:13:20.943515 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.964951 (+ 21436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.964990 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:20.977134 (+ 12144us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.183766 (+206632us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:21.183829 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.183929 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.955121 (+771192us) raft_consensus.cc:1685] finished
0709 13:13:21.955141 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.955267 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20985,"raft.queue_time_us":21871,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":9306,"thread_start_us":206111,"threads_started":1,"wal-append.queue_time_us":549419}
I20260709 13:13:21.904765  1475 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.919973  1894 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:21.958527  1606 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.977155  1606 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:21.981366  2002 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:21.981971  1981 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.982107  2002 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.984236  1956 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:21.984969 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:21.986598 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:21.949770  1916 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:13:21.962805  1630 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.968036  1931 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:21.955926  1665 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.938632  2008 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:21.999415 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:22.010097 28654 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:21.984954  2002 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:21.956595  1970 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:13:21.999881  1965 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:22.002192  1981 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:22.020910 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:22.022084 28578 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:22.006278  1999 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:22.010201  1916 consensus_queue.cc:1243] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:22.038362 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:22.013850  2017 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:22.042719 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.045478 28654 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:22.048723 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:22.051345  1965 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:22.051837  1916 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:22.006083  1886 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.052405  1999 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:22.055577 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.056699 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.057945 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.103333 28722 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:21.985272  2024 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.046599  1857 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:22.066176  2028 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:13:22.047101  2026 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:13:22.043372  1896 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.080229 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.125409 28728 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:22.126377 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.094350 28727 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:22.052157  2025 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:22.137745  1665 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:22.137436  2025 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.138077 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:22.138870  2033 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:13:22.138940 28727 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:22.139845  2025 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:22.059633  1963 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:22.140241 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:22.122198 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.141521 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:22.026547  1981 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.101859 28726 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:22.104835 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:22.143816 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:22.144575 28581 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:22.145601 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:22.106173 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:22.112784 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.098888 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.147821 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:22.148497 28723 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:22.150436 28573 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:22.152302 28581 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:22.154196 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:22.155068 28722 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:22.156939 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.158389 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.159036 28725 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:22.163290 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:22.142231 28727 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:22.179057 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.182547 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:22.183498 28581 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:22.187954 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:22.115936  1990 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:22.098171  1965 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.156621  2002 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:22.189893  1665 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.177544  1963 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:22.198185  1575 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:22.198980 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 2617) took 1334 ms. Trace:
I20260709 13:13:22.112213  1999 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.112282  1916 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:22.198261 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.203445 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2614) took 1341 ms. Trace:
I20260709 13:13:22.317477 28656 rpcz_store.cc:276] 0709 13:13:20.864307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.864442 (+   135us) service_pool.cc:224] Handling call
0709 13:13:22.198815 (+1334373us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54003b1354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:22.198926 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716163328}
I20260709 13:13:22.319938 28653 rpcz_store.cc:276] 0709 13:13:20.862004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.862139 (+   135us) service_pool.cc:224] Handling call
0709 13:13:20.913648 (+ 51509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.781685 (+868037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.203211 (+421526us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540018f454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:22.203389 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937544064}
I20260709 13:13:22.205224 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:22.122318  1892 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:22.211374 28655 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
W20260709 13:13:22.192667 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 369642us
I20260709 13:13:22.149811  1913 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:22.331822 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:22.332119  1913 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:22.332856  1913 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.168051  1475 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:22.335476  1982 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.069s	user 0.013s	sys 0.001s
I20260709 13:13:22.336320 28728 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:22.120208  1857 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.151535  1896 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:22.324553  1665 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.345821 28647 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:22.347633 28647 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:22.349269 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:22.250988  1899 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:22.322345  2002 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.383589  2002 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:22.387089 28726 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:13:22.385694  1569 consensus_meta.cc:287] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.087s	user 0.010s	sys 0.004s
I20260709 13:13:22.321684  1963 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:22.411629 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.250339  1990 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:22.428092  1981 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:22.460144 28651 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:22.462347 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:22.462510 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2618) took 1596 ms. Trace:
I20260709 13:13:22.463013 28651 rpcz_store.cc:276] 0709 13:13:20.865917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.866038 (+   121us) service_pool.cc:224] Handling call
0709 13:13:20.866356 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.460672 (+1594316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.462218 (+  1546us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400259754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:22.462433 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3664200960}
I20260709 13:13:22.463793  2007 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:22.463984  1970 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:22.464258  2007 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:22.465766 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:22.466383 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:22.466784 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:22.466959 29253 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:22.467078 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:22.467468 29258 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:22.467865 29254 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:22.386976 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:22.516110  1889 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:22.516711  1889 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:22.418874  1963 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:22.386745  2021 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.422904  1569 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.524459  1930 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:22.558861  1877 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:22.627799 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.012s	sys 0.022s
I20260709 13:13:22.628448 28649 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:22.583997 28729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.009s
W20260709 13:13:22.643590 28729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.004s	sys 0.009s
W20260709 13:13:22.628526 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.012s	sys 0.022s
W20260709 13:13:22.628568  1606 consensus_meta.cc:287] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.006s
I20260709 13:13:22.517755  2007 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.447686 28722 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:22.588223  1930 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:22.810575 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.781582  2007 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:22.599750  1877 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.864451 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:22.866111 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 678211us
I20260709 13:13:22.866959 28695 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:22.868892 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1281) took 1226 ms. Trace:
I20260709 13:13:22.869482 28648 rpcz_store.cc:276] 0709 13:13:21.642581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.643050 (+   469us) service_pool.cc:224] Handling call
0709 13:13:21.667999 (+ 24949us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:21.786634 (+118635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.786675 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:21.787391 (+   716us) log.cc:844] Serialized 78 byte log entry
0709 13:13:22.072817 (+285426us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:22.564681 (+491864us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.597582 (+ 32901us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.868413 (+270831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.868521 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.868610 (+    89us) raft_consensus.cc:1685] finished
0709 13:13:22.868630 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.868818 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15585,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":40977,"thread_start_us":634261,"threads_started":2,"wal-append.queue_time_us":379761}
W20260709 13:13:22.870914 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.871302  1665 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:22.874014  1857 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:22.876250 28619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.011s	sys 0.010s
W20260709 13:13:22.876636 28619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.011s	sys 0.010s
I20260709 13:13:22.884538 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:22.892069 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 428419us
I20260709 13:13:22.865514 28656 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:22.952564 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:22.874056  1965 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:22.954056  1924 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:22.954826 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:22.954699  1924 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.956471 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:22.956496 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:22.957253 28573 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:22.958494 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:22.960461 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:22.629379  1889 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:22.661520  1606 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.003782 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:23.012172 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.964747 29260 raft_consensus.cc:2410] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:13:23.012434 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 145176us
W20260709 13:13:23.015914 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.964800 28654 pending_rounds.cc:85] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 11
I20260709 13:13:23.016783 28577 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:23.014106 29252 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:23.005106 29258 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:13:23.005549 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:22.964118 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61760.2us
W20260709 13:13:22.999122 28581 consensus_meta.cc:287] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.000s
I20260709 13:13:23.019629 28581 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:23.021946 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:22.781965  2024 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.994642 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1413) took 1147 ms. Trace:
I20260709 13:13:23.020291 28654 pending_rounds.cc:107] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:13:23.027848 28654 raft_consensus.cc:2889] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:23.030501 28723 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.860s	user 0.008s	sys 0.003s
I20260709 13:13:23.031379 28723 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:23.032331  1981 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:13:23.045959  2021 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.049557  1569 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.049387  2052 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:23.050196  1569 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:23.050614  1569 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:23.050956  1990 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.051796  1896 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.052513  1896 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.053515  1913 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.054118  1913 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.054327  1578 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.054687  1913 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.056543 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:23.059466 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2625) took 1004 ms. Trace:
I20260709 13:13:23.060184 28648 rpcz_store.cc:276] 0709 13:13:22.054997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.048177 (+993180us) service_pool.cc:224] Handling call
0709 13:13:23.048642 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.048874 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.048914 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:23.048982 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:23.058946 (+  9964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.059083 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.059343 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:22.956015  1892 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:23.064178 29253 raft_consensus.cc:2393] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:23.015239  1899 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.027542 28575 rpcz_store.cc:276] 0709 13:13:21.809639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.809775 (+   136us) service_pool.cc:224] Handling call
0709 13:13:21.810115 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.141500 (+331385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.141531 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.156481 (+ 14950us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.558685 (+402204us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:22.558729 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.558992 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.956727 (+397735us) raft_consensus.cc:1685] finished
0709 13:13:22.956748 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.956918 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1601,"raft.queue_time_us":28876,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":684109,"threads_started":2,"wal-append.queue_time_us":755985}
I20260709 13:13:22.876227  2040 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.012743  2042 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:23.071569 28725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.027s	sys 0.017s
W20260709 13:13:23.075839 28725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.027s	sys 0.017s
W20260709 13:13:23.074779 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 189704us
I20260709 13:13:23.074229 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:23.050981  1569 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:23.080760 28727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.016s	sys 0.032s
W20260709 13:13:23.084354 28727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.016s	sys 0.033s
I20260709 13:13:23.082162 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:22.901273  1926 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.091542 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 198326us
I20260709 13:13:23.092583 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:23.072693  1930 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.096673 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:23.077809  2042 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.071394  2048 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:23.098699 28648 raft_consensus.cc:2368] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:23.066931  1896 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:23.066694  2051 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:13:23.102972  2044 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:23.069418  1892 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.105125 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:23.091717  1999 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.075963  1899 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.096890  2021 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:23.081143  2040 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.089501  1665 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:13:23.101083  1970 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:23.084650  2024 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.095669  1926 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:23.191656 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 113401us
I20260709 13:13:23.139314  1913 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.137780 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:23.099397  2042 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:23.103067  2048 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.141808  2021 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:23.249528 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.249267 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.193956 29251 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:23.251045 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2629) took 1154 ms. Trace:
I20260709 13:13:23.189416  1924 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.107160  2044 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.245548 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.267289 28656 rpcz_store.cc:276] 0709 13:13:22.096376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.994766 (+898390us) service_pool.cc:224] Handling call
0709 13:13:22.995138 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.995360 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:23.063077 (+ 67717us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.250579 (+187502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:23.250633 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:23.250812 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.250879 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.250992 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56610,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":3335,"raft.queue_time_us":13278,"thread_start_us":186550,"threads_started":1}
I20260709 13:13:23.193379  2062 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:23.264690 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:23.263581 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 243590us
I20260709 13:13:23.175694  1970 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:23.269855 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 211729us
I20260709 13:13:23.276712 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:23.271134 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.283509 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:23.275112 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 253202us
I20260709 13:13:23.275424 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:23.287040 28621 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:23.284555 29259 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:23.262607  2064 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:23.266111  1606 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:23.276662  2050 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:13:23.317790 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.320554 29260 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:23.323391 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.297070  2051 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:23.333812  2061 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:13:23.334391  1892 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.262466  2063 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:13:23.335191  1569 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:23.335577 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 3049) took 1260 ms. Trace:
I20260709 13:13:23.337361  2021 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.336194 28579 rpcz_store.cc:276] 0709 13:13:22.075240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.075366 (+   126us) service_pool.cc:224] Handling call
0709 13:13:22.075715 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.586632 (+510917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.586681 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.587359 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.068232 (+480873us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:23.068275 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.068350 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.335238 (+266888us) raft_consensus.cc:1685] finished
0709 13:13:23.335269 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.335489 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":255865,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":903635,"threads_started":2,"wal-append.queue_time_us":516952}
W20260709 13:13:23.338881  2059 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:13:23.339815  2057 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:13:23.338107  1569 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.341380  1899 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.305049  1886 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.308744  2064 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:23.306623  2062 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.353695  2046 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:13:23.370301 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.344548  1926 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.339674  1896 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.356014  2040 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.375618 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.320484  1913 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:13:23.355234  1970 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:23.344627  2044 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:23.369513  1892 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.371953  2066 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:23.356341  2072 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:23.348388  1665 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:13:23.386899  2078 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:23.387864 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.388401  1910 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:23.388600 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1415) took 1468 ms. Trace:
I20260709 13:13:23.390292  2075 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.390805  2024 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.369730  2064 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:23.377110 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 97019.4us
I20260709 13:13:23.395412 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.395628 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.397684 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.418780 28577 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:23.375173  2062 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.393479  2082 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:23.397497  1892 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.375586  2051 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:23.393882  2066 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:23.394165  1926 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.407721  2042 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:23.398211  2007 consensus_meta.cc:287] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.001s
I20260709 13:13:23.411572 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:23.412047  2069 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:23.411644 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2620) took 1358 ms. Trace:
I20260709 13:13:23.413955 28578 rpcz_store.cc:276] 0709 13:13:21.920039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.920530 (+   491us) service_pool.cc:224] Handling call
0709 13:13:23.388448 (+1467918us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b54001fb654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:23.388547 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223048448}
I20260709 13:13:23.431385 28579 raft_consensus.cc:606] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:13:23.420575 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.421793 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.432973 28577 raft_consensus.cc:2393] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 9: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:23.433909 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:23.427824  2082 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.434801 28577 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:13:23.434092  2051 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.435735 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.436337  2082 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.365331  1886 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:23.437849  1963 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.896s	user 0.013s	sys 0.000s
I20260709 13:13:23.437505  2066 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.423890 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.426591 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:23.426610 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:23.415824  1910 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.429818 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.430529 29259 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:23.466296 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.466524  1886 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.466892 28581 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:13:23.468868  1910 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:23.474679  2062 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:23.469244  2014 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 1.895s	user 0.011s	sys 0.008s
I20260709 13:13:23.469879 28573 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:13:23.422942  2075 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.473279 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1688) took 1838 ms. Trace:
I20260709 13:13:23.478991 28724 rpcz_store.cc:276] 0709 13:13:21.634912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.635058 (+   146us) service_pool.cc:224] Handling call
0709 13:13:21.635373 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.635601 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:22.071140 (+435539us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.872339 (+801199us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.472626 (+600287us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b180036dde0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:13:23.472829 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:23.472891 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:23.472953 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.473072 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.473214 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307356,"prepare.queue_time_us":210095,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":1099407,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":37655,"spinlock_wait_cycles":13819776,"thread_start_us":568606,"threads_started":2,"wal-append.queue_time_us":935764}
I20260709 13:13:23.431457 28647 rpcz_store.cc:276] 0709 13:13:22.053503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.380700 (+327197us) service_pool.cc:224] Handling call
0709 13:13:22.865336 (+484636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.865874 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.865920 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.901080 (+ 35160us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.199068 (+297988us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:23.199125 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.199215 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.411327 (+212112us) raft_consensus.cc:1685] finished
0709 13:13:23.411367 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.411550 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":87624,"thread_start_us":148231,"threads_started":1,"wal-append.queue_time_us":394405}
W20260709 13:13:23.430001 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 292307us
I20260709 13:13:23.465586 29255 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:23.436872 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.466661 28578 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:23.478159 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.483748 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.485980 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.482175 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:23.487558 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.491240 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:23.438442  1892 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:23.486423  2079 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:13:23.496806 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 70305.1us
I20260709 13:13:23.493762 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:23.438385  1963 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:23.485884  2066 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:23.475574  2069 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:23.508669 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 222467us
I20260709 13:13:23.498260  1833 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:23.502763  2018 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:23.492866  2062 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:23.500578  2082 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:23.505260  1963 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:23.507696 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 238042us
I20260709 13:13:23.525386 28622 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:23.525869 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1686) took 1900 ms. Trace:
I20260709 13:13:23.508427 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2623) took 1454 ms. Trace:
I20260709 13:13:23.526302 28729 rpcz_store.cc:276] 0709 13:13:21.625501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.625944 (+   443us) service_pool.cc:224] Handling call
0709 13:13:21.626260 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.626476 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:22.037739 (+411263us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.504572 (+1466833us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:23.525511 (+ 20939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:23.525568 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:23.525615 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.525685 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.525809 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":836230,"prepare.queue_time_us":218607,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"spinlock_wait_cycles":5353344,"thread_start_us":900095,"threads_started":3,"wal-append.queue_time_us":1036732}
I20260709 13:13:23.438867  1926 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:23.513195 28573 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:23.510226 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:23.491842  1965 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:23.517894 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:23.518215 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 651294us
I20260709 13:13:23.540398 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:23.518781  2002 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:23.530306 28578 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:23.533847  1530 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:23.534062  2081 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.538213 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:23.545035 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:23.514443  2018 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:23.519384  2062 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:23.526495 28654 rpcz_store.cc:276] 0709 13:13:22.054434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.874737 (+820303us) service_pool.cc:224] Handling call
0709 13:13:22.964526 (+ 89789us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:23.028995 (+ 64469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.029045 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:23.032757 (+  3712us) log.cc:844] Serialized 52 byte log entry
0709 13:13:23.244896 (+212139us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:23.267983 (+ 23087us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.507367 (+239384us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b18003e10a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:13:23.507762 (+   395us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.507966 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.508039 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.508172 (+   133us) raft_consensus.cc:1685] finished
0709 13:13:23.508190 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.508367 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":986,"prepare.queue_time_us":23788,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":266419,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":232,"spinlock_wait_cycles":9169536,"thread_start_us":163095,"threads_started":1,"wal-append.queue_time_us":280620}
I20260709 13:13:23.555930 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:23.553874 28578 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:23.551179 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1913) took 1347 ms. Trace:
W20260709 13:13:23.556552 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 46379.8us
I20260709 13:13:23.560972 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:23.574208 28621 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:23.575429 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:23.569482 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1269) took 2901 ms. Trace:
I20260709 13:13:23.544543  1963 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:23.583305 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.584632 28578 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:23.570885 29257 rpcz_store.cc:276] 0709 13:13:22.204206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.209955 (+  5749us) service_pool.cc:224] Handling call
0709 13:13:22.889044 (+679089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.077342 (+188298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.077372 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.090413 (+ 13041us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.277702 (+187289us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:23.277745 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.277815 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.550935 (+273120us) raft_consensus.cc:1685] finished
0709 13:13:23.550956 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.551107 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4814,"raft.queue_time_us":185138,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":11347,"thread_start_us":356967,"threads_started":2,"wal-append.queue_time_us":273670}
I20260709 13:13:23.589275 29224 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:23.576829 28650 rpcz_store.cc:276] 0709 13:13:20.653425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.653534 (+   109us) service_pool.cc:224] Handling call
0709 13:13:20.653796 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.980752 (+326956us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b1800423460. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e0ebfb 00007f4a27e1964b
0709 13:13:20.980880 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:20.981195 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.108335 (+127140us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.121416 (+ 13081us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.121586 (+   170us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:21.121621 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.388686 (+1267065us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540022c754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:22.388764 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.468891 (+1080127us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b24000c2c48. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24baf9c4 00007f4a24badacb 00007f4a24d68dc9 00007f4a24d68a55 00007f4a24d6809d 00007f4a2799a10e 00007f4a279b188c 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221
0709 13:13:23.554803 (+ 85912us) raft_consensus.cc:1685] finished
0709 13:13:23.554825 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.554982 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":65598,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":48996,"spinlock_wait_cycles":388635904,"thread_start_us":217469,"threads_started":2,"wal-append.queue_time_us":200995}
I20260709 13:13:23.587634 28622 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:23.543833  2002 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:23.589943  2049 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.432s	user 0.003s	sys 0.000s
I20260709 13:13:23.559113  2018 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:23.558182  2072 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:23.569974  1999 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:23.595224 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.596077 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:23.573335  1981 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:23.544240  1965 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:23.598093 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.558887  2058 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:23.573689  1970 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:23.602730 28578 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:23.589083  1963 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.587893  2007 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:23.569628  2062 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:23.616146 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.622084 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.597101  2044 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:23.622783 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 3062) took 1378 ms. Trace:
I20260709 13:13:23.590991  1569 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:23.598399  2002 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:23.637478  1569 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:23.616667 29257 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:23.561367  1530 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.597538  2078 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.561331  2081 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.600097  2072 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:23.604336  1999 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.603989  1981 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.623410 28580 rpcz_store.cc:276] 0709 13:13:22.243956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.615781 (+1371825us) service_pool.cc:224] Handling call
0709 13:13:23.622700 (+  6919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:23.623597 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:23.627025  2067 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:23.624043  1899 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:23.639832 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:23.640075 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:23.693748  1530 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.697726  2072 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.698791 28578 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.701773  2075 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.703198  2069 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.692384  2068 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 13:13:23.648801 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:23.710137 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 114136us
I20260709 13:13:23.621740  1963 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.672938 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2624) took 1618 ms. Trace:
I20260709 13:13:23.719488 28578 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:23.721712 28651 rpcz_store.cc:276] 0709 13:13:22.054738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.648245 (+1593507us) service_pool.cc:224] Handling call
0709 13:13:23.672276 (+ 24031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.672500 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.672536 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:23.672602 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:23.672654 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.672723 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.672866 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:23.722839 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.711445 28622 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:23.724172 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 84474.7us
I20260709 13:13:23.725054 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:23.725821  2082 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:23.726034  2096 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:23.726832  2096 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:23.727182  2058 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:23.727402  2096 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:23.726843  2040 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:23.729188  2040 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.726263  2082 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:23.732841 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 114622us
I20260709 13:13:23.731020 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.622010  2007 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:23.638681  2071 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:23.742923  2071 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:23.744274 28728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2858) took 1618 ms (client timeout 1929 ms). Trace:
W20260709 13:13:23.744730 28728 rpcz_store.cc:269] 0709 13:13:22.126007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.126148 (+   141us) service_pool.cc:224] Handling call
0709 13:13:23.744025 (+1617877us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002da354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:23.744186 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481365248}
I20260709 13:13:23.746400  1836 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.746625  2081 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.747125 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:13:23.748050 28545 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.696s (SENT) [suppressed 9 similar messages]
I20260709 13:13:23.731204 29257 raft_consensus.cc:2410] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:13:23.734992  2058 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.736686  2082 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:23.741657  2068 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.747011  1836 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.750470 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.646930  2044 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:23.743398  2040 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.735424  1899 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.735213 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.721279  1981 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.721457  1999 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:23.622982  1970 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.769088  1970 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:23.769646 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.770535 29257 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 7.
I20260709 13:13:23.750130 29260 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:23.755498  1836 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:23.757987  2087 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:13:23.759333 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.760818 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 3050) took 1685 ms. Trace:
I20260709 13:13:23.762275 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.763590 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1271) took 2628 ms. Trace:
I20260709 13:13:23.771660 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:23.773742 28578 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:23.749024  2007 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:23.734345 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:23.736220  2067 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:23.670092  2078 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:24.046749 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 298693us
I20260709 13:13:23.777041 28577 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:13:23.903640  1928 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:24.078717 28652 rpcz_store.cc:276] 0709 13:13:21.134922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.136414 (+  1492us) service_pool.cc:224] Handling call
0709 13:13:21.136784 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.611026 (+474242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.763360 (+2152334us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400298e54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:23.763536 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079851904}
I20260709 13:13:24.080946  1928 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:24.088941  1928 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.090858  1928 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:24.092796  2067 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.096365  2106 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:24.096674  1910 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.623s	user 0.002s	sys 0.008s
W20260709 13:13:24.097683 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 363395us
I20260709 13:13:24.100781 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.101052 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.102576  2018 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:23.892652  2064 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.106815  2064 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:24.017542  1965 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:24.016505  2044 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.111693  2072 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.115808 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.116508 28650 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:24.002179  1877 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:23.902575  1836 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.119690 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.121757  1910 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.125317 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.126026 28647 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:24.131696 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:24.132946 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:24.133612 28648 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:24.135372  2018 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.044463  1999 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.139655 28650 raft_consensus.cc:2368] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18.
I20260709 13:13:24.151176  1999 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.772778  2071 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:23.772961  2068 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.153834 28654 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:23.973451  2002 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.077374 28572 rpcz_store.cc:276] 0709 13:13:22.081077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.081492 (+   415us) service_pool.cc:224] Handling call
0709 13:13:22.115462 (+ 33970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.142463 (+ 27001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.142502 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.142540 (+    38us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:22.142580 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.760468 (+1617888us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b540031ef54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:23.760517 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.760656 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61655424}
I20260709 13:13:24.125559  1910 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.141217  1963 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.151453  2072 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.187876 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:24.191028 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.193397 28656 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:24.195173 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.195173 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:24.197274 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:23.774981  1899 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.200182 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:24.202373 28580 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:24.208634 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.206226 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.209481 29259 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:24.209158 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:24.210525 29258 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:24.211386 28651 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:24.211994 28574 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:23.756567  2058 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:24.215633 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 140758us
W20260709 13:13:24.217244 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.213711  2042 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.219087 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:24.220652 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:24.221253  2062 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.573s	user 0.002s	sys 0.010s
I20260709 13:13:24.205730  2082 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.222126  2051 raft_consensus.cc:993] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:13:24.297273 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.273303 29258 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:13:24.319025 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.241520 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:24.271876 28655 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1285) took 2282 ms (client timeout 1510 ms). Trace:
I20260709 13:13:24.322125 29259 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:24.322687 29255 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:24.319855 28578 raft_consensus.cc:2410] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:13:24.323797 28622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.031s	sys 0.071s
W20260709 13:13:24.324425 28622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.031s	sys 0.071s
W20260709 13:13:24.321357 28655 rpcz_store.cc:269] 0709 13:13:21.989649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.008946 (+ 19297us) service_pool.cc:224] Handling call
0709 13:13:24.271581 (+2262635us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540001c2d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:24.271744 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435975936}
I20260709 13:13:24.256004 29252 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:24.328027 28573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.039s	sys 0.066s
W20260709 13:13:24.328531 28573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.039s	sys 0.066s
W20260709 13:13:24.243515  2031 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 2.177s	user 0.000s	sys 0.025s
W20260709 13:13:24.248889  2032 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 2.180s	user 0.016s	sys 0.009s
W20260709 13:13:24.333297 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.333438 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:24.239044  2096 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.000s
I20260709 13:13:24.341686 28572 raft_consensus.cc:2368] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19.
I20260709 13:13:24.320580  1889 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.338425 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:24.344362 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.338752 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.323558  2039 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.233582  1899 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.257249  1981 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:24.349772  2113 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.112s	user 0.000s	sys 0.004s
I20260709 13:13:24.350901  1981 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.351281 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2866) took 2222 ms. Trace:
I20260709 13:13:24.351933 28576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1407) took 2741 ms. Trace:
I20260709 13:13:24.351720 28730 rpcz_store.cc:276] 0709 13:13:22.128607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.243955 (+115348us) service_pool.cc:224] Handling call
0709 13:13:22.857918 (+613963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.849637 (+991719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.849670 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.914570 (+ 64900us) log.cc:844] Serialized 26 byte log entry
0709 13:13:24.157552 (+242982us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:24.157593 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.157666 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.351030 (+193364us) raft_consensus.cc:1685] finished
0709 13:13:24.351052 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.351197 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":620268,"thread_start_us":423715,"threads_started":2,"wal-append.queue_time_us":220627}
I20260709 13:13:24.253563  1926 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.352440 28576 rpcz_store.cc:276] 0709 13:13:21.610886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.611265 (+   379us) service_pool.cc:224] Handling call
0709 13:13:21.611638 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:21.612026 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.612064 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:21.612717 (+   653us) log.cc:844] Serialized 52 byte log entry
0709 13:13:21.869833 (+257116us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:21.869874 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.869944 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.248251 (+2378307us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:24.351596 (+103345us) raft_consensus.cc:1685] finished
0709 13:13:24.351620 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.351849 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":451,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":2791168,"thread_start_us":256722,"threads_started":1,"wal-append.queue_time_us":406710}
I20260709 13:13:24.222306  2078 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.354722  2082 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.354897  2048 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.323840  2062 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.354931 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.358206 28656 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:24.343657 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.358795 28655 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:24.342756 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:24.332274 28648 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:24.339363 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:24.358443 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:24.328073  2051 raft_consensus.cc:1081] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:13:24.234578  2069 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:24.364522  2069 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:24.364969  2069 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:24.364871  2007 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.367478 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.236301  2058 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.347342 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:24.351421 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.372388 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:24.361308 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2865) took 2561 ms. Trace:
I20260709 13:13:24.263870  1872 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.362237 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:24.362475 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:24.358922  2039 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.373802 28576 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:24.374085 29251 raft_consensus.cc:2410] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:13:24.374607  2068 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.375015 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.375205  2039 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.375597 29251 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.360195 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:24.377318  2082 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:24.364064  2062 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:24.346596  2096 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.345147 28574 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
W20260709 13:13:24.377799  2117 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:13:24.362880 28546 leader_election.cc:400] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18.
I20260709 13:13:24.379088 28649 rpcz_store.cc:276] 0709 13:13:21.799552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.965598 (+166046us) service_pool.cc:224] Handling call
0709 13:13:21.965965 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.632349 (+666384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.361099 (+1728750us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b540006e0d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:24.361255 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523085568}
I20260709 13:13:24.390431 28546 leader_election.cc:403] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:24.391045 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:24.391763 28649 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:24.389992 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:24.393994 28574 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:24.373924  1963 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.398200 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.381458  2078 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:24.380524 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2862) took 2253 ms. Trace:
I20260709 13:13:24.384939  1857 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:24.385424 28576 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:24.385110  2067 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.361732 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:24.381598  2048 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:24.408214 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:24.372920  2069 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.403728 28725 rpcz_store.cc:276] 0709 13:13:22.127437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.159707 (+ 32270us) service_pool.cc:224] Handling call
0709 13:13:22.160020 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.160260 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:22.318526 (+158266us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.380190 (+2061664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.380249 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:24.380297 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.380367 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.380477 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1302227,"prepare.queue_time_us":151621,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"thread_start_us":759012,"threads_started":1,"wal-append.queue_time_us":958312,"wal-append.run_cpu_time_us":1785,"wal-append.run_wall_time_us":1070804}
I20260709 13:13:24.408458 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.383991  2082 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:24.385804  2020 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:24.411773 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.421622  2067 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.433185  2071 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:24.433830  2071 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.434866  2067 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.436235  2071 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.400126  2002 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.427389 28574 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:24.410487  2051 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18.
I20260709 13:13:24.409600  1899 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:13:24.440220 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:24.417455 28648 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:24.429042  2093 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.441039 28574 raft_consensus.cc:2368] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:24.441370  2093 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.442477  2069 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.443746  2093 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:24.429561  1965 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:24.444687  1965 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.445163  1965 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:24.447306 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.448288 28574 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:13:24.430070  1872 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:24.449512  1872 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.451102 28574 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:24.451678  1872 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.429332  1575 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.397579  1929 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:13:24.452673  1575 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.423525  2048 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:24.454113  2048 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:24.454836  1575 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:24.406720  2078 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.455737  2078 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:24.432053  2082 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:24.432247  2020 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:24.429209  2103 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.441745 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.455726  1857 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:24.437958  2018 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:24.437151 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.460134 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.461395 28649 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:24.502272 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.462353 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.520104 29224 leader_election.cc:400] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:24.520731 29224 leader_election.cc:403] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:13:24.521528  2071 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:24.500496 28650 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
W20260709 13:13:24.528051 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.523805  2103 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.540664 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.541483 28650 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:24.540700  1630 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:24.542341  2103 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.542680 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.543515 28654 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:24.542819 28650 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:13:24.546890 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:24.547453 28650 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:13:24.547729 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:24.548699  1578 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:24.549538 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:24.549549  1578 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:24.550446  2020 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.551589 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:24.551232  1578 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.552507 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:24.553869 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:24.554454 28649 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:24.557070 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.557909 28648 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:24.577653 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:24.538277  1857 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:24.598423 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45972.4us
I20260709 13:13:24.548749 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:24.616694 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 68025.9us
I20260709 13:13:24.618494 28649 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:24.500087  2018 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:24.625114  1857 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.625869  1981 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:24.626313  1890 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:24.630438 28577 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:24.638886 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:24.462124  1929 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:13:24.642319 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1686) took 1742 ms. Trace:
I20260709 13:13:24.577105  2069 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:24.641460 28650 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:24.634243  2018 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:24.648662 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2823) took 1251 ms. Trace:
I20260709 13:13:24.642712 29253 rpcz_store.cc:276] 0709 13:13:22.895291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.897902 (+  2611us) service_pool.cc:224] Handling call
0709 13:13:24.637427 (+1739525us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400596354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:24.637559 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249508608}
I20260709 13:13:24.651108 28648 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:24.649242 28579 rpcz_store.cc:276] 0709 13:13:23.396844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.467915 (+ 71071us) service_pool.cc:224] Handling call
0709 13:13:23.468318 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.494934 (+ 26616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.494982 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.500744 (+  5762us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.654364 (+153620us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:23.654752 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:13:23.715181 (+ 60429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.715297 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.274980 (+559683us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b48000030d8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2cd3faa1 00007f4a2cd36b37 00007f4a2cd369ca 00007f4a2ce2e26f 00007f4a2ce2df37 00007f4a2ce4255c 00007f4a2ce42508 00007f4a2ce42488 00007f4a2ce42443 00007f4a2ce416ec 00007f4a2bd6ba96
0709 13:13:24.646219 (+371239us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b180034b640. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:24.648346 (+  2127us) raft_consensus.cc:1685] finished
0709 13:13:24.648373 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.648580 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27804,"prepare.queue_time_us":49384,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":97489,"raft.run_cpu_time_us":14620,"raft.run_wall_time_us":782716,"spinlock_wait_cycles":49486336,"thread_start_us":130682,"threads_started":1,"wal-append.queue_time_us":232198}
W20260709 13:13:24.654246 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.11384e+06us
I20260709 13:13:24.656028 29251 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:24.620358 28647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:13:24.657953 28647 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:24.658331 28647 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:24.656629 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:24.655290 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:24.637279  1981 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.649304  1926 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:24.669991 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:24.665410 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:24.674165 29251 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:24.676962 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.678726 29253 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:24.683732 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.661054  2069 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:24.663858  1857 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:24.665537  2052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.008s	sys 0.023s
I20260709 13:13:24.664393  1877 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:24.696209 28647 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.703822 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.649214  1890 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.669178  1981 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:24.705308 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.726649 28725 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 8.
I20260709 13:13:24.706158 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.707672 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.721179 28695 leader_election.cc:400] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:24.728065 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.728291 28695 leader_election.cc:403] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:24.728683 28723 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 8.
I20260709 13:13:24.729984 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.730633 28723 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:24.731729 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.727955 28724 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:24.733063 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.735193 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.664714  1929 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:13:24.721684  2052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.671s	user 0.009s	sys 0.024s
I20260709 13:13:24.670603  2042 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
W20260709 13:13:24.720443  2118 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:13:24.738792 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.742532 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.744815 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.751047 28724 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:24.751833 29251 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.747776 29253 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:24.752921 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.753783 28724 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:24.759377 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.762527 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.765288 28647 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.767620 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.768563 28728 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:24.730644  2123 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:24.742159  2111 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:13:24.785271 28695 connection.cc:256] RPC call timeout handler was delayed by -1.6203025610000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
I20260709 13:13:24.736485  2086 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.793706 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.794003 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:24.794368 28695 connection.cc:256] RPC call timeout handler was delayed by -1.5564025609999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 13:13:24.794850 28725 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:24.742044  2089 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.798369 29251 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:24.731320  1872 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:24.803283 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.755722  2096 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:24.808352 28695 connection.cc:256] RPC call timeout handler was delayed by -1.4295025609999357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 13:13:24.808972 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1674) took 1079 ms. Trace:
W20260709 13:13:24.809351 28695 connection.cc:256] RPC call timeout handler was delayed by -1.4079025609999007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 13:13:24.812040 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:24.810581 28695 connection.cc:256] RPC call timeout handler was delayed by -1.2729025609999098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 13:13:24.816764 28695 connection.cc:256] RPC call timeout handler was delayed by -1.2378025609998531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:13:24.736151  1575 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:13:24.769294  2125 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:24.828845 28729 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
W20260709 13:13:24.817950 28695 connection.cc:256] RPC call timeout handler was delayed by -1.1861095739998291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 13:13:24.795133  2090 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:24.778858  1982 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.847505  1982 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.848981  1890 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:24.850028  1982 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.809556 29251 rpcz_store.cc:276] 0709 13:13:23.729908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.807799 (+1077891us) service_pool.cc:224] Handling call
0709 13:13:24.808167 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.808391 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:24.808429 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.808484 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:24.808529 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.808597 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.808906 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:24.850509  1889 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.006s
I20260709 13:13:24.800133  2123 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.812911  1872 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.778136  2093 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:13:24.805025  2089 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.852888 29251 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:24.862985 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.885267 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.796279 28724 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:13:24.826591 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.827044 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.864063 29254 raft_consensus.cc:2410] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:13:24.828320 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.863322 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.887018 28579 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:13:24.828858 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 166940us
I20260709 13:13:24.829258 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.731158  2088 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:13:24.893718 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.896700 28577 raft_consensus.cc:2368] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
W20260709 13:13:24.832659 28695 connection.cc:256] RPC call timeout handler was delayed by -1.1055025609998665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 13:13:24.888800 28620 connection.cc:256] RPC call timeout handler was delayed by -1.8207962610001687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 13:13:24.904062 28620 leader_election.cc:336] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.582s (SENT)
W20260709 13:13:24.905714 28620 connection.cc:256] RPC call timeout handler was delayed by -1.5289869040002486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 13:13:24.823189 28730 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:24.763270  1892 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:13:24.837917 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 2865) took 2709 ms. Trace:
I20260709 13:13:24.889424  1171 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.916770  1171 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.886647 28725 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:24.916285 28727 rpcz_store.cc:276] 0709 13:13:22.128344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.221708 (+ 93364us) service_pool.cc:224] Handling call
0709 13:13:22.321411 (+ 99703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.321616 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:22.393588 (+ 71972us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.659924 (+2266336us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.837485 (+177561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.837549 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:24.837600 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.837678 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.837850 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1369264,"prepare.queue_time_us":486912,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":2681,"raft.queue_time_us":1375491,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":191,"thread_start_us":1114840,"threads_started":3,"wal-append.queue_time_us":976942,"wal-append.run_cpu_time_us":2112,"wal-append.run_wall_time_us":1200829}
I20260709 13:13:24.874493 28728 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:24.919993 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.877738 28729 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:13:24.872093 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.897861 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:24.906147 28620 connection.cc:256] RPC call timeout handler was delayed by -1.3784875490000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2259s for a response
W20260709 13:13:24.922953 28620 connection.cc:256] RPC call timeout handler was delayed by -1.3601456840001447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:13:24.865522  1872 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:24.924392  2119 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:13:24.924547 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.925369 28726 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:24.926167 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.927203 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.927980 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.928339 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.929458 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.930048 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:24.930524 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:24.923540 28620 connection.cc:256] RPC call timeout handler was delayed by -1.1558456840002691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:13:24.931308 28620 connection.cc:256] RPC call timeout handler was delayed by -1.056711266000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2989s for a response
I20260709 13:13:24.867156  2093 consensus_queue.cc:1243] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:24.932410 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.933039 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.933573 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:24.934916 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.935009 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:24.935672 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.936374 28725 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.938182 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.938838 28729 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:24.940876 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.947108 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:24.957257 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:24.942482 28726 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:24.863101  2123 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:24.961627 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.962359 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.869597  2089 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:24.966382 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.865803  2126 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:24.964336 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.968730 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.990307 28730 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:24.979110 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.992000 28729 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:24.980084 28647 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:24.981392 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.962646 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.986286 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:24.986709 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:24.987954 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:24.988476 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:24.934382  1575 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:24.995474 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.997622 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.994043 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:25.003201 28647 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:13:24.824925  2086 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.005385 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:25.008320 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:25.007748 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.007906 28649 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:13:25.010514 28725 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:25.002063 28729 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:24.961828  2093 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:24.860962  1965 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.864251  2018 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:24.835094  2069 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:24.983708  2002 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:25.010421 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.012771 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.013769 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.983174  1963 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:24.981683  1874 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.011933 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.031780 28725 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:25.032162 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:24.866734  2090 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.034096 28730 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:25.005471  1894 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.040192  1874 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:25.046746  1874 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.048312  1965 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:25.027061 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.035737 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.059806 28728 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:25.007905  2058 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:25.025918 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.007733  2052 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.010777  1857 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:25.060372 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.036931 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:25.082543 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.016908  1889 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:25.083469 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.084601 28725 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.060688 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.087437 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.088287 28728 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
W20260709 13:13:25.061674 28620 leader_election.cc:336] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.732s (SENT)
I20260709 13:13:25.095320 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:25.098266 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61498.3us
I20260709 13:13:25.099418 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.020138  2138 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:24.999210  2123 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:13:25.008196  2103 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:13:25.111799 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.006235  1877 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:25.064797  2136 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:13:25.064949  2132 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:13:25.041394  1916 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.005301  2126 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.116888 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.145565 28729 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:25.035450  2002 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:25.098522  2052 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:25.119766 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:25.149386 29254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1683) took 2272 ms (client timeout 2065 ms). Trace:
W20260709 13:13:25.149870 29254 rpcz_store.cc:269] 0709 13:13:22.863570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.863728 (+   158us) service_pool.cc:224] Handling call
0709 13:13:25.135747 (+2272019us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54006bf154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:25.135913 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4393562368}
I20260709 13:13:25.120039  2086 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:25.123097 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.110235  2058 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:25.126407 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.127106  2122 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:25.127751 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.130237 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.131738  1877 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.133386 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.136462 29251 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:13:25.159057 29251 pending_rounds.cc:85] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 10
I20260709 13:13:25.158836 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.159365 29251 pending_rounds.cc:107] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:13:25.159179 28728 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:25.159870 29251 raft_consensus.cc:2889] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:25.111455  1894 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:25.149186  1630 raft_consensus.cc:2764] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:13:25.095086  1889 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:25.154970 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 166563us
W20260709 13:13:25.155669 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 145297us
I20260709 13:13:25.138236 28730 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:13:25.161600 28725 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:25.159824 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.190208 28727 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
W20260709 13:13:25.163471  2130 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:25.164249  2002 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.164987 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.199887 29252 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:25.166496  2058 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.167784 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.158119  2125 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:25.168745 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.169723 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.169747 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:25.187183 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.189380 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.190434 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.209551 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.211001 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:25.179273  1894 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:25.216187 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.216487 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:25.212783 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:25.213104 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1427) took 1640 ms. Trace:
I20260709 13:13:25.197150  1889 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:25.223138 28727 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:25.219894 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.220413 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.210546  2088 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:25.214787  2103 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:25.225281  2080 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:25.226186  1630 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:25.197726  2140 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:25.241845 28724 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:25.117328  2138 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:25.263790  2138 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.204438  2125 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:25.217223 28581 rpcz_store.cc:276] 0709 13:13:23.573097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.897418 (+324321us) service_pool.cc:224] Handling call
0709 13:13:23.898055 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.898337 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:24.076490 (+178153us) log.cc:844] Serialized 14 byte log entry
0709 13:13:25.059040 (+982550us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b18001a5360. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a 00007f4a27e20a2a
0709 13:13:25.154177 (+ 95137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.154239 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:25.195492 (+ 41253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.212682 (+ 17190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.212955 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41012,"prepare.queue_time_us":177898,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":131,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"spinlock_wait_cycles":11112192,"thread_start_us":94472,"threads_started":1}
I20260709 13:13:25.203542  2139 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:25.242316 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.220270  1894 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.244158  2088 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:25.242036 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.220453  2122 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:25.278949 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.244827 28728 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:13:25.194638 28729 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
W20260709 13:13:25.245885  2142 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:13:25.242619  2144 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:25.248977  2148 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:25.257511 28724 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:25.238749  2080 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:25.270432 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.271745  2150 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:25.220062  2075 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.291406  2124 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:25.290369  1857 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:25.304805 28724 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:25.308032 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2622) took 3254 ms. Trace:
I20260709 13:13:25.309425 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2830) took 1883 ms. Trace:
I20260709 13:13:25.309943 28573 rpcz_store.cc:276] 0709 13:13:23.425770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.743579 (+317809us) service_pool.cc:224] Handling call
0709 13:13:23.743914 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:23.744309 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.744336 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:23.744920 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:13:24.328961 (+584041us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:24.347858 (+ 18897us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.348192 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.357548 (+  9356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.357621 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:25.299564 (+941943us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18004243c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:25.309105 (+  9541us) raft_consensus.cc:1685] finished
0709 13:13:25.309172 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.309351 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33046,"prepare.queue_time_us":23726,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":18624,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2651,"spinlock_wait_cycles":47038976,"thread_start_us":555557,"threads_started":1,"wal-append.queue_time_us":598229}
W20260709 13:13:25.268676  2078 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.812s	user 0.018s	sys 0.003s
I20260709 13:13:25.363566  2078 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:25.366008  2078 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.366876 28578 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:25.267069  2125 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.367822  2125 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.368526  1171 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.291225  2151 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:25.285619 28729 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:13:25.375253  2155 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
W20260709 13:13:25.375409  2103 consensus_queue.cc:1175] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "178f22d83287460fb8c0db0ba2799895" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
I20260709 13:13:25.375871  2075 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:25.289865  2080 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:25.297941  2090 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:25.377700  2008 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:25.318817  2007 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:25.308066 28724 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:25.321455  2018 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:25.324230  2082 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.012s
I20260709 13:13:25.328678  2062 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:13:25.385206  2042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.000s
I20260709 13:13:25.329962  2088 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:25.330561  1963 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:25.442696  2042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.007s	sys 0.001s
I20260709 13:13:25.442983  1963 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:25.385370  1926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.003s	sys 0.003s
I20260709 13:13:25.443452  2088 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:25.443990  2088 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:25.443517  1926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.003s	sys 0.004s
I20260709 13:13:25.445475  1926 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:25.446964 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:25.448046 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.448263 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:25.337958  1889 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.339314  1894 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:25.341885  1981 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.002s
I20260709 13:13:25.308523 28653 rpcz_store.cc:276] 0709 13:13:22.054089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.382188 (+328099us) service_pool.cc:224] Handling call
0709 13:13:24.273371 (+1891183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.273606 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:24.273646 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.273696 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:24.273742 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.273812 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.307863 (+1034051us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540001c2d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:25.307973 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4348447488}
I20260709 13:13:25.343763  1874 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.345597 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:25.348738  2044 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:13:25.350925  2146 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 13:13:25.350948 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:25.463992 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 113122us
W20260709 13:13:25.352643  2071 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.831s	user 0.016s	sys 0.002s
W20260709 13:13:25.355588 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85268.3us
W20260709 13:13:25.358165 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 201443us
I20260709 13:13:25.317768  2126 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:25.381052 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:25.474685 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 93749.6us
I20260709 13:13:25.475829 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:25.381245 29260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1694) took 1837 ms (client timeout 1522 ms). Trace:
W20260709 13:13:25.476954 29260 rpcz_store.cc:269] 0709 13:13:23.543723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.556651 (+ 12928us) service_pool.cc:224] Handling call
0709 13:13:25.380981 (+1824330us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54006b8ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:25.381155 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372478848}
I20260709 13:13:25.315142  2052 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.390761 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.391405 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.391316 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.392495 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:25.431733  2082 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.397534  2123 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:25.415443 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.492430 28727 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:13:25.276069  2048 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.000s
I20260709 13:13:25.450735  1892 consensus_queue.cc:1059] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:13:25.506011  2048 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.468779  1857 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:25.446899  1926 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.513469  2048 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.458990 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1289) took 1133 ms. Trace:
W20260709 13:13:25.460346 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 114811us
I20260709 13:13:25.469079 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:25.521617 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52644.5us
I20260709 13:13:25.520854 28651 rpcz_store.cc:276] 0709 13:13:24.325608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.325761 (+   153us) service_pool.cc:224] Handling call
0709 13:13:24.338460 (+ 12699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:24.338857 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:24.338900 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:24.344319 (+  5419us) log.cc:844] Serialized 26 byte log entry
0709 13:13:25.312088 (+967769us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b1800206200. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:25.403602 (+ 91514us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:25.403655 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.403742 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:25.449327 (+ 45585us) raft_consensus.cc:1685] finished
0709 13:13:25.449352 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.458898 (+  9546us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27633,"raft.queue_time_us":2976,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6712,"spinlock_wait_cycles":4076416,"thread_start_us":91302,"threads_started":1,"wal-append.queue_time_us":1083866}
I20260709 13:13:25.523240 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.524374 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:25.481554 28730 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.479915 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.521612 28695 leader_election.cc:400] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:25.525664 28695 leader_election.cc:403] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:25.450255  2062 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:25.494459 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 102052us
I20260709 13:13:25.530529 28696 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:25.489209  2042 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:25.453624  1982 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:25.450924  2088 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:25.513116 28581 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:25.455646  1894 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.516817  1874 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:25.493381  2122 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:25.553196 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:25.479442  2071 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:25.474318  2066 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:25.519120 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:25.556385 28649 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:25.504024  2103 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:25.463589  1981 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:25.533393 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53600.2us
I20260709 13:13:25.559280 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:25.532377 28696 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:25.560981 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:25.539554  2126 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:25.539212 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:25.536724 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:25.541098 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.518263  1857 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:25.553591  2122 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:25.552696 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:25.552882 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:25.554186 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:25.571123 28655 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:25.542377  2044 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:25.540463  1982 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:25.538388 28730 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:25.562146 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:25.569998  2122 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:25.576112 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:25.576736  1575 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:25.577486  2052 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:25.577983  2069 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:25.574139  1980 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.579018  1980 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.579397  1980 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.580507  1982 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.561404  1171 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:13:25.565203 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.541731  2051 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:25.533357  1929 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:25.569828  1857 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:25.570998 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.529966  2090 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:25.553575  2020 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.578583  2069 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:25.560748  1965 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:13:25.537294  2042 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.587086 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:25.557379 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.617220 28652 raft_consensus.cc:2368] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
W20260709 13:13:25.623461 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 66171.2us
I20260709 13:13:25.624432 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:25.625735 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.625684  1575 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:25.618536 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 77551.3us
I20260709 13:13:25.570106  2082 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:25.569921  1894 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:25.589145  2088 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:25.589818 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:24.778621 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:25.747376 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 170391us
I20260709 13:13:25.743562 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:25.702643 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 136775us
I20260709 13:13:25.706163 28575 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:25.671139 28572 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:25.746795  2051 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:25.577932  2052 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:25.623443  2012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.372s	user 0.014s	sys 0.027s
I20260709 13:13:25.613240 29253 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:25.628826 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:25.784855 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 156094us
I20260709 13:13:25.787315 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.788196 28723 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:25.622663  2042 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.627887  2048 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:25.626709  2093 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:25.706575  1851 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:25.564118  1874 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:25.841296 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47512.4us
I20260709 13:13:25.684437  1981 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.626823  1910 raft_consensus.cc:3055] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:25.789531 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.851814 28725 raft_consensus.cc:2376] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14. Re-sending same reply.
I20260709 13:13:25.790683 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.790900 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.791960 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.793066 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.742220  1665 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:25.687083 29223 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:25.629194  1575 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:25.627593  1982 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:25.628681  2020 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:25.774479  2058 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:25.770632 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:25.779346  1929 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:13:25.770305  1894 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.784564  2052 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:25.847697 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.847250 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.848062 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:25.784192  2012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.533s	user 0.016s	sys 0.067s
I20260709 13:13:25.657835  2126 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
I20260709 13:13:25.849797  1910 raft_consensus.cc:740] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:25.916953 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 1.24319e+06us
I20260709 13:13:25.661298  2147 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.182s
I20260709 13:13:25.710599  1889 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:25.782771  2075 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:13:25.875017 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.927326 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.869082 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.774408  1432 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:13:25.928931 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.840626  2048 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.929780  2048 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.930142 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.931365 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.937348  2126 consensus_queue.cc:1243] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:25.903733  2020 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.940210 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1708) took 1555 ms. Trace:
I20260709 13:13:25.940806 29253 rpcz_store.cc:276] 0709 13:13:24.385353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.762284 (+376931us) service_pool.cc:224] Handling call
0709 13:13:25.939953 (+1177669us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540048ab54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:25.940131 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842971392}
W20260709 13:13:25.944039 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 184716us
I20260709 13:13:25.911979  2044 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:25.842388  1874 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.782704  2007 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:13:25.786818  2090 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:25.901340 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 214306us
W20260709 13:13:25.876085  2166 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:13:25.850907  2165 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 13:13:25.905804  1171 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:25.959720  1171 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:25.949323  2080 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.572s	user 0.013s	sys 0.000s
I20260709 13:13:25.744774  1857 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:25.911327  1894 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:25.914399 28722 raft_consensus.cc:2376] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14. Re-sending same reply.
I20260709 13:13:25.645716  2062 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.844046 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:25.997537 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 153581us
I20260709 13:13:25.997802  1432 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.998327  1432 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.999121 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.000236 28654 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:26.000605  1432 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:25.774420  2122 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.001526 28649 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:13:26.002421  2122 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.003000  2122 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:26.003077 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:25.945101 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 189290us
I20260709 13:13:25.886737  1665 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:26.004769 28573 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:26.005281 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.005590  1665 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.006872  1665 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:26.007588 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.879103  1851 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:13:26.009997  1851 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.010509  1851 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.001572 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:26.013032 28572 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:26.004802 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:26.013465 28572 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:26.014377 28572 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.917104  2002 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:25.952416 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:25.956413 28648 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 16. Ops: []
I20260709 13:13:26.025089 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:25.963001  1929 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:25.974717 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.976262  1171 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.969969 28621 leader_election.cc:400] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19.
I20260709 13:13:26.028801 28621 leader_election.cc:403] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:25.950696  1874 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:25.978546 28724 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:25.979897  2080 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:25.979442 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:25.976976  1910 consensus_queue.cc:260] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:25.985955 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:26.035781 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:25.990191 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2881) took 1009 ms. Trace:
I20260709 13:13:25.991657 29256 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:26.003468  2122 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:26.036811 28652 rpcz_store.cc:276] 0709 13:13:24.980990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.981116 (+   126us) service_pool.cc:224] Handling call
0709 13:13:25.989915 (+1008799us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54003a93d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:25.990109 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383270144}
I20260709 13:13:26.015007 28581 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:25.990355 28725 raft_consensus.cc:2410] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:13:26.042181 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 89853.4us
I20260709 13:13:26.016201 28572 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:25.683169  2069 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.000998 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:25.947033  2044 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:26.004878 28649 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:26.014967  1851 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:25.904824 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 134294us
I20260709 13:13:25.966750  1889 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:13:26.025808 28575 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:26.026963  1924 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:26.038897 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:25.958089  1981 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:26.040658 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:25.906118  2169 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:13:26.064491 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:26.064687 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:26.065531 28727 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:26.044948 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:26.046609 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 580714us
I20260709 13:13:26.066725 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:26.047353 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 3075) took 1683 ms. Trace:
I20260709 13:13:26.016111 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.051991 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:26.067514 28578 rpcz_store.cc:276] 0709 13:13:24.363751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.367228 (+  3477us) service_pool.cc:224] Handling call
0709 13:13:26.047148 (+1679920us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54000eced4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:26.047296 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296483072}
I20260709 13:13:26.068044 28722 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:26.060004 28728 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:26.070083 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:26.052973 28580 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:26.043552 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.062167 28575 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:26.057348  1924 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:26.070749 28728 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:26.046032  1910 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:26.049626  2044 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:26.080163 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.080963 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.056869  1851 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:26.077466  2018 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:26.090145  1432 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:26.091431  2124 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:26.059064  2042 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.093389  1926 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:26.077950  2007 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:26.094321 28729 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:26.108826 28729 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:26.109119 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:26.080281  2051 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:26.097848 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.035813  1929 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.032364  2002 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.107788 28728 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:26.116547 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:26.061252  2071 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:13:26.118214 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:26.124886 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 155011us
I20260709 13:13:26.154711 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:26.124653 28722 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:26.158373 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:26.096472  2174 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19.
I20260709 13:13:26.109764 28729 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.069866  1981 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.070218  2052 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.170616 28729 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:26.108918  2124 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:26.182933 28724 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:26.113122  2007 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:26.188046  2058 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:26.189051  2058 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:26.198380  2002 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.199079  2002 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:13:26.201050  2172 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:13:26.203747  2080 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.206552  2042 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.161696  1924 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.154861  2176 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:26.199115  1889 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:26.220079 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:26.108496  1432 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.177470  2051 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:26.215343 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.226439  1171 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:26.226591 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 212534us
I20260709 13:13:26.209404  2007 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:26.198379  1929 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:26.113602  2122 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.237466 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.225255  1924 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:26.219043  1857 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:26.234524  1980 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.001s
I20260709 13:13:26.225574  1889 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:26.245481 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:26.245983 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:26.251794 28724 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:26.246291 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.233726  2051 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:26.257974 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:26.258363 29257 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:26.257905 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.260501 29254 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:26.261711 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:26.262645 28655 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:26.264312 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:26.266557 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.267891 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.263489 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.269282  1889 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.227300  2048 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.274895  2048 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.276014  2051 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.234440  2020 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.254052  1980 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.280761 28656 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:26.281307 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.281505 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.281962  2020 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.252737 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:26.240842  1963 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.797s	user 0.012s	sys 0.001s
I20260709 13:13:26.247139 28729 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:13:26.255916 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:26.293937 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.294354 28647 raft_consensus.cc:2368] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:26.257258 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.295046 28654 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:26.282855  1980 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.283110  1432 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.244630  1929 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:13:26.251408  2124 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.283730 28650 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:13:26.284647 29255 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:26.285348 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.304908 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.295157 28648 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
W20260709 13:13:26.248250 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 158438us
I20260709 13:13:26.298353 28572 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:26.300284  2178 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.309270  2178 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.309643  2124 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:26.311455  2178 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.234892  2179 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:13:26.303496  1963 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.313675  2183 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:26.315049  1963 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:26.307701 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.316149 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.317807  1981 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.296140 28729 pending_rounds.cc:85] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 9
I20260709 13:13:26.318864 28729 pending_rounds.cc:107] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:13:26.282018 28652 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:26.319811 28729 raft_consensus.cc:2889] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:26.322006 28729 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:26.326838 28729 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:13:26.329989 29258 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:26.330385  1963 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:26.364108 29254 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:26.365751 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.366776 29254 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:26.371500 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.372944 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.373520 29259 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:13:26.373711  2184 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.372967 29258 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:26.374253  2184 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.376688 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:26.377393 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.379227 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.380648 28574 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:13:26.380548 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.384927 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.377420 29260 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:26.388072 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:26.388252 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.394673 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:26.395190 28724 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:26.395421 28572 raft_consensus.cc:2368] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:26.396538 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:26.397429  2183 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:26.397930  2183 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:26.398867  2183 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:26.406435 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.420451 28547 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:26.420827 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.422017  1910 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:26.423240  2137 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:26.423868  2137 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:26.425967  2082 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:26.423974  1910 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:13:26.433830  2171 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.485s	user 0.003s	sys 0.000s
I20260709 13:13:26.436277 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.439330 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.446874 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.448153 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:26.448879  1928 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:26.449527 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.449868 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:26.505932 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 56487.7us
I20260709 13:13:26.506974 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:26.510172 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.455065 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 219206us
I20260709 13:13:26.319442  2180 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:26.361145  2126 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:13:26.461504 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.512694 28722 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:13:26.526876 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 408703us
I20260709 13:13:26.527802 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.528932 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:26.529763 28722 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:26.530056 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:26.530437 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:26.515027 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 360386us
I20260709 13:13:26.510139 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:26.533927 28724 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:26.545984 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.550614 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.513805  1851 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:26.524477  1857 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:26.537492  2088 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.001s
I20260709 13:13:26.532240  2185 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:26.566380 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:26.537132  2179 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:26.567178 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.562685 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 478200us
I20260709 13:13:26.562682 28695 leader_election.cc:400] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:26.538573  2093 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:26.565397 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:26.571928 28695 leader_election.cc:403] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:13:26.497942  2137 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.551658  2052 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.581570 28723 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:26.585053  1432 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:26.585565  1432 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.585917  1432 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:26.586423  2184 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.588312  2021 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:13:26.595515  2181 log.cc:927] Time spent T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:13:26.595755  1851 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.524799  2180 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.604502 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.600920  1857 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:26.583405  2175 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:26.575235  2179 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:26.611478  1665 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.007s
I20260709 13:13:26.568773  2174 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:13:26.613575  2062 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:26.608422  2002 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:26.622093  1894 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.000s
I20260709 13:13:26.638495 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:26.622885  2179 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:26.652460 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.695039 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.695222  2189 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:26.695456  1982 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:26.695992  2189 consensus_queue.cc:1243] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:26.696305  1982 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:26.696672  1982 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:26.697113  2071 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:26.700017 28576 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:26.700416 28572 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:26.702315 28580 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:13:26.703871  1432 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:26.705547 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 139234us
W20260709 13:13:26.713691 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 148405us
I20260709 13:13:26.714768 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:26.660842  2002 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:26.640265  1894 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.723508 29254 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:26.722836 29224 leader_election.cc:336] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.510s (SENT)
I20260709 13:13:26.729875 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:26.717705 28580 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:26.721180  1432 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.731345  1432 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:26.731689 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.734673 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.702335  2191 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.737694  2187 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:26.752703 28651 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:26.753931 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.740517  1929 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:26.740762  2192 log.cc:927] Time spent T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:13:26.740762  2195 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:13:26.780292 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.743454 28649 raft_consensus.cc:1240] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:26.738268  2188 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:13:26.782081  2188 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:13:26.782232  2193 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:13:26.782487  2188 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:26.783211  2194 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:13:26.746928  2044 consensus_meta.cc:287] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.002s
I20260709 13:13:26.748030 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:26.748574 28656 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:26.739940  1432 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:26.757362  2183 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:26.801523 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:26.705271  1982 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.750630 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:26.802862  1982 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:26.751780 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:26.805893 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:26.779603  2007 consensus_meta.cc:287] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.004s
I20260709 13:13:26.806564 28725 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:26.806617  2007 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.757185 28580 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:26.765264  2187 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:26.801388 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.812598  2187 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.813269  2018 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:26.813673  2018 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:26.814553  2018 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.767772  1929 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:13:26.767972  1874 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.722s	user 0.003s	sys 0.007s
I20260709 13:13:26.768473  2182 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:26.770509  2086 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:13:26.601593  2021 consensus_queue.cc:1175] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ed517a03edd141a798f07798667c1c04" responder_term: 16 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: [15.12-15.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:26.784621 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.838057 28572 raft_consensus.cc:2410] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:13:26.785301 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.786329  2093 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:26.785881  2002 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.787067 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.783437  2188 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.842222  2086 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:26.749106 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:13:26.843618 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 94586.9us
I20260709 13:13:26.796504 28654 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:13:26.796948 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:26.797816 28581 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:26.845283 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:26.758589  2191 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.859736  2191 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:26.799355 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:26.799592  2012 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:26.800485  1894 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.801476 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:26.814265 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:26.767592  2147 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:26.865481  1575 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:26.865914  1575 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:26.842731  2188 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:26.838688  2008 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.867883  2008 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.805963 28653 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:26.869903  2008 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.818012 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.842711  2086 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:26.874042 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56120.2us
I20260709 13:13:26.874114  2086 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.875085 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.875813  2086 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:26.876312 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:26.824918 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:26.827299 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.877163  1929 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:26.878387  2191 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:26.819060 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:26.881393 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62373.7us
I20260709 13:13:26.881495  2008 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:26.882145  2008 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.882470  2008 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:26.844652  2093 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:26.839064 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.839161 28576 raft_consensus.cc:2410] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:13:26.887282 28726 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:26.888512 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:26.842065  2018 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:26.890740  2008 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:26.892164 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.839864  1874 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.795691  2044 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.900473  1874 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.901489  2008 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:26.902009  2044 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:26.902912 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 101520us
I20260709 13:13:26.903798 28721 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:26.843825 28573 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:26.798607 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:26.846071 28725 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:26.905959 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:26.856848  2052 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:26.856972  2090 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:26.909729  2090 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.861603 28574 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:26.913074  2183 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:26.862210 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:26.914726 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52622.5us
I20260709 13:13:26.863865 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:26.866786  1575 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.917544  2175 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:26.917973  1575 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:26.918478  2175 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:26.919759  2207 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:13:26.751587  1857 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:26.921569  1857 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:26.922982  1894 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:26.824510 29254 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:13:26.923511  1894 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.924091 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:26.924726  2186 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:26.925138  2186 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:26.926014  2186 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.927294  2186 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:26.927672 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.928918 29260 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:13:26.930982 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 67175us
I20260709 13:13:26.933442 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:26.919770  2175 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:26.934136 28730 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:26.938773 28723 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:13:26.938714 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 54074.7us
I20260709 13:13:26.936656 28726 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
W20260709 13:13:26.940888 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 64670.4us
I20260709 13:13:26.943643 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:13:26.941285 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.945967 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:26.946733 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:26.947924  1432 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:26.948746  1432 consensus_queue.cc:1243] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:26.951435 28622 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:26.951514 28730 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:26.951653 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:26.888830  2202 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.912822  2090 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:26.970342 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.884904  2093 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:26.953182 29259 raft_consensus.cc:2393] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
W20260709 13:13:26.995518 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 44134.4us
I20260709 13:13:27.062297 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:27.013036 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 68099.3us
I20260709 13:13:27.021817 28655 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:27.037562 28653 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:27.043840 29252 raft_consensus.cc:2410] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:13:27.044433 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 110973us
W20260709 13:13:26.953127 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.955338 28725 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:26.956540 29256 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:26.943862  1963 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:27.063555 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:27.067174 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:26.952894  2020 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:27.073900 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:27.067905  1432 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:27.073261 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:26.962589  1981 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:13:27.084668 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 83680.8us
I20260709 13:13:26.957666  1928 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:26.944042  2082 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.130s
I20260709 13:13:26.935456  2179 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:26.951619  2174 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 13:13:27.068346  2151 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:27.153923 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 80114.2us
W20260709 13:13:27.079553  2165 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 13:13:27.063674  2188 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:27.041795  2184 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.098s
W20260709 13:13:27.147338 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 243204us
I20260709 13:13:27.187083 28730 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17. Ops: [15.13-16.14]
I20260709 13:13:27.188100 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:27.189268 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 118711us
I20260709 13:13:27.189774 28723 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:13:27.190655 28728 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:27.193753 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:27.194521 28653 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:27.149735  2171 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:13:27.044191  2202 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.090950  1980 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:27.082774  1981 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:27.181339 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 219062us
I20260709 13:13:27.152889  2124 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.140527  2191 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:27.193173 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:27.195696 28648 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:27.189971  1432 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:13:27.191658 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:27.200598 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.279412 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 117466us
I20260709 13:13:27.168327  1575 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.159415  2203 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:27.280400 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:27.288488 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:27.311800 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:27.290805 28651 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:27.312424 28723 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:27.298493  2188 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.299669 28653 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:27.305073 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:27.198117  2126 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.314348 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:27.182982  1928 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.126s
I20260709 13:13:27.329749 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:27.358733 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:27.366043 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:27.364643 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:27.304059  1857 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:27.307314  2191 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:27.389148 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.370357  2093 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:27.422668 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.308265  2124 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:27.374333  2012 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:27.364962  1924 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:27.329519  1575 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.375196  1981 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:27.450068  1981 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:27.450165  2188 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.451103  1575 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.452205  1924 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.452854  1924 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:27.454031  1982 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.001s
I20260709 13:13:27.377961  2191 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:27.432138  2220 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:13:27.434180  2227 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:13:27.435307  2216 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:13:27.436975  2212 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
W20260709 13:13:27.437716  2215 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:13:27.458702 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1736) took 1240 ms. Trace:
I20260709 13:13:27.459101 28729 rpcz_store.cc:276] 0709 13:13:26.218167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.335017 (+116850us) service_pool.cc:224] Handling call
0709 13:13:26.335329 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:26.335792 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:26.335832 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:26.336386 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:13:26.810566 (+474180us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b1800341c20. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:26.986772 (+176206us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:27.066909 (+ 80137us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.067144 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.067229 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:27.458385 (+391156us) raft_consensus.cc:1685] finished
0709 13:13:27.458489 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.458643 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81651,"raft.queue_time_us":1677,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":81645,"spinlock_wait_cycles":52146560,"thread_start_us":175915,"threads_started":1,"wal-append.queue_time_us":714446}
I20260709 13:13:27.438445  2202 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.413962  1894 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.462648 28729 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:27.414386  2229 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:27.441495 28730 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:13:27.442127  2218 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:13:27.442489  2224 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.444248  1926 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.379252  1857 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:27.414170  1963 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:27.447503  2124 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:27.448401  2018 consensus_meta.cc:287] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.002s
I20260709 13:13:27.369722  2223 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:13:27.367229  2126 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.429826 28725 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
W20260709 13:13:27.497938 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.531282 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 445572us
W20260709 13:13:27.531764  2175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.000s	sys 0.012s
I20260709 13:13:27.534458  1926 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.540164  1926 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:27.543859  2175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.012s
W20260709 13:13:27.551962  2186 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.610s	user 0.002s	sys 0.007s
I20260709 13:13:27.417054 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:27.557577 28473 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:27.565593 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:27.573607 28578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.007s	sys 0.010s
W20260709 13:13:27.574345 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 270312us
I20260709 13:13:27.559588 28473 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 6 to 14, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 14 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:27.535717  2229 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:27.576954 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:27.564064  2184 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.583877 28729 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:13:27.586125 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 216625us
W20260709 13:13:27.595359  2221 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.408s	user 0.004s	sys 0.000s
I20260709 13:13:27.596024  1857 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:27.597128  2229 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:27.588217  2186 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:27.589293  2126 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.587044  1963 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:27.603152 28647 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:27.635149 28654 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 13:13:27.582157 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:27.611195 28695 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:27.604869 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:27.604351 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:27.528323  2224 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.639969 28695 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:27.640486  2224 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.618803 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:27.619722  1963 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:27.620610  2238 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:13:27.621155  2223 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:27.623543  2217 log.cc:927] Time spent T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:13:27.638536 28651 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:27.643283 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:27.609562  2184 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.655753  2126 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:27.661883 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:27.664484 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:27.647969  2124 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:27.647020  2238 consensus_queue.cc:1243] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:13:27.661603  2052 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:27.670166 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:27.675089 28651 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:27.668154 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:27.672102 28578 pending_rounds.cc:85] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 11
I20260709 13:13:27.646046  2236 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:27.664155  2151 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:27.678787 28578 pending_rounds.cc:107] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:13:27.679026 28581 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:13:27.680797 28578 raft_consensus.cc:2889] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:27.668255  1851 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:27.685997 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:27.688622 28723 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:13:27.689958 28723 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:27.691932  1924 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:27.694363  1924 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:27.696844 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:27.660632  2223 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.677055  2238 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.664705  2126 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.704385  2126 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.687479  2151 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.721936  2238 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:27.724100 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.699846  1874 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:27.729698  1874 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:27.730263  1874 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:27.687698  2052 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:27.742266  2052 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.706415  2151 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.747216  2151 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.700215  2184 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.706423  2191 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.754779  1874 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:27.755587  2191 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:27.755865  2180 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.756378  2223 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.757776  1874 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:27.759119  2238 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.774742  2185 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:27.775585  2185 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:27.776849  2185 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.781934  2185 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:27.785658 29252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1689) took 1540 ms (client timeout 1570 ms). Trace:
W20260709 13:13:27.786140 29252 rpcz_store.cc:269] 0709 13:13:26.245297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.245446 (+   149us) service_pool.cc:224] Handling call
0709 13:13:27.785360 (+1539914us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54005f0fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:27.785580 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791347584}
W20260709 13:13:27.839159 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.849653 28728 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:27.852093 28653 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:27.859607  2007 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:27.862977  2122 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.864076  2122 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.871495  2122 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.876273 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:27.878064 28578 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:27.878202 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 2667) took 1133 ms. Trace:
I20260709 13:13:27.878839 28655 rpcz_store.cc:276] 0709 13:13:26.744752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.744873 (+   121us) service_pool.cc:224] Handling call
0709 13:13:27.877715 (+1132842us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b540001c7d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:27.877972 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227906432}
I20260709 13:13:27.883599 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 1944) took 1188 ms. Trace:
I20260709 13:13:27.886022 29255 rpcz_store.cc:276] 0709 13:13:26.694958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.697885 (+  2927us) service_pool.cc:224] Handling call
0709 13:13:26.698193 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:26.698386 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:26.830109 (+131723us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.079575 (+249466us) log.cc:844] Serialized 14 byte log entry
0709 13:13:27.623019 (+543444us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:27.882303 (+259284us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b18004aaf40. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a24d2ba40 00007f4a24d264e4 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:13:27.882739 (+   436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:27.882825 (+    86us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:27.882953 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.883098 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:27.883303 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85376,"prepare.queue_time_us":90601,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":87107,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7558,"spinlock_wait_cycles":26432128,"thread_start_us":340781,"threads_started":2,"wal-append.queue_time_us":336654}
I20260709 13:13:27.890563  1929 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:27.914135  2002 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:27.915119  2002 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:27.922731  2179 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.914175  2021 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.924603  2021 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.927732 28654 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:27.928645  2021 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:27.929844 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507239c483484d3abb552ab606bfd45c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:27.931195 28572 raft_consensus.cc:606] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:27.931983 28572 raft_consensus.cc:614] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:27.931243  2002 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.934087  2002 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:27.934178 28721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 1730) took 1978 ms (client timeout 1987 ms). Trace:
I20260709 13:13:27.938046 28727 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:13:27.939745  2090 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:27.940066 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2375) took 1931 ms. Trace:
I20260709 13:13:27.940635  2090 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:27.943910  2090 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:27.946280 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 53856.8us
I20260709 13:13:27.947551  2233 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:27.948354 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:27.897476  2122 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.949597  2122 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.953125  2122 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:27.957953 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 56774.6us
I20260709 13:13:27.969120  1665 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:27.973035  2093 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:27.934926 28721 rpcz_store.cc:269] 0709 13:13:25.955900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.064226 (+108326us) service_pool.cc:224] Handling call
0709 13:13:27.933524 (+1869298us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54001275d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:27.933882 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1928108800}
I20260709 13:13:27.974047  2093 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.977437 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:27.978389  2093 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:27.979399  2233 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:27.979511 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:27.980182  2233 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:27.980455 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:27.940697 28727 rpcz_store.cc:276] 0709 13:13:26.008761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.206584 (+197823us) service_pool.cc:224] Handling call
0709 13:13:27.937234 (+1730650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:27.938736 (+  1502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:27.939691 (+   955us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54001275d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:27.939945 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3978986752}
I20260709 13:13:27.985100  2007 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:27.995467 28578 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:27.999250 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:28.002213  2183 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.002600 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.003556  1892 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.004956  2178 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:28.003193  2052 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.005362  1910 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:28.006471 28728 raft_consensus.cc:2368] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:28.006163  2052 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.992053  2007 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:27.996454  2233 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:28.017441 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 943939us
I20260709 13:13:28.014173 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.003198  2183 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:28.021675 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.021971 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.040544  1857 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.041385  1857 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.042892  2179 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:28.045475  2175 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:28.046576 29252 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 20: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:28.049561 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.057214  1889 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:28.057739  1889 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:28.058760  2183 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:28.058880  1889 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.060592  1889 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:28.063351 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.064175 29259 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:28.065357 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:28.066063 28721 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:28.066736 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.067440 29258 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:28.070349 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.073539 28726 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:28.073261 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.075718  2007 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.080631 29254 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:28.004412  1892 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.081506 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.082288 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.067498  2052 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:28.082954 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 429294us
I20260709 13:13:28.066109 29260 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:28.089257  2048 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:13:28.090261  1892 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.094738  2007 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:28.095808  2007 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.100068  2007 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.091636 29255 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:28.088563 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:28.107600 29252 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:28.108372  2048 consensus_queue.cc:1243] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:28.109570  2048 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:28.110028  2048 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:28.111574  2048 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.113574 29259 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:13:28.114080 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.114862 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.115509 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.116012 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.116459  2256 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.116910 29258 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:28.131522  2007 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.132411  2007 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:28.117316  1857 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.135087  2007 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:28.136425 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.145608 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:28.147814 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59450.7us
I20260709 13:13:28.146693 28473 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 12, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 12 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:28.149060  2021 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:28.117259  1665 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:28.118047  2182 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.141250  1857 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:13:28.156029 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.154496 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:28.159171 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 114921us
I20260709 13:13:28.140762  2256 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.164270 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.167548 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.176147  2137 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:28.172940 29252 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:28.168040  1857 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:28.176544 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.179203  2257 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:28.180191 29258 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:28.167510  1665 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:28.183804 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 151623us
I20260709 13:13:28.185714 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.186733 28578 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:28.189285  2048 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:28.189674 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.192960 29259 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:28.195366 28578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:28.207337 28578 raft_consensus.cc:606] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:28.194943 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:28.197522 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48760.4us
I20260709 13:13:28.209030 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:28.210734 28721 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:28.191529  2021 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:28.210765 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.194927  2058 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:13:28.218379  2062 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.180632  2182 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.219316  2062 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.219938  2183 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:28.220813 29260 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:28.220809  2183 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.221542  2182 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:28.223219  2179 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.224000  2179 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.195616  2093 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:28.197633  2090 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.229440 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:28.196522  1665 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:28.210264  2256 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:28.219362  2058 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:28.235322 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.235896 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.235471 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.224032  2183 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.243916 29259 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:28.244400  1851 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:28.244951  2179 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:28.245698 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.245841  2258 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.240293  2058 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:28.246452  2258 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.247457  2058 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:28.243950 29258 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:13:28.247994 29251 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:28.196142  2007 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:13:28.230154  2093 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.250847 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:28.255733 28730 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:28.248898  2058 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:28.261266 29260 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:28.259428 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.253504  2093 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:28.196539  1857 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:28.267189 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.237049  2021 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.270639 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.273324 29258 raft_consensus.cc:2410] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:13:28.272610 29252 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:28.256361  2090 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.263748  1892 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:28.196785 28473 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 15, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:28.288975 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.290532 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.291247  2062 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:28.284510  2256 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:28.293413  1892 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:28.305419 29251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1693) took 1482 ms (client timeout 1648 ms). Trace:
I20260709 13:13:28.305982  1892 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.306470  2012 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:28.307566  2012 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.297426  2090 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.301491 28581 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:13:28.310642 28730 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:28.315676 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.317394 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.318351 29252 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
W20260709 13:13:28.306030 29251 rpcz_store.cc:269] 0709 13:13:26.823326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.824611 (+  1285us) service_pool.cc:224] Handling call
0709 13:13:28.299674 (+1475063us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54007562d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:28.305319 (+  5645us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3151678848}
I20260709 13:13:28.323499  2021 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:28.329717  2185 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.019s
W20260709 13:13:28.331128 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 68784.5us
I20260709 13:13:28.334479  2002 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:28.335147 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:28.335367  2012 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.336027  2002 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:28.335943  2175 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:28.336652  2002 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:28.337076  2176 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:28.337597  2176 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.338011  2176 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:28.339519  2223 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:28.340564 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.341292  2223 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:28.341774  2002 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.342284 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:28.342056  2223 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.343642  2002 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:28.344836  2223 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.341586 28572 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:28.345329 28473 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 14, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 14 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.341567 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.353192 28620 leader_election.cc:400] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:28.326288 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.353819 28620 leader_election.cc:403] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:13:28.354158 29258 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 7.
I20260709 13:13:28.348232 28473 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 5 to 6, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 6 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:13:28.354657 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 71840us
I20260709 13:13:28.355962 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.356992  1851 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:28.358014  1851 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:28.360606  2175 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:28.362255 28572 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:28.362915 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.363584 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.363821 28647 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:28.364733 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.364991 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.365849 28573 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:28.365959 28576 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
W20260709 13:13:28.369808  2263 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.158s	user 0.001s	sys 0.001s
I20260709 13:13:28.370469 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.371404 28654 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:28.373713  2228 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:28.374352  2228 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:28.375561  2228 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:28.378252  2228 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:28.383925 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 152728us
I20260709 13:13:28.384616 28574 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:28.386812 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85167.3us
I20260709 13:13:28.340544 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:28.397552 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 82265.3us
I20260709 13:13:28.399499 28696 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.401464 28696 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.386112 28575 raft_consensus.cc:1217] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Deduplicated request from leader. Original: 12.6->[13.7-13.7]   Dedup: 13.7->[]
I20260709 13:13:28.409175 28575 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:13:28.316638  2258 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:28.409210 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 68881.1us
I20260709 13:13:28.413535 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.411825 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.336936  2012 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:28.416726 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:28.419231 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.418387 29258 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:28.428622  2122 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:28.429324  2122 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.429773  2122 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:28.433636 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.433863  2223 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:28.434659 29253 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:28.353219  2179 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:28.437393 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:28.438374 28474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 391) took 24653 ms (client timeout 15000 ms). Trace:
W20260709 13:13:28.442466 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47114.3us
I20260709 13:13:28.414528  1892 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:28.444550 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:28.454751 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 122000us
I20260709 13:13:28.440654  2012 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.457238 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.458163 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:28.464119 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46601.3us
I20260709 13:13:28.410264  2021 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:13:28.449692  1892 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.493222  1892 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:28.496025 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.496251 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:28.498199  2052 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:28.498741  2052 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.499161  2052 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:28.445304  2090 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.472987  2269 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:28.475843 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.503276  2090 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:28.504372 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54245us
I20260709 13:13:28.477979 28578 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:28.486642 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.486905 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.489496 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.489274  1910 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:28.512394  1910 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:28.512262 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.513571 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:28.513842 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.514266 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.515013 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.463320  2012 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:28.515038 28649 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:28.515934 28576 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:28.516986  2048 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:28.457932  2223 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:28.518316  2223 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:28.518850  2223 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:28.503297  2269 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.519922  2269 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:28.512791  1910 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:28.522163  1910 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:28.522799  2266 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:13:28.523726  1910 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:28.524785 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:28.527910  2271 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:13:28.404961 28473 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 13 to 14, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 14 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:28.510555 28573 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 8.
I20260709 13:13:28.530162 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:28.510735  2258 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:28.531288  2183 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:28.531713  2183 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.532044  2183 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:28.534616 28473 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 7 to 11, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 11 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.537385  2179 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:28.537842 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:28.538528 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:28.538417 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:28.539148 28729 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:28.506505  2090 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:28.540194 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:28.540777  2090 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:28.541301  2090 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.541744 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:28.552042 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:28.552968 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 151601us
I20260709 13:13:28.542601 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:28.543083 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.546489 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.551883 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.559163 28577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:28.553362 28721 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:28.536470  2176 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.557825 28622 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:28.559768 28577 raft_consensus.cc:606] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:28.564570 28577 raft_consensus.cc:614] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:28.540395  2226 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:28.557610  2179 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:28.571019 29223 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.572681 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:28.569608 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.563213  2048 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:28.574812 28581 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:13:28.579150 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 83082.4us
I20260709 13:13:28.552479  2058 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:13:28.567081  1889 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:28.578498  2062 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:28.572242  2226 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:28.579015  2048 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:28.613464 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.577195  2179 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:28.586076 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:28.593993  2062 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:28.640062 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 54037.9us
I20260709 13:13:28.611304  2226 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:28.610776  2007 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:28.641438  2179 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:28.655011  2176 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:28.649868 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 92113us
I20260709 13:13:28.657105 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.666034 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:28.605782  1889 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.667861 28473 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 13 to 15, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 15 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.642998  2062 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:28.667865  2267 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:28.681649  2267 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.682137  2267 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:28.640506  2048 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:28.694621 28653 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 10.
I20260709 13:13:28.664565  1857 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:28.743615  1889 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:28.750156 28473 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 12, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 12 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.751123  2122 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:28.756594 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.766842 28574 raft_consensus.cc:2368] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:28.755620 28647 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:13:28.771116 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 230172us
I20260709 13:13:28.737185  2176 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:28.753559  2090 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:28.775419 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 133204us
W20260709 13:13:28.787767 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 130752us
I20260709 13:13:28.741663  1857 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.752444 28473 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:28.442721 28474 rpcz_store.cc:269] 0709 13:13:03.789997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:03.790339 (+   342us) service_pool.cc:224] Handling call
0709 13:13:28.438077 (+24647738us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:19.492873 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:19.529634 (+ 36761us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:19.529786 (+   152us) write_op.cc:435] Acquired schema lock
0709 13:13:19.529806 (+    20us) tablet.cc:662] Decoding operations
0709 13:13:19.578001 (+ 48195us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:19.594348 (+ 16347us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:19.603729 (+  9381us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:13:19.670392 (+ 66663us) tablet.cc:701] Row locks acquired
0709 13:13:19.670444 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:13:19.670637 (+   193us) write_op.cc:270] Start()
0709 13:13:19.670784 (+   147us) write_op.cc:276] Timestamp: P: 1783602799670562 usec, L: 0
0709 13:13:19.670821 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:13:19.734178 (+ 63357us) log.cc:844] Serialized 9300 byte log entry
0709 13:13:20.147535 (+413357us) op_driver.cc:464] REPLICATION: finished
0709 13:13:20.427100 (+279565us) write_op.cc:301] APPLY: starting
0709 13:13:20.452489 (+ 25389us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:20.682144 (+229655us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:20.682300 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:23.405316 (+2723016us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18004525c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a27b550ec 00007f4a27ba1c0a 00007f4a27ba14f7 00007f4a27ba1490 00007f4a27b58f48 00007f4a2b86d1bb 00007f4a2b8b45d4 00007f4a2b7608da 00007f4a2b7633cb
0709 13:13:23.636154 (+230838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:23.636632 (+   478us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:13:23.636707 (+    75us) write_op.cc:312] APPLY: finished
0709 13:13:23.637352 (+   645us) log.cc:844] Serialized 212 byte log entry
0709 13:13:23.976709 (+339357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:24.036335 (+ 59626us) write_op.cc:454] Released schema lock
0709 13:13:24.069793 (+ 33458us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:24.129333 (+ 59540us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:24.129375 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1698316,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":253134,"apply.run_cpu_time_us":120391,"apply.run_wall_time_us":3713140,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104399,"num_ops":24,"prepare.queue_time_us":171380,"prepare.run_cpu_time_us":39605,"prepare.run_wall_time_us":339940,"raft.queue_time_us":233383,"raft.run_cpu_time_us":22313,"raft.run_wall_time_us":225159,"replication_time_us":444440,"spinlock_wait_cycles":9205632,"thread_start_us":729655,"threads_started":5,"wal-append.queue_time_us":624451,"wal-append.run_cpu_time_us":28760,"wal-append.run_wall_time_us":2271963}]]}
I20260709 13:13:28.777599  2176 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:28.792917  1857 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:28.769860  2226 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:28.843094 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56034.1us
I20260709 13:13:28.815207  2176 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:28.846746  2278 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:28.837934  2090 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:28.865186 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:28.868973 28653 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:28.866251 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.906651 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:28.907553 28573 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:28.863596  2122 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.847358  2273 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:28.913645  2272 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:13:28.927192  2273 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.929944  2273 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:28.934731  2283 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.935532  2283 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:28.937834  2277 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:13:28.939586 28473 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:28.942238  2090 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:28.849180  2278 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:28.963537 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 156865us
I20260709 13:13:28.964365 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:28.920140  2267 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.970096  2283 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:28.970222 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 112395us
I20260709 13:13:28.970782  2283 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:28.971210 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:28.971333  2283 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:28.972651  2226 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:28.973394  2286 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:28.973865  2090 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:28.974558  2090 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:28.975183  2090 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.975637  2276 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:28.976397  2276 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:28.989113 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 207228us
W20260709 13:13:28.990958 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.990067 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:28.997701 28730 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:29.014997 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.015203  2090 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:29.019364 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.019579  2012 consensus_meta.cc:287] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 13:13:29.020117  2012 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.021203  2185 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:29.021864  2185 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.025403  2228 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:29.025883  2228 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.026242  2228 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:29.027953  2179 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:28.965529  2269 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:28.997581  2093 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.722s	user 0.005s	sys 0.008s
W20260709 13:13:29.013269  1892 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.000s
I20260709 13:13:29.041679 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.049821 29259 raft_consensus.cc:3060] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:29.056365 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:29.040897  2052 consensus_meta.cc:287] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.004s
I20260709 13:13:29.038125  2185 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:29.026257  2267 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.062856 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.058975 28574 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:29.039372  2002 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:29.065376 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 72844.8us
I20260709 13:13:29.058064  2007 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.074802 28654 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:29.075338 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.074422 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.078356 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.082057 28653 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:29.083884 28573 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:13:29.079174 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.085453 29251 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.088006 29260 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 20: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:29.087705 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.041559  2093 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.012943  2276 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.088775 28649 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:29.061592  2278 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.090281 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.092885 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:29.096735 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 178720us
I20260709 13:13:29.053535  1892 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.100030 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.106494 28573 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:29.097440 28572 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:29.103590 28656 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:29.078677  2283 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:29.089329  2223 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.007s
I20260709 13:13:29.065362  2052 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.094087  2267 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.136678 28575 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:29.126230  1910 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.004s
I20260709 13:13:29.145128 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.146606 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.145967 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.103931  2269 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.090754  2002 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.190963 29254 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:29.192549 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.193415 28573 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 8: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:13:29.144161  2258 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.005s
W20260709 13:13:29.176205 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.040896 28473 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.136128  2279 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:29.197501  2283 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.210597  2283 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.214414 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.130060  2223 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.125671  2233 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:13:29.121876  2007 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:29.222545 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 178384us
I20260709 13:13:29.147990  2267 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.207530  2258 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:29.192880  2289 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.188380  2048 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.200208  2058 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.237257 28649 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:13:29.239521 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 130549us
W20260709 13:13:29.244867 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.219142  2179 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.255735 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.257233 28573 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:13:29.257081 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 55718.1us
I20260709 13:13:29.257710 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:29.231659  2226 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:29.232226  2012 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.268918 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.279209  2296 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:29.279850 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.279927  2296 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.284200 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.285072 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.285691 28652 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.287004 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.288465  2280 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.289283  2291 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:29.289323 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.289768  2058 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.296864  1892 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.299932 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.301826 28473 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 8 to 9, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 9 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.304796  2223 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.305862  2273 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.249861  2268 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.306958  2267 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.273979  2283 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.345541 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.346362 29256 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:29.265225  2285 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.274346  2303 raft_consensus.cc:2764] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:13:29.258685  2185 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:29.324146 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:29.324419 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61865.7us
I20260709 13:13:29.322988 29254 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:29.325577 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.332156 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.370822 29260 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
W20260709 13:13:29.330567 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 254570us
I20260709 13:13:29.253798  2289 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.372488 28649 raft_consensus.cc:2368] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:29.337534  2052 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.337782 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.339195 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:29.341162  2301 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:29.341641  1857 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:29.309114  2062 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.631s	user 0.004s	sys 0.009s
I20260709 13:13:29.382709 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:29.336572 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61742.1us
I20260709 13:13:29.347496 29259 raft_consensus.cc:2468] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:29.348352 28578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:29.312364 28695 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:29.387181 28578 raft_consensus.cc:606] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:29.387583 28578 raft_consensus.cc:614] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:29.325302  2307 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.377477 28654 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:29.367564  2093 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.323120  2280 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:29.392880 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 80598.6us
I20260709 13:13:29.395864  2002 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:29.432763 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:29.433895  2289 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.434557  2289 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:29.434971  2289 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.435328  2289 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:29.435947 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:29.436803  2012 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:29.437151 28621 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.579s (SENT) [suppressed 41 similar messages]
W20260709 13:13:29.400326  2284 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.264s	user 0.002s	sys 0.002s
I20260709 13:13:29.388697  2062 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.402340 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.326076  2176 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.388223  2180 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:29.403843  2048 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:29.404491 28696 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:29.451048 29251 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
W20260709 13:13:29.406359  2183 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.874s	user 0.012s	sys 0.002s
I20260709 13:13:29.454314 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.408445  2226 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.455123  2226 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:29.455750 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:29.457345  2180 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.458815  2048 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:29.459216  2048 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.459563  2048 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.459936  2180 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:29.410158  2058 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.410820 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.415614  2223 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:29.460886 28649 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:29.461853  2176 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.461948 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.416296  2007 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:29.417256  2122 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:29.463179 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.464349 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.461215 29251 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:29.465216 28649 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:29.466037 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.466557 28649 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:29.419027  2273 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.323302  2291 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.468940  2291 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:29.427930  2307 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.471114  2307 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.406411  1857 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:29.472457 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.472687 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:29.473563 28730 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:29.388595  2185 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.477485  2185 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.440897 28648 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:29.480127 28650 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:29.480398  2062 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:29.369493  2268 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.447904 28652 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:29.448462 29256 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:29.447455 28654 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:29.482993  2268 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:29.453141 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48737.4us
I20260709 13:13:29.485473 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:29.390862  2285 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.486382 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:29.486555 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.487215 29256 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:29.487468  1857 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:29.487931  1857 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.488354  1857 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:29.489349 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.490173 29252 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:29.491113 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.492033  2268 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:29.492285 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.492587  2268 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:29.454236  2183 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.454461  2267 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:29.493420  2267 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.493469 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.493867  2267 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:29.494033 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.495604 28581 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:29.494788 29253 raft_consensus.cc:2368] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:29.496871 28648 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:13:29.499132 28648 pending_rounds.cc:85] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 13
I20260709 13:13:29.506598 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.509868 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.511227 28649 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:29.500301 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:29.511423 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.512442 29259 raft_consensus.cc:2368] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:29.513399 29251 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 21.
I20260709 13:13:29.510738 29254 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:29.523514 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:29.523861 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.524399 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.525050 29255 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:29.525915 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:29.526921  2228 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.006s
I20260709 13:13:29.527367  2228 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.529155  1892 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:29.529265 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:29.529925  1892 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:29.494735  2183 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.531211  1892 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.532522  2226 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.499430 28648 pending_rounds.cc:107] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:13:29.533603 28648 raft_consensus.cc:2889] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.525270  2090 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:29.535615  2090 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.533532  2012 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.537286  2012 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.537953  2090 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.529541  2228 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.539436  2012 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.539954  2185 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.540441  2185 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.525285 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:29.542203 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:29.542289 28650 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:29.535182 28654 raft_consensus.cc:2368] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
I20260709 13:13:29.390339  2296 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:29.537524  2268 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.529994 28721 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.546069 28622 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:29.548712 29256 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:29.572882 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.573835 29255 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:29.574887 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.571974 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:29.580655 28730 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:29.581668 28622 leader_election.cc:400] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:29.582144 28622 leader_election.cc:403] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:13:29.525270  2093 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:29.586771 28728 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:29.579246 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:29.591876 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47202.4us
I20260709 13:13:29.588593 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:29.536726  2048 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.565580  2012 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:29.597352 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:29.598618 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 161517us
I20260709 13:13:29.578979  2296 raft_consensus.cc:2804] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:29.597756  2093 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 21 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:29.604503  2305 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:29.587670  2058 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:29.606199 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:29.605034  2305 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:29.611716  2298 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:29.615075 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.615588 29255 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:13:29.613848 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:29.616598 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:29.612867  2305 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.636075 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:29.531231 28473 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 14, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 14 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:29.607954  2002 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:29.643688 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:29.608747  2226 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.653424 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.660123 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:29.654114 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:29.655788 28578 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:29.650555 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:29.661904 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:29.662233 28651 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.648949 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:29.665509 28575 raft_consensus.cc:2393] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:29.666917 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.666822 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.620452  1910 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:29.660122  2002 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.669730  2002 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:29.670445  2048 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:29.671200  2048 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:29.668910  1910 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:29.674443 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:29.621932  2012 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:29.677389 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 76766.5us
I20260709 13:13:29.675732 28576 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:29.675756 28578 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:29.674686 28622 leader_election.cc:400] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:29.757604 28622 leader_election.cc:403] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:13:29.689621 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.660622  2296 raft_consensus.cc:697] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:29.693333 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.692893  2299 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:29.751068 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:29.678862 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:29.610847  2093 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.686570 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:29.761075 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:29.761946 29255 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:13:29.768862 28721 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:29.770251 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:29.751068 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 60182.9us
I20260709 13:13:29.850538 29254 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:13:29.957082 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 278274us
W20260709 13:13:29.838313 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.772953 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 98404.4us
I20260709 13:13:29.842015 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.830008 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:29.823176 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:29.841693 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.825981 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:29.959838 29252 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:29.857702 28696 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:29.776820 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 127965us
I20260709 13:13:29.871290 28651 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:29.843408 29258 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:29.844261 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:29.964154 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 181796us
I20260709 13:13:29.959370 28581 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:29.959896 29259 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:29.804366 28723 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:29.678902  2012 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:29.978003  2012 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:29.980675 29252 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:29.802620 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:29.982125 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:29.957973 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:29.972371  2291 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:29.962935  2176 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:29.963362  2279 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:29.751868  2090 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:29.853412  2285 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:29.989904  2090 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.771349  2299 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:29.969990 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.762663  2226 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:13:29.783192  2284 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.107s	user 0.005s	sys 0.001s
W20260709 13:13:29.849901  2317 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:13:29.963409 29223 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:30.013688 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55763.4us
I20260709 13:13:29.841907  2048 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:29.963984  2175 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.783018  2273 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:29.818773  2280 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.004602 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:29.686630  1910 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.030928 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:29.985817  2233 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:13:30.010627  2289 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.575s	user 0.002s	sys 0.009s
I20260709 13:13:29.845901  2267 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:29.875557  1857 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:30.028831 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.006758 29224 leader_election.cc:400] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:30.008293  2299 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:30.050570 29224 leader_election.cc:403] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:13:30.049863 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 196388us
I20260709 13:13:29.891477  2296 consensus_queue.cc:237] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.048938  2223 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:30.050748  2007 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:30.086980 28728 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:30.086912 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52470.5us
I20260709 13:13:30.061517 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:30.062204 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69710.6us
I20260709 13:13:30.026782  2309 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:30.091668 28723 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:30.095705 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.058073  2058 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.061190  2291 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:30.047394  2179 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:13:30.049183  2308 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:13:30.041448  2279 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:13:30.047633  2273 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:30.046773  2048 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:30.115713 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 124053us
I20260709 13:13:30.115958  2058 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.116591 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.104781  2223 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:30.050096  2289 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:29.764086 28473 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 11, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 11 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:30.050477  2002 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.050017  2175 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:30.093824  2287 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:30.118472  1889 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:30.118770  2179 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:30.141297  2287 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.141938  2179 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:30.142858  2179 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:30.143635  2287 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.144037  2179 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:30.115753  2090 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:30.107730  2305 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.118163  2223 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.147045  2305 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.147711 28726 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:30.148797  2002 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.130182  2304 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:30.095841  2180 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.117967 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:30.178838 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 60936.8us
I20260709 13:13:30.179656 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.133884 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.123275 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:30.181454 29255 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:30.119853 28729 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:13:30.098435  2321 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:30.119293 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.103356  2309 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:30.116994  2048 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:30.118320  2058 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.175432  2267 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.176312  2291 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.177423  2175 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:30.152592 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:30.185209 28581 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 9.
I20260709 13:13:30.102836  2007 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:30.186663 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 125228us
I20260709 13:13:30.187510 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:30.191192 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:30.194042 29253 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:30.198124 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:30.121042  2289 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:30.118919  1857 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.200958 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.176333  2185 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.189983  2258 raft_consensus.cc:2764] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:13:30.109788  2334 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:30.205488 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.207976 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.212105 28730 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:30.215742 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:30.190923  2002 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.218797 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:30.192370  2279 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:30.211349 28726 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:30.221388 28723 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:30.221983  2293 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:30.202332  2321 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:30.225236  2326 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:30.224900  2309 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.225747  2330 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:30.228133 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:30.231122 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 129834us
I20260709 13:13:30.232236 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:30.234030 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.200758  2273 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:30.201922  1910 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:30.188815  2180 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:30.240280 29251 raft_consensus.cc:2368] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17.
I20260709 13:13:30.240303 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:30.241303 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.244037 29253 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:30.249652 29260 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:13:30.228899  2334 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.253515  2226 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.258836  2226 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.259333  2183 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:30.261075  2185 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:30.246279  2279 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.262277  2226 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.263217  2279 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.246878  1910 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.263865  1910 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:30.263094 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.246558  2052 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:30.265664 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:30.266355 29258 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:30.250943  2321 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:30.268069  2321 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.265734  2052 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.271030  2052 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.271409 28729 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:13:30.268070 28727 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:30.202951  2012 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.272948 28727 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:13:30.274235  2012 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.250670  2282 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:30.282928  1910 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:30.283758 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:30.286103 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 75731.5us
I20260709 13:13:30.286975 29224 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.288228 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:30.284924 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:30.292984 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52767.8us
I20260709 13:13:30.293861 28727 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:13:30.293917 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:30.300664  2185 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:30.301182  2058 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:30.302112 28621 leader_election.cc:400] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:30.302714  2185 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.303151  2185 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:30.304154  2307 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:30.294591 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:30.305078  2307 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:30.305490  2307 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:30.305739  2048 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:30.306576  2048 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:30.306311  2307 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.306880 29224 leader_election.cc:400] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
I20260709 13:13:30.307265 29224 leader_election.cc:403] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:30.307703  2288 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:30.202046  2304 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:30.309321  2288 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 8. Current term is 9.
I20260709 13:13:30.309085  2007 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.307669  2307 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:30.310626  2304 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:30.296515 28728 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:30.256273  2334 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:30.296345  2256 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:30.313730 28651 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:13:30.208478  2308 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:13:30.307142  2048 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:30.319554 29255 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:30.320772 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:30.322194 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 70628us
I20260709 13:13:30.246570  2330 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.336789 28696 leader_election.cc:400] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17.
I20260709 13:13:30.338275 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:30.253959  2175 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.337196 28696 leader_election.cc:403] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:13:30.340530 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:30.234582  2002 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.349674 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.349951 28647 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:30.354208 28650 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:13:30.355641 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:30.356490 28726 raft_consensus.cc:2368] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:30.357115 28696 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:30.354748 28650 pending_rounds.cc:85] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 9
I20260709 13:13:30.358551 28650 pending_rounds.cc:107] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:13:30.358825 28650 raft_consensus.cc:2889] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:30.360196  2273 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17.
I20260709 13:13:30.361119  2273 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:30.361688  2273 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:30.370980 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:30.335968  2330 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:30.378696 28647 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:30.254922  2326 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.381789 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.345290  1910 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:30.337150  2185 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:30.383965 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:30.386878 28647 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:13:30.397501 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 89258.1us
I20260709 13:13:30.406347 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:30.407253 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:30.408412 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:30.356724  2175 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.423133 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.423316 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:30.475129 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:30.476955 28648 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:30.478480 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:30.473711 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:30.482940 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:30.484735 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:30.485658 28647 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:30.487242 28656 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:30.483932 28725 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
W20260709 13:13:30.490289 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 60241.9us
W20260709 13:13:30.492975 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 110327us
I20260709 13:13:30.494869 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:30.538586 28649 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:30.538586 28574 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:30.539891 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:30.385854  2299 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.553988 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:30.555310 28648 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:30.549647 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:30.538744  1928 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:30.575805 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:30.581705 28648 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:30.583386 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:30.587811 28649 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:30.598425 29254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:13:30.599316 29254 raft_consensus.cc:606] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.599771 29254 raft_consensus.cc:614] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:30.601104 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:30.601753 28581 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:30.571120  1928 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.553910  2304 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:13:30.571249  2282 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:13:30.746929 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 148652us
I20260709 13:13:30.747282 28653 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:13:30.747766 28653 pending_rounds.cc:85] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 7
I20260709 13:13:30.748024 28653 pending_rounds.cc:107] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:13:30.748266 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:30.473433  2048 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.545775  2273 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.595393  2341 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:30.739673 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:30.740432 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 1777) took 1063 ms. Trace:
I20260709 13:13:30.741650 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.600940 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:30.748307 28653 raft_consensus.cc:2889] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:30.752104 28656 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:30.750502 28574 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
W20260709 13:13:30.765596 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 225756us
I20260709 13:13:30.758024 28728 rpcz_store.cc:276] 0709 13:13:29.676905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.677080 (+   175us) service_pool.cc:224] Handling call
0709 13:13:30.620678 (+943598us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400233cd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:30.740371 (+119693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297069824}
W20260709 13:13:30.772197 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.772574 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:30.779029 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:30.788393 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 187513us
I20260709 13:13:30.739260  1889 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:13:30.772444  2346 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.177s	user 0.004s	sys 0.000s
W20260709 13:13:30.775305  2345 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.187s	user 0.004s	sys 0.004s
I20260709 13:13:30.756913  1928 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:30.786443  2342 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.304s	user 0.001s	sys 0.004s
I20260709 13:13:30.760174  2058 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:30.823447  2347 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.212s	user 0.008s	sys 0.000s
I20260709 13:13:30.839782 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:30.794598  1889 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:30.850595 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 104955us
I20260709 13:13:30.820775  2002 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.818994  2267 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:30.861992  1889 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:30.863148  2350 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:13:30.863620  1889 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:30.853688  2058 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:30.865864  2176 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:30.866269  2185 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:30.867156  2058 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.866286  2176 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.868328  2176 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:30.853726 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.850709  2296 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.832168  2180 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:30.786576  2226 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:13:30.874931 28545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.005s
W20260709 13:13:30.879944 28545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.010s	sys 0.005s
W20260709 13:13:30.882066 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 640752us
I20260709 13:13:30.886350 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.852229  2352 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:30.900272 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 284956us
I20260709 13:13:30.836592  2293 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:13:30.870349  2052 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:30.870085  2300 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:30.917933 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:30.934146 28574 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:30.937309 28573 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:13:30.920132  2343 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.366s	user 0.000s	sys 0.009s
I20260709 13:13:30.898108  2321 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:30.891506  2341 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:30.942708 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.945861 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.899669  2012 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.947181 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:30.955498 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:13:30.957547  2336 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.505s	user 0.000s	sys 0.006s
W20260709 13:13:30.960170  2353 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:13:30.966171  2355 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:13:30.921510  2359 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:30.970794  2349 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:13:30.980883  2309 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:30.945840  2299 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.933751  2175 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.898327  2296 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.013947 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:30.967022 29254 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:30.983783  2326 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:30.984488  1892 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:31.025933 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:31.031229 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 258818us
I20260709 13:13:31.064514 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:31.071890 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 323704us
I20260709 13:13:31.077734 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:30.946765  2300 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:30.999171  2321 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:30.998498  2012 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.077617 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:31.028420  2285 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:31.090545 28575 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:31.029623  2180 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:31.075801  2256 consensus_meta.cc:287] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.743s	user 0.005s	sys 0.007s
W20260709 13:13:31.078568  2307 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.004s
I20260709 13:13:31.080436 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:31.101094 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:31.044663  2308 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:13:31.084084  2326 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:31.073091  2280 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:13:31.093519  2283 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.124419 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:31.123252 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.129046 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2420) took 1122 ms. Trace:
I20260709 13:13:31.033452 28574 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 21.
I20260709 13:13:31.131551 28573 raft_consensus.cc:2368] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17.
W20260709 13:13:31.125658 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 202026us
I20260709 13:13:31.129161 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:31.102620  2228 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.102210  2256 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:31.136884 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.138770 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:31.135484 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:31.114303  2299 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:31.151885 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:31.148339 29254 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:31.142374 28620 leader_election.cc:400] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:31.154062 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:31.142915 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.143739 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.156317 28730 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:31.144522 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:31.140801 29256 raft_consensus.cc:1275] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:31.178467 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:31.129638 28724 rpcz_store.cc:276] 0709 13:13:29.800078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.802745 (+  2667us) service_pool.cc:224] Handling call
0709 13:13:29.803103 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.803350 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:29.803710 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:13:29.915482 (+111772us) log.cc:844] Serialized 14 byte log entry
0709 13:13:30.269737 (+354255us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b18004668a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d29522 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:30.756020 (+486283us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b18004668a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287 00007f4a27e31208
0709 13:13:30.922281 (+166261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:30.922355 (+    74us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:30.922420 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.922492 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.922663 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65189,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":51164,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":26599,"spinlock_wait_cycles":50629632,"thread_start_us":276882,"threads_started":2,"wal-append.queue_time_us":203803,"wal-append.run_cpu_time_us":1851,"wal-append.run_wall_time_us":1099748}
W20260709 13:13:31.147707 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 159577us
I20260709 13:13:31.147620 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:31.128733  2267 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:31.151257 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:31.119334  2307 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:13:31.147552  2002 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:31.192657 29260 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:31.193257  2363 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:13:31.193979 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:31.194924  2356 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:31.191500 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:31.112680  2180 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.199514 29253 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:31.136479  2122 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:13:31.204949 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 143116us
W20260709 13:13:31.211549  2330 consensus_meta.cc:287] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.808s	user 0.003s	sys 0.008s
I20260709 13:13:31.129835  2052 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:13:31.216825 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:31.160151  2319 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 1.281s	user 0.000s	sys 0.013s
I20260709 13:13:31.136301  2283 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:31.249416 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55536.4us
W20260709 13:13:31.249565 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 58153.8us
I20260709 13:13:31.250183 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:31.253417 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:31.254671 29259 raft_consensus.cc:2410] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:13:31.098935  2341 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.245636  2338 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:31.246297  2012 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:31.200409  2321 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.204573  2333 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:31.133729  2352 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:13:31.153786  2228 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.191877  2360 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:31.148392  2285 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:13:31.234187 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:31.268532 28652 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:31.272110 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:31.273617 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 138343us
W20260709 13:13:31.280104 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 143309us
I20260709 13:13:31.281630 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.281867 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.283004 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:31.283136 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.283824 28652 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:31.294442 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:31.294219  2368 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:13:31.295171 28651 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:31.296288  2369 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.176s
I20260709 13:13:31.298502  2052 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:31.298924  2052 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:31.299000 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 80655.5us
I20260709 13:13:31.299782  2052 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.301295  2380 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:31.301530  2367 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:13:31.301815  2380 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:31.302261  2380 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:31.303035 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:31.303969 28724 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:31.305389 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.305822  2308 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.306355  2308 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.307024  2358 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:31.307178 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.307484  2358 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:31.307801 28730 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:31.308549  2308 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.308795 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:31.303912 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 69866.8us
I20260709 13:13:31.309341  2256 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:31.310037 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:31.310515 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.311249 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:31.307896  2358 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:31.259585  2330 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.315796  2176 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.316358  2330 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:31.321969 28651 raft_consensus.cc:2410] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:13:31.268522  2299 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:31.327446 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:31.331269 29259 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:31.328146 28656 raft_consensus.cc:2368] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19.
I20260709 13:13:31.329658 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.289665 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.332597 28651 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:31.275098  2333 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.222929  2359 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:13:31.335170 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:31.338362 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:31.339473 28651 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:31.287751  2338 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:31.338529 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:31.343570 28729 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:31.346486 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:31.325533  2175 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:31.355141 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.322849  2330 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:31.354303 28652 raft_consensus.cc:2393] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:31.331110  2299 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.332351  2052 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:31.333623  2296 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.333221  2256 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:31.335563  2333 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:31.380046 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:31.285785  2360 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.394155  2300 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.393885 28651 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:31.395371 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:31.397377 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:13:31.405449  2334 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.047s	user 0.013s	sys 0.000s
I20260709 13:13:31.405449 29259 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:31.353384  2369 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:31.414863 29255 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:31.417271 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:31.378407  2299 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:31.436682 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:31.372042  2330 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.447173 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2689) took 2380 ms. Trace:
I20260709 13:13:31.449726 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:31.450831 28652 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:31.462078  2364 consensus_queue.cc:1048] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.195s
I20260709 13:13:31.463035  2391 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:31.463546  2391 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:31.463979  2391 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:31.462447 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 65164.1us
I20260709 13:13:31.466215 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:31.467702  2267 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:31.470194  2370 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:31.470830  2370 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.467442 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.473814  2338 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:31.474262  2180 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:31.475724 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.475503  2256 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.476475  2338 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:31.477732 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.481721 28724 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:31.428674  2369 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.490820 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.480214 28696 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:31.434520  1892 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:31.436513  2273 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.450181 28655 rpcz_store.cc:276] 0709 13:13:29.053864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.054013 (+   149us) service_pool.cc:224] Handling call
0709 13:13:29.070235 (+ 16222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:29.343582 (+273347us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b180030b2c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e0ebfb 00007f4a27e1964b
0709 13:13:29.343728 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:29.343752 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:29.344296 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:13:29.585228 (+240932us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:29.598582 (+ 13354us) log.cc:844] Serialized 14 byte log entry
0709 13:13:29.601415 (+  2833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.601469 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:29.895104 (+293635us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4800231e58. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2cd3faa1 00007f4a2cd36b37 00007f4a2cd369ca 00007f4a2ce2e26f 00007f4a2ce2df37 00007f4a2ce4255c 00007f4a2ce42508 00007f4a2ce42488 00007f4a2ce42443 00007f4a2ce416ec 00007f4a2bd6ba96
0709 13:13:30.609797 (+714693us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:31.433940 (+824143us) raft_consensus.cc:1685] finished
0709 13:13:31.433969 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.434128 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3122,"prepare.queue_time_us":12993,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":125725,"raft.run_cpu_time_us":7899,"raft.run_wall_time_us":297182,"spinlock_wait_cycles":29252864,"thread_start_us":354549,"threads_started":2,"wal-append.queue_time_us":258567}
W20260709 13:13:31.455685  1928 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.001s
W20260709 13:13:31.502602 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 190158us
I20260709 13:13:31.472988  2370 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:31.501022  2352 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.534885  2352 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.496021  2012 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:31.537545  2012 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:31.500885  1892 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:31.503425  2368 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:31.545930  2368 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:31.546653  2386 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.546335  1892 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.546909  2368 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.547176  2386 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.547694  1892 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:31.433389  2334 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.496800  2369 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:31.569605  2358 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.572242  2358 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.517587  2273 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.573194  2382 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.573997  2382 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.575101  2273 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:31.577098 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 76746.1us
W20260709 13:13:31.593389 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 136011us
I20260709 13:13:31.594640 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:31.597498 28726 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:13:31.602147 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 127872us
I20260709 13:13:31.606230  2007 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:31.609930 28728 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:13:31.612403  2360 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.502656  2308 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
W20260709 13:13:31.703183 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 176638us
I20260709 13:13:31.717646 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:31.722747 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 121943us
I20260709 13:13:31.722887 28573 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:31.596849  2283 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:31.526785  1928 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:31.703179 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 87348.2us
I20260709 13:13:31.737190 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.702075  2179 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:31.742596  2356 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:31.748317 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:31.749392 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 247993us
I20260709 13:13:31.733165  2180 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.754788 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.721143  2352 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.716230  2386 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:31.742449  2093 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.008s	sys 0.012s
I20260709 13:13:31.764181 28580 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:31.785940 28649 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:31.756325 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:31.791251 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 300495us
I20260709 13:13:31.798344  1928 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:31.799392  2375 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:13:31.779791  2048 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:13:31.777038  2183 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.802974  2183 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.790792 28652 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:31.802155 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.816896 28647 raft_consensus.cc:2410] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:13:31.818079 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:31.819144 29259 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:13:31.766455  2304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.000s	sys 0.027s
I20260709 13:13:31.823977 28652 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:31.775980  2394 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:31.753153  2382 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:31.826088 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.836469 28653 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:31.792058  2330 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:31.745944  2258 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:31.832532 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 80315.9us
W20260709 13:13:31.790225  2093 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.008s	sys 0.012s
I20260709 13:13:31.789920  2267 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:31.835601 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:31.835291  2368 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:31.837646  2394 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:31.831744  2380 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
W20260709 13:13:31.833616  2304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.008s	sys 0.038s
I20260709 13:13:31.844324 28649 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:31.845091 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:31.865289  2379 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:31.868042  2379 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.869131  2285 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:31.870549  2379 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.865286  2380 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.872717  2380 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.843627  2330 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:31.875399  2330 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.877578  2330 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:31.878139  2330 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:31.879760 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:31.887087 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 135766us
I20260709 13:13:31.772727  2321 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:13:31.847193  2291 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:31.879359 28654 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:13:31.891345 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.882323 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.893707 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.894354 28724 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:31.895192 29257 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:13:31.895067 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 317180us
I20260709 13:13:31.895262 28656 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:13:31.791098  2180 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.896548 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.899911 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:31.902031 28721 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:13:31.902422 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:31.906898 28729 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:31.907519 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:31.908054 28726 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:31.909333 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:31.910853 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:31.912070 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:31.912757 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:31.913427 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:31.911103 28727 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:13:31.832054  2391 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.917299 28723 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:31.920027 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.922097 29256 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:31.884953  2330 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:31.844619  2258 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.933499 28655 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:13:31.940132  2394 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:31.942930  2397 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
I20260709 13:13:31.895772  2309 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:31.924254  2375 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:31.944947  2375 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.945443  2375 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:31.944977  2309 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.952154  2309 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:31.952157  2233 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.848558  2368 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.954378 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:31.954912 28721 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:31.956028 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:31.933398  2401 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
I20260709 13:13:31.924549  2283 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:31.927807  2330 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:31.921571  2404 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:31.953145  2233 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.963899 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:31.967383 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:31.909336  2380 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:13:31.978338  2376 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:31.978518  2180 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:31.978618  2233 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.979012 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:31.979576  2093 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:31.890791  2369 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:31.995301 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:31.995553  2389 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.996259 28695 leader_election.cc:400] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19.
I20260709 13:13:31.996519  2369 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:31.997073  2273 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:31.997480  2273 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.997814  2273 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:31.998507  2368 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:31.999291  2368 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:31.999666  2368 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:32.000130  2368 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:31.911592  2291 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:31.996666 28695 leader_election.cc:403] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:32.004070  2291 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.004788  2233 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:32.005617 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:31.996188  2389 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.006060  2371 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:32.006598  2371 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:32.007774  2389 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:32.005366  2233 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.007555  2371 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:31.963414  2333 consensus_meta.cc:287] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:13:32.011876 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:32.013662 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:32.013797 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.015003 28578 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:13:32.020313 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.041229 28695 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:32.042872 28695 leader_election.cc:400] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17.
I20260709 13:13:32.045434 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.050580 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.052290 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.052762 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.054469 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.008819  2371 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:31.990499  2309 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.056828 28575 raft_consensus.cc:2410] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:13:31.994867  2299 consensus_meta.cc:287] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.005s
I20260709 13:13:32.059183 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:31.963579  2338 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:13:32.062793 28577 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:32.060420 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.061724 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:32.065268 28723 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 10.
I20260709 13:13:31.989851  2366 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.079017  2361 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:32.079530  2361 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:32.079355  2366 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.049512  2267 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:32.081893  2366 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.086926 28649 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:32.058211  2341 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:32.088956 28653 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:32.090323 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.091799  2348 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:32.092379  2348 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:32.092945  2273 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.096015  2228 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.067102 28572 raft_consensus.cc:2393] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:32.097668 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.039959  2093 consensus_queue.cc:1243] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:32.099002  2279 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:32.099457  2279 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:32.067844  2233 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.050422  2404 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:32.100327  2279 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.102048  2258 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.102283  2279 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:32.066536  2309 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.110450 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.113281 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:32.113474 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.039340  2333 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.069437  2176 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:32.070516  2326 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:32.073664  2360 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:32.074239  2413 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:13:32.076341  2394 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:32.049363  2179 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:32.077373  2369 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.077924  2402 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.066011  2338 consensus_queue.cc:1243] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 0c0ecde0af494dc9b152dee191c6d3e6 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:32.064561  2300 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:32.157462  2390 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:32.186533 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 124746us
I20260709 13:13:32.115234 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.116447 28573 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:32.187727 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:32.118229 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:32.125345 28621 leader_election.cc:336] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.579s (SENT)
I20260709 13:13:32.133344 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:32.188864 28722 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:32.188907 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:32.133497 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.140793 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.190155 28652 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:32.143394 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.191572 28649 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:32.135304  2326 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:32.146545 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.146960  2375 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.123466  2404 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:32.152275  2368 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.140250  2179 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.065801  2299 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.134203  2307 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:13:32.158931 28725 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 20: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:32.169391 28726 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:32.109588  2283 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:32.067783 28579 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:32.185451  2426 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:32.144572 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.193789 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.194502 28654 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:32.194999 28729 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:32.213758 28648 raft_consensus.cc:2368] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:32.193159 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.195653 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.142066  2309 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.194119  2180 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:32.186162  2280 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:13:32.190448  2226 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:13:32.137814  2258 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:13:32.209971 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:32.080520  2361 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.211700 28649 pending_rounds.cc:85] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 10
I20260709 13:13:32.254248 28649 pending_rounds.cc:107] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:13:32.254695 28649 raft_consensus.cc:2889] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:32.238163 28653 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:32.238709 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:32.225091 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:32.212188 29224 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:32.219265 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:32.240864 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:32.257928 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45856.5us
I20260709 13:13:32.259665 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:32.260361 28652 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:32.204581  2176 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:32.262642 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:32.173038  2369 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.159368  2360 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.259685 28723 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:32.265798 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.213783  2179 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.265264  2300 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:32.270581 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.277419 28579 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:32.272614  2283 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:32.276103 28729 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:32.244377  2291 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19.
I20260709 13:13:32.245168  2390 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:32.242139  2180 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:32.273556 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 148244us
I20260709 13:13:32.288769 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:32.263542  2309 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:32.263814  2389 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:32.203066  2358 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 13:13:32.262632  2415 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.200s	user 0.001s	sys 0.003s
I20260709 13:13:32.281682 28652 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:32.182505  2402 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.210048  2375 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.275461  1910 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:32.295164 28576 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:13:32.317931 28576 pending_rounds.cc:85] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 10
I20260709 13:13:32.318202 28576 pending_rounds.cc:107] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:13:32.318444 28576 raft_consensus.cc:2889] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:32.294314  2389 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:32.312588 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:32.314776 28621 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.315558 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:32.317235 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.283499  2283 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:32.319835 28722 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:13:32.210131  2404 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.321910 28573 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
W20260709 13:13:32.322607 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.323427 28727 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:32.295497  2180 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:32.335217 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:32.335745 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:32.336300 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.266933  2413 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:13:32.333858 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.327603  2283 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:32.208575  2326 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.294500  2309 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.288906  2300 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:32.288676  2361 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:32.341104 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.343336 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:32.343608 28573 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:32.343909 28729 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:32.344653 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.259078  2426 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.324417  2389 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:32.347553 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:13:32.348297 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 129747us
I20260709 13:13:32.317734  1910 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:32.327854  2341 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:32.346707  2309 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:32.352617  1910 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.387676 28729 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:32.353704  2300 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.349208  2285 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:32.360651  2426 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.360944  2283 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.367211 28727 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
I20260709 13:13:32.369971 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.370909 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.394984 28573 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:32.351608 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:32.383934 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:32.396174 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 45638.8us
I20260709 13:13:32.396771 28652 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:32.328622  2307 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:13:32.389045 28579 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:32.328857  2176 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:13:32.346941  2280 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:32.399812 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.409044 28722 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:32.407166  1928 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:13:32.410862 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.411662 28579 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:32.402967 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.405020  2334 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.390022  2326 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:32.382858  2333 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.421711  2368 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.421932  2402 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.416350 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.419263  2369 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.399017  2279 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:32.425503 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:32.426994 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.428488 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.400292  2282 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:32.423521  2179 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.407655  1910 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:32.446590 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2921) took 1175 ms. Trace:
I20260709 13:13:32.447222 28648 rpcz_store.cc:276] 0709 13:13:31.271643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.271799 (+   156us) service_pool.cc:224] Handling call
0709 13:13:32.446284 (+1174485us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b5400258854. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:32.446506 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146872704}
I20260709 13:13:32.454741 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2881) took 1058 ms. Trace:
I20260709 13:13:32.455359 28580 rpcz_store.cc:276] 0709 13:13:31.396091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.420331 (+ 24240us) service_pool.cc:224] Handling call
0709 13:13:32.454497 (+1034166us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54001f8954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:32.454670 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750861184}
I20260709 13:13:32.459511  2330 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.460975 28724 raft_consensus.cc:2393] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:32.461352 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:32.462828  2427 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:13:32.463961 28724 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:32.448828 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.498741 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.499890 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:32.500576 29260 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:32.502754  2179 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:32.503537 28656 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:32.507229 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.507906 28581 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:13:32.508906 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.509544 28581 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:32.514459  2330 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.406994  2433 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:32.558601  2308 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:32.559324  2308 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:32.561714 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.561930 28648 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:13:32.563256 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.495303 28721 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:32.496678  2390 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.496997  2321 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:32.515940 28581 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:32.587121 28581 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:32.494792 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:32.520841 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 95411.7us
I20260709 13:13:32.587810 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.524610 28579 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:32.549423 29259 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:13:32.516273  2404 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.428514  2402 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:32.590279 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.493762  2285 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:32.601604 28724 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:32.604445 28579 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:13:32.604887 28579 pending_rounds.cc:85] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 12
I20260709 13:13:32.605170 28579 pending_rounds.cc:107] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:13:32.560488  2308 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.605468 28579 raft_consensus.cc:2889] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:32.592096  2378 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:32.608261 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.609983 29260 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:32.644104 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:32.645788 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 79468us
I20260709 13:13:32.655676 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.645592 29260 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:32.609982 29259 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:32.592633  2321 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.589442  2390 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.743813 28621 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:32.744232 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 135916us
W20260709 13:13:32.693871  2432 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
I20260709 13:13:32.639599  2360 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.750938 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.752907 29258 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:32.687970  2413 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.734884  2375 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.603963  2285 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.604701  2382 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 13:13:32.656292  2180 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.768958  2283 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:32.769287  2428 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260709 13:13:32.770262  2431 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:13:32.784684  2390 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.786638  2321 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.791481  2421 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.793985 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:32.794642 28729 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:32.759444  2389 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.766178  2413 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.806062 28655 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:32.806310  2391 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.800133  2421 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.810223  2421 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.811846 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.812562 28580 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:32.813719  2413 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.814685 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.815537 28577 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:32.817092  2183 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:32.822664  2389 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:32.830269  2285 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:32.837302 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 440035us
I20260709 13:13:32.841121 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:32.841287  2307 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:32.841802  2307 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:32.841914 28655 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:32.842721  2307 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.843885  2307 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.843811  2309 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.776659  2375 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:32.845752 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 102002us
I20260709 13:13:32.846542 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.846975  2351 raft_consensus.cc:2764] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:13:32.847537  2375 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:32.847651 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:32.855264 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.850744 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:32.858748 28727 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:32.858566 28648 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:32.849901 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:32.863119 28724 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:32.863991 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:32.841387  2176 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:32.864866 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:32.847683  2351 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:32.900142 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:32.901089 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:32.866935 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:32.904125 28648 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:32.851740  2002 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:32.901893 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:32.852507  2273 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:32.914552 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.908917 28577 raft_consensus.cc:2376] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14. Re-sending same reply.
I20260709 13:13:32.917204 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:32.921330 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:32.921574 28621 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:32.904585  2432 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:32.870810  2326 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:32.927244 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:32.907882  2341 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:32.899067  2176 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:32.928917 28655 raft_consensus.cc:2368] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
W20260709 13:13:32.848991  2356 consensus_queue.cc:1175] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ed517a03edd141a798f07798667c1c04" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 13:13:32.869544  2371 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:13:32.869350  2366 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:13:32.914561  2394 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:32.864745  2382 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:13:32.932783 28654 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:32.917429  2351 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:32.918701  2180 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:32.937891  2419 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:13:32.953349 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.938838 28648 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:32.916513  2300 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:13:32.917081  2369 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:13:32.927428  2326 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.928105  2362 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:32.962637  2362 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:32.958473  2223 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:32.961637  2369 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:32.966861 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.963985  2362 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.969957  2369 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:32.972235 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.976140 28655 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:32.977154 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.946779  2394 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:32.978444 29255 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:32.981940 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.979858 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:32.978657 29257 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:32.965432  2326 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:32.979811 28578 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:13:32.950743  2351 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:32.971555  2223 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:32.954762  2176 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:33.002398 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.011931 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:33.009683  2375 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:33.023299 28652 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 13:13:33.028887  2394 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:33.030767  2351 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:33.017845  2369 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.034574 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:33.022665  2375 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.019052  2180 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:33.039168 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:33.020210  2176 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:33.037927  2418 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.962s	user 0.004s	sys 0.002s
I20260709 13:13:33.041821 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 2000) took 1249 ms. Trace:
I20260709 13:13:33.042249 29253 rpcz_store.cc:276] 0709 13:13:31.792765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.794112 (+  1347us) service_pool.cc:224] Handling call
0709 13:13:31.794801 (+   689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:31.795116 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:31.795154 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:31.795741 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:13:31.953700 (+157959us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:31.953753 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.953849 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.037257 (+1083408us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:33.041495 (+  4238us) raft_consensus.cc:1685] finished
0709 13:13:33.041521 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.041755 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17345920,"thread_start_us":107132,"threads_started":1,"wal-append.queue_time_us":217872}
I20260709 13:13:33.044603 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:33.045645  2434 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.412s	user 0.002s	sys 0.000s
I20260709 13:13:33.037691  2375 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:33.050283 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:33.050865  2394 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.051596 28572 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:33.051391  2394 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.053383  2371 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:33.054976  2394 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:33.059710 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.014571  2300 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:13:33.061105 29253 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:33.021310  2223 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.067780  2413 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:33.068466  2223 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:33.068478  2413 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:33.074162 28725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 2950) took 1202 ms (client timeout 1535 ms). Trace:
W20260709 13:13:33.074652 28725 rpcz_store.cc:269] 0709 13:13:31.879282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.879475 (+   193us) service_pool.cc:224] Handling call
0709 13:13:33.073964 (+1194489us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54002b8754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:33.074102 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625054976}
I20260709 13:13:33.077921  2359 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:33.078329  2359 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:33.079521 28728 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:13:33.079181  2359 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.080394  2359 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:33.082603 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:33.084357  2356 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.079205 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:33.087901 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:33.088798 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:33.093200  2391 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:33.098140 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:33.099622 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:33.101745 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.102911 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:33.103856 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:33.092954  2012 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:33.105679 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:33.106909 29254 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:33.108445 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:33.097335  2391 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.105110 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:33.112453 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:33.114423 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:33.115443 29254 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:13:33.115545 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:33.117070 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:33.120616 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:33.121810 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:33.100875  2389 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:33.125515 29255 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:33.093447  2267 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:13:33.100521  2379 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:33.102931  2406 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:33.104846  2283 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:33.126026 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:33.107451  2404 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:33.129206 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:33.109357  2365 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.135473  2293 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:33.138437  2228 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:33.138443  2326 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.146170  2413 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:33.157698  1910 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:13:33.146632  2379 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.128358  2375 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:33.163107  2404 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.147534 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:33.148375 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:33.125094  2378 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:33.151232  2426 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.115666  2391 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:33.151962 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:33.120182  2233 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:13:33.152962 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:33.134720  2389 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.168927 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1798) took 1042 ms. Trace:
I20260709 13:13:33.146548 28576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1500) took 1094 ms. Trace:
I20260709 13:13:33.164202  2283 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.182708 28723 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:33.180363 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.133704  2403 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:33.186985 28730 rpcz_store.cc:276] 0709 13:13:32.126824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.126954 (+   130us) service_pool.cc:224] Handling call
0709 13:13:32.150727 (+ 23773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.151152 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:32.151185 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:32.151769 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:13:33.140841 (+989072us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b18001887a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1
0709 13:13:33.160788 (+ 19947us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:33.160855 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.160926 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.160971 (+    45us) raft_consensus.cc:1685] finished
0709 13:13:33.160981 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.168832 (+  7851us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53797,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":4511,"spinlock_wait_cycles":20670208,"thread_start_us":102329,"threads_started":1,"wal-append.queue_time_us":146088}
I20260709 13:13:33.188465 28576 rpcz_store.cc:276] 0709 13:13:32.052025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.052239 (+   214us) service_pool.cc:224] Handling call
0709 13:13:32.077620 (+ 25381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.323528 (+245908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.145299 (+821771us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54000ed8d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:33.146249 (+   950us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54000ed8d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:33.146444 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514634368}
W20260709 13:13:33.217955 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 112318us
I20260709 13:13:33.170780  2406 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:33.172694  2183 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:33.222692 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:33.179148  2267 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:33.191277  2378 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.172354  2361 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.172432  2228 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:33.170837  2293 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:33.177593  2288 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:33.176213  2375 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:33.177326  1910 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:33.134370  2226 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:13:33.177477  2404 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:33.226341 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:33.228281  2280 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:33.176424  2308 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:13:33.244884 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 69155.4us
I20260709 13:13:33.224764  2183 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.172950  2365 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.244849  2293 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:33.249648 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:33.200299  2283 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:33.247196 28655 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:33.223956  2012 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:33.230069  2378 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:33.196098  2426 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.224170  2267 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:33.224665  1928 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.226594  2403 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:33.252292  2280 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:33.257608 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:33.268712 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:33.133963  2348 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.282229 28573 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:33.248428  2375 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:33.248556  1910 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:33.253343  2288 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:33.277333  2183 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:33.278260  2452 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
W20260709 13:13:33.295024 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 56361.8us
I20260709 13:13:33.242182  2361 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.248621  2413 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:13:33.302313 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44826.5us
I20260709 13:13:33.308674 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:33.286523  2175 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.292690  2402 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:13:33.315440 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 89191.9us
I20260709 13:13:33.284504  2176 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:13:33.289414  2307 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:13:33.321476 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.322268  2012 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.325851 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.306031  1928 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.327456  2361 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:33.327703  2365 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:33.312880  2228 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.330605  2426 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:33.323824  2180 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.322486 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.336508 28695 leader_election.cc:400] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:33.311733  2326 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:33.357977  1928 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:33.343781  2267 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.359182  2267 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.360186  2369 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:33.334381  2402 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:33.316202  2406 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.361893  2402 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.363250  2402 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.334676  1892 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:33.320173 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:33.341117 28573 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:33.318996  2321 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.347829  2352 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:33.347904  2379 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:33.355156 28695 leader_election.cc:403] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:33.357102  2228 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:33.349576  2280 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.357673  2180 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.287132  2453 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:13:33.378149  2389 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:33.372933  2463 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:13:33.342659  2175 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.348693  1910 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.349938  2458 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:13:33.342996  2413 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 13:13:33.319928  2455 consensus_queue.cc:1175] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" responder_term: 15 status { last_received { term: 15 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 15 index: 12 } }
I20260709 13:13:33.344197  2403 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.372813  2288 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.373857  1892 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.443287  2452 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:33.435568 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 99233.6us
W20260709 13:13:33.437328 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 103324us
W20260709 13:13:33.442726 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 200199us
I20260709 13:13:33.445421 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.448925 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.434540  2352 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:33.434568  2338 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.434778  1928 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:33.461928 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 146936us
I20260709 13:13:33.404858 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:33.509728 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 104970us
I20260709 13:13:33.474496 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:33.476621 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:33.470921  1892 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:33.480435 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.511536 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:33.476145 28696 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:33.471171 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.457572  2280 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:33.518308 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:33.519150 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 45131.3us
I20260709 13:13:33.520215 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:33.517100  2371 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:33.520459  2183 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.522505  2299 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:33.522553 28578 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:33.524876  2404 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.527405  2404 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:33.527484 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:33.528535 29257 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:33.516697  1928 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.531246  2394 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:33.532191  2394 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:33.514649  2338 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:33.538602 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.538683 28721 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:33.479360  2454 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.539896 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:33.543696 29257 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:33.520488 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:33.511921  2441 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:13:33.554378 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 78387.7us
I20260709 13:13:33.571751 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:33.573694 29260 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:33.573964 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 53542.9us
I20260709 13:13:33.578413 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:33.589030 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:33.539381  2467 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:33.584880 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 66646.6us
I20260709 13:13:33.600644 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2733) took 1513 ms. Trace:
I20260709 13:13:33.602532 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:33.558449  2403 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:33.596236 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:33.500682  2452 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:33.559952  2442 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.574s	user 0.000s	sys 0.005s
I20260709 13:13:33.610208 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:33.550350  2473 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:33.558171  2371 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:33.601307 28656 rpcz_store.cc:276] 0709 13:13:32.085224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.087933 (+  2709us) service_pool.cc:224] Handling call
0709 13:13:32.088269 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.503960 (+415691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.598188 (+1094228us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540001d1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:33.598408 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954410240}
I20260709 13:13:33.573431  2413 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:33.578193  2426 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:33.620811 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:33.615933 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 73824.5us
I20260709 13:13:33.540143  2406 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:13:33.594360  2463 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:33.651149 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:33.648689 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:33.572970  2375 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.599675  2389 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:33.615127  2341 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:33.637454  2223 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.657934 28649 raft_consensus.cc:2410] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:33.634649 28647 pending_rounds.cc:85] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 10
I20260709 13:13:33.576128  2468 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:13:33.639997  2394 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:33.655445 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:33.636997  2338 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:33.713380 28647 pending_rounds.cc:107] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:13:33.713785 29260 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
W20260709 13:13:33.725045 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 214102us
I20260709 13:13:33.759902 28647 raft_consensus.cc:2889] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:33.657114  2356 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:33.773411 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 118054us
W20260709 13:13:33.734639  2359 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.654s	user 0.000s	sys 0.015s
I20260709 13:13:33.660916  2463 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:33.774644 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:33.663972  2403 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:33.788237 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 209887us
I20260709 13:13:33.714468  2012 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:33.616796  2467 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.735235  2458 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:33.738700  2326 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:33.783411  2391 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.005s
I20260709 13:13:33.761641  2426 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.824033 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:33.825640  2426 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.820767  2391 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.737267  2293 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.834605 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:33.738953  2223 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.802173  2338 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:33.739092  2283 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:33.788686  2463 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:33.853689 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.761062  2483 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:13:33.861282 29254 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:13:33.858508 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:33.788693  2482 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:33.857263 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:33.862726 28730 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:33.866679 28725 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 20: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:33.863339 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:33.870558 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 84100.8us
I20260709 13:13:33.872996 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:33.788945  2356 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.873894 28722 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:13:33.874089 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:33.874473 29259 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:33.870082  2465 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 13:13:33.823076  2326 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:33.934734 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:33.977322 29260 raft_consensus.cc:2410] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:33.871766  2482 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:33.940795  2478 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:13:33.941577  2476 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:13:33.862942  2338 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:33.943704  2228 consensus_meta.cc:287] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.004s
I20260709 13:13:33.938598  2175 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:33.872408  2453 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:33.955013 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.835307  2394 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:33.973757 29258 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:33.907984  2341 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.815495  2371 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:33.947088  2267 consensus_meta.cc:287] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:13:33.952404 29259 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:33.975965  2487 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:33.979760  2482 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:34.012741 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 467078us
W20260709 13:13:33.989908  2378 consensus_meta.cc:287] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.692s	user 0.022s	sys 0.009s
W20260709 13:13:34.022171 28573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.012s	sys 0.004s
W20260709 13:13:34.022567 28573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.012s	sys 0.004s
I20260709 13:13:34.021689 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:33.995142  2356 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:34.053290 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 105899us
I20260709 13:13:33.936602  2403 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.029264  2452 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.037323  2282 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:34.009142  2394 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.009431  2341 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.002291  2453 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.049966  2375 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:34.050596  2492 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:34.083902 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.082957 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:34.104422  2480 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:13:34.105903 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.112751  2484 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:13:34.133306  2426 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.134191  2223 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.135723  2481 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:34.069183  2288 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:34.138489 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.101215 28572 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
W20260709 13:13:34.136754  2454 consensus_meta.cc:287] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.002s
I20260709 13:13:34.136334  2481 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.145179  2283 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.102332  2467 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:34.102962  2293 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:34.138347  2492 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.145255  2175 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:34.156137  2175 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.157162  2288 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.158751  2175 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.145761 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:34.160485  2288 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.160936 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:34.161720  2338 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.163980  2341 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.174571 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1802) took 1030 ms. Trace:
I20260709 13:13:34.175379  2364 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:34.175583 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.201378 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:34.177742  2280 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.002s
I20260709 13:13:34.150130  2394 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.179738 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.057610  2356 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:13:34.021564  2487 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.155251  2492 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:34.152009  2402 consensus_meta.cc:287] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.788s	user 0.013s	sys 0.000s
I20260709 13:13:34.186981  2454 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13.
I20260709 13:13:34.027649  2378 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:34.199314 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 137671us
I20260709 13:13:34.191058 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:34.195197 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1809) took 1048 ms. Trace:
W20260709 13:13:34.204304 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 182697us
I20260709 13:13:34.203132 28722 rpcz_store.cc:276] 0709 13:13:33.144492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.160488 (+ 15996us) service_pool.cc:224] Handling call
0709 13:13:33.174866 (+ 14378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:33.874366 (+699500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.174169 (+299803us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b5400233cd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:34.174485 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606963968}
I20260709 13:13:34.219229 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:34.192060  2369 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.831s	user 0.012s	sys 0.003s
I20260709 13:13:34.193024  2175 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.196871  2183 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.243846 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.218720  2341 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:34.253924 29256 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:34.255244 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.244639 29253 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:34.245582 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:34.248474  2280 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.249336 29252 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:34.196169  2493 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:34.250034 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.257869 28547 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:34.251650 28577 raft_consensus.cc:2410] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:34.241348 28721 rpcz_store.cc:276] 0709 13:13:33.146787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.146920 (+   133us) service_pool.cc:224] Handling call
0709 13:13:33.147274 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:33.546232 (+398958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.194930 (+648698us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54000343d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:34.195135 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899647744}
I20260709 13:13:34.218364  2338 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:34.248327  2492 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:34.242393 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:34.268661 28580 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:34.263247 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.266436 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.210135  2467 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:13:34.267335 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.271008 29254 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:34.276892 29253 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:34.278891 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.252295  2285 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:34.280922 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:34.286763 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.269583  2183 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:34.291718  2321 consensus_meta.cc:287] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.856s	user 0.004s	sys 0.008s
I20260709 13:13:34.284765  2288 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:34.275475  2394 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.319060  2487 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.256430  2175 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.316912 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1761) took 1008 ms. Trace:
I20260709 13:13:34.338295 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:34.352720 28578 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:34.355756 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.352517 29259 rpcz_store.cc:276] 0709 13:13:33.308128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.308297 (+   169us) service_pool.cc:224] Handling call
0709 13:13:34.316647 (+1008350us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54006e0354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:34.316803 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267367296}
I20260709 13:13:34.364908 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.366317 28574 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:34.366683 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:34.366940 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.367602 28579 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:34.265785  2280 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.368109 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.371940 28572 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:34.366721 28648 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:13:34.293596  2183 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:34.374259 28573 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:34.333681  2321 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:34.335961  2326 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.337425  2288 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:34.289052  2285 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.328684  2482 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.377282 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.356858  2307 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:34.398940  2307 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.399792  2481 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.377334  2402 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.400801  2402 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.402211  2175 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.377307  2183 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.403398  2402 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.404654  2378 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.407260  2482 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.408540  2453 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.410179 29259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:13:34.410943 29259 raft_consensus.cc:606] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
W20260709 13:13:34.389843  2508 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:34.374634  2283 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.384430  2288 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.398037  2280 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.419114 28578 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:34.375555  2487 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.377925  2356 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:34.433717 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.428606 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:34.427139  1892 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.884s	user 0.012s	sys 0.000s
I20260709 13:13:34.432480 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.453330  2356 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.453896  1892 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.454617 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.455569  2356 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.455735 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:34.357847  2394 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.428764  2496 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.457151 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:34.456851 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.457633 28581 raft_consensus.cc:2368] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14.
I20260709 13:13:34.457857 28574 raft_consensus.cc:2368] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:34.457958 28650 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:34.431118  2493 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:34.438215 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:34.445279 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.446900  2285 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.448887 28721 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:13:34.432946  2307 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.449571 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.468753 28722 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:34.450366 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:34.470001 28725 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 12: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:34.451094 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.452837 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:34.430382  2283 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.472118 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.455967 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.473320 28726 raft_consensus.cc:2410] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:13:34.458230 29224 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.622s (SENT) [suppressed 8 similar messages]
I20260709 13:13:34.473727 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:34.474382  2341 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:34.475363 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:34.435366 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:34.478024 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.478631 28652 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:34.479488 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.480067 28652 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:34.481884  2360 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:34.484335  2360 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:34.484700  2360 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:34.459136 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:34.446786 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.454538 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.494966 28724 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:34.495121  2477 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.021s	sys 0.031s
W20260709 13:13:34.495570  2477 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.021s	sys 0.031s
I20260709 13:13:34.496042  2506 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.496598  2309 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:34.499303  2479 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.657s	user 0.000s	sys 0.001s
I20260709 13:13:34.500152 28650 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 13:13:34.499303 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:34.500880  2486 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.501399  2486 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.502257  2382 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:34.502581  2493 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.503861  2378 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:34.507085 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:34.465219 28578 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:13:34.470556 28728 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:34.456095  1892 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.476670 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:34.518923 28574 raft_consensus.cc:606] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
W20260709 13:13:34.486016  2463 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.000s
I20260709 13:13:34.476904 29224 leader_election.cc:400] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:34.519651 29224 leader_election.cc:403] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:13:34.521322 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:34.480903 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:34.485193 28654 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:34.457587  2487 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.467216  2402 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.472576  2283 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:34.434602 28651 raft_consensus.cc:2410] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:34.510315 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.511790 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:34.507387 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:34.516069 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.465090  2122 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.518154 28721 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:34.456574  2496 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.523788 28652 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:34.571971  2514 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:34.524848 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 48087.1us
I20260709 13:13:34.564628 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.563846 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.566555  2356 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:34.567034 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 45830.1us
W20260709 13:13:34.586261 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 78928.5us
I20260709 13:13:34.587217 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:34.587378 28622 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:34.569674  2487 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.569834 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.570243  2394 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.573824 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.591009 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:34.591362 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:34.593154 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:34.593381 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.593902 28726 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:34.594069 29253 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:34.595000 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.596091 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:34.598670  2491 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:13:34.607914 28652 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:34.623816 28728 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:34.624698 28725 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:13:34.621431 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:34.630796 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.631691 28651 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:34.632962 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.633857 28648 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:34.634035 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.582131  2326 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:34.645289 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.645313 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:34.522359  2403 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.592200  2307 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:34.527125  2293 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:34.520776  2390 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.128s
I20260709 13:13:34.654392 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:34.614192  2514 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.496627  2506 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.627334  2359 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:34.592590  2183 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.565502  2402 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.634949  2394 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:34.667572 28574 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:34.639567  2378 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.517283  2309 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:13:34.588239  2122 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:34.677066 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 83981.6us
I20260709 13:13:34.643733  2486 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.614639  2365 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:34.524890  2463 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.677964 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:34.657096  2307 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.656302  2477 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:34.631695  2285 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:13:34.661067  2321 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:34.639747  2326 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.721113 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:34.669621  2514 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:34.718325 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2955) took 1109 ms. Trace:
W20260709 13:13:34.827450 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.627164  2360 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:34.716060  2476 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:13:34.829166 28651 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:34.751891  2512 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:34.835455  2183 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.830803 28647 rpcz_store.cc:276] 0709 13:13:33.609210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.609890 (+   680us) service_pool.cc:224] Handling call
0709 13:13:33.634348 (+ 24458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:33.956378 (+322030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.956423 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:34.184988 (+228565us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b2c000f9be8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:13:34.186021 (+  1033us) log.cc:844] Serialized 52 byte log entry
0709 13:13:34.432044 (+246023us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:34.432079 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.432144 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:34.680914 (+248770us) raft_consensus.cc:1685] finished
0709 13:13:34.680940 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.718244 (+ 37304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":200430,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4206,"spinlock_wait_cycles":53870464,"thread_start_us":405104,"threads_started":2,"wal-append.queue_time_us":310165}
I20260709 13:13:34.661478  2403 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.726225  2307 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:34.727185  2390 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:34.726112  2477 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:34.714896  2378 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.854839 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.681063  2394 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.860872 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.863869 28728 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:34.861987 28651 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:34.868002  2527 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:34.869058  2527 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.869706  2527 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.830967  2048 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 13:13:34.883904 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:34.884961 28724 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
W20260709 13:13:34.893862  2522 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:13:34.894347  2379 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:34.901206  2391 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:34.863088  2491 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:34.853380  2390 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:34.879345  2504 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:34.907459  2390 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.908649  2504 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:34.909440  2521 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:13:34.910159  2491 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.911020  2348 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:34.912937 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2456) took 1090 ms. Trace:
W20260709 13:13:34.915599 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 194657us
I20260709 13:13:34.889362  2360 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:34.928251 28729 rpcz_store.cc:276] 0709 13:13:33.822694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.823839 (+  1145us) service_pool.cc:224] Handling call
0709 13:13:33.834209 (+ 10370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.001565 (+167356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.001613 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:34.001684 (+    71us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:34.001731 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.912603 (+910872us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54000a6ed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:34.912679 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:34.912854 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384226560}
I20260709 13:13:34.938620 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:34.917604  2504 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:34.951439 29224 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:34.956290 29224 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:34.954213  2390 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:34.971941  2424 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.972594  2424 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.973186  2536 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:34.973372  2379 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:34.973748  2536 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.974087  2379 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.974913  2379 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:34.975677  2527 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.975965  2536 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:34.978482  2424 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:34.983403 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:34.986317  2528 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.986984  2528 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:34.989794  2506 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:34.990635  2519 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:13:34.991727 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:34.994612 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.960947  2458 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:34.959012  2526 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:34.989431  2528 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:34.998893  2526 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:34.930603  2477 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:34.998152  2458 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:35.009754  2532 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:35.010497  2532 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:35.010939  2403 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:35.014873  2389 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.015439  2389 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.017642  2536 raft_consensus.cc:993] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:13:35.018332  2390 raft_consensus.cc:1081] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:13:35.019699  2321 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:35.020155  2321 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:35.007587  2526 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:35.025228  2233 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:35.025765  2233 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:35.026660  2233 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.027786  2233 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:35.031601 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.033241  1928 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.033358  2378 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.033890  2458 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:35.046918 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.047883 28649 raft_consensus.cc:2410] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:35.052498 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:35.054404 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.034113  1928 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.063572  1928 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.064198 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.065436 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.065548 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.066098  1928 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.066305 28649 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:35.034472  2359 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:35.068853 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.077266 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.078056 28651 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:35.081084  2491 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.082280  2491 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:35.084179  2361 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:35.084457 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.084733  2361 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:35.085371 28651 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:35.085850  2361 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.087265  2361 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:35.089422  2394 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.047488  2477 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:35.094512 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.095512 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.093425 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:35.098990 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.034373  2379 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.102669 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.103735 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.104697 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.105062 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.105762 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.107961 28728 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:35.107985 28724 raft_consensus.cc:2410] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:35.109417 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.110896 29259 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:35.111035 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.109926 29253 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:35.112073 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.112183 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:35.112963 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 120385us
I20260709 13:13:35.116261 28729 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 13: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:35.117743 29253 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:35.118646 29256 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:35.074707  2486 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:35.074220  2389 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.141553 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.121390 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.142426 28730 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:35.105192  2421 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.081321  2359 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.116449  1928 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:35.152302 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.039604  2321 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.157087 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.170749 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.154331 28579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:35.175086 29259 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:35.180444 28579 raft_consensus.cc:606] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.152094 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.197440  2180 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.197487 29256 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
W20260709 13:13:35.198767  2288 consensus_meta.cc:287] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.006s
I20260709 13:13:35.199292  2288 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.200469 29260 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.201915  2389 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:35.210492 29260 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:35.111959  2504 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.153525  2474 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:35.208348 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.220556 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:35.225752  2356 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.006s
I20260709 13:13:35.226400  2356 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:35.230489  2504 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.237569  2526 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.238744 29251 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:35.239809  2526 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.172336  2421 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.151422  2486 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.237838  2288 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:35.242506 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:35.243593 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:35.250162  2403 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.250746  2403 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.253283  2093 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.254069  2122 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.257701  2473 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:35.258107  2473 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:35.258881  2473 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.260010  2473 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:35.240952  2464 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.260826  2464 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.218866  2321 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.273351  2379 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.273746 28725 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:13:35.272830  2361 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:35.277400  2356 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.277216  2514 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.277913  2288 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:13:35.278394 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 164867us
I20260709 13:13:35.277266 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.285425 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.285934 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:35.287962 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 113212us
I20260709 13:13:35.291477 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.287598 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:35.296748 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.296787 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.297549 28726 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:35.297911 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.265439  2352 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.254086  2093 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.243259  2526 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:35.298419 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:35.301964 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.287040  2288 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.290592 28725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:44608
I20260709 13:13:35.307232 28725 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.307577 28725 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:35.305325 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.305931  2361 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:35.294067  2403 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:35.300673  2122 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:35.289955  2356 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.315065  2226 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:35.318653 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.319144  2421 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:35.320879 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.321988 28723 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:13:35.323832 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:35.316691 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.326413  2093 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.309441  2360 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:35.326957  2378 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:35.327724  2504 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:35.334180  2548 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:35.336015  2514 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.309682  2288 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:35.339033 28721 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:35.339458  2226 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:35.317338  2122 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:35.368462  2307 consensus_meta.cc:287] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 13:13:35.314146  2352 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:35.369429  2307 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.299814  2458 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:35.351524 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.355959  2494 raft_consensus.cc:993] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:13:35.356647 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:35.357160 28577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1506) took 2042 ms (client timeout 1736 ms). Trace:
I20260709 13:13:35.352085  2504 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:35.351035  2378 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.360440  2486 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.361694 28578 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:13:35.313462  1928 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:35.367607  2226 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.368664  2122 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:35.372421  2307 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.375931 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.395547 28721 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:35.348495 28726 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:13:35.381635 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.397765 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 2017) took 1560 ms. Trace:
I20260709 13:13:35.398031 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:35.379503 28577 rpcz_store.cc:269] 0709 13:13:33.314994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.319548 (+  4554us) service_pool.cc:224] Handling call
0709 13:13:35.356863 (+2037315us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540031e054. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:35.357065 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036760448}
W20260709 13:13:35.382934 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 55714.4us
I20260709 13:13:35.384883 28578 pending_rounds.cc:85] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 12
I20260709 13:13:35.399156 28578 pending_rounds.cc:107] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:13:35.399475 28578 raft_consensus.cc:2889] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:35.399507  2321 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:35.390738  2226 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:35.398228 29257 rpcz_store.cc:276] 0709 13:13:33.837175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.837387 (+   212us) service_pool.cc:224] Handling call
0709 13:13:33.837841 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:33.859881 (+ 22040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:33.859921 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:33.877072 (+ 17151us) log.cc:844] Serialized 26 byte log entry
0709 13:13:34.036997 (+159925us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:34.071739 (+ 34742us) log.cc:844] Serialized 14 byte log entry
0709 13:13:34.072395 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:34.072504 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.033088 (+960584us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b1800422860. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:35.372172 (+339084us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b1800422860. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:35.397533 (+ 25361us) raft_consensus.cc:1685] finished
0709 13:13:35.397556 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.397707 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20531,"prepare.queue_time_us":36154,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":22355,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":14672,"spinlock_wait_cycles":25294848,"thread_start_us":33138,"threads_started":1,"wal-append.queue_time_us":112598}
I20260709 13:13:35.374421  2458 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.401701 28547 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.384398  2378 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.381389  2504 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.385673  2492 raft_consensus.cc:1081] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:13:35.400331  2321 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:35.413378 28577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:35.415238 28577 raft_consensus.cc:606] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:35.415486 28577 raft_consensus.cc:614] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:35.419044 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.420719 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2754) took 1088 ms. Trace:
W20260709 13:13:35.426719 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.418237  2546 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:35.414465  2547 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:35.421460 28656 rpcz_store.cc:276] 0709 13:13:34.332641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.333711 (+  1070us) service_pool.cc:224] Handling call
0709 13:13:34.334090 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:34.355453 (+ 21363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.355490 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:34.356132 (+   642us) log.cc:844] Serialized 52 byte log entry
0709 13:13:35.373343 (+1017211us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b180033ee00. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:35.389865 (+ 16522us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:35.419869 (+ 30004us) log.cc:844] Serialized 14 byte log entry
0709 13:13:35.420259 (+   390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.420360 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.420416 (+    56us) raft_consensus.cc:1685] finished
0709 13:13:35.420520 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.420652 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15076,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4410,"spinlock_wait_cycles":7089792,"thread_start_us":42600,"threads_started":2,"wal-append.queue_time_us":1030341}
I20260709 13:13:35.428583  1928 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.433903 28577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:35.437644 28577 raft_consensus.cc:606] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:35.438050 28577 raft_consensus.cc:614] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:35.410296  2551 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:13:35.440582  2402 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:35.425997  2351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.015s	sys 0.014s
W20260709 13:13:35.391571  2494 consensus_queue.cc:1175] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ed517a03edd141a798f07798667c1c04" responder_term: 20 status { last_received { term: 15 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: [19.10-19.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:35.439986  2547 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.438117  2356 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.451398  2458 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.452476 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:35.442092 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.453928 28727 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
W20260709 13:13:35.485242 28581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1510) took 2042 ms (client timeout 1622 ms). Trace:
W20260709 13:13:35.485842 28581 rpcz_store.cc:269] 0709 13:13:33.442617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.445101 (+  2484us) service_pool.cc:224] Handling call
0709 13:13:35.460942 (+2015841us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b540031e554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:35.485156 (+ 24214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260278016}
I20260709 13:13:35.487679  2122 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.451980  2458 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.488956  2550 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.489472  2550 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.490445  2122 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.490793  2458 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.488509  2468 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.491611  2550 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.494030  2547 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.494499 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.494838 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.495489 29255 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:35.495652 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.496459 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.497692 28652 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:35.491487  2468 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.500437  2468 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.503113 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.503813 28648 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:35.529242 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:35.550943 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.561810 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:35.562633 28656 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:35.460932  2351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.016s	sys 0.015s
I20260709 13:13:35.576572  2504 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.566486 28725 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.610965 28581 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:35.612938 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.613600 29255 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.595031  2455 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.590049  2550 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:35.621143 28725 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.601291  2504 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.479334  2321 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.608135  2122 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:35.629410  2122 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.631835  2122 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.623180  2550 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.621536  2455 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.634681  2550 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.635716  2288 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.636307 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.637334 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.639693  2378 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.642360 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.642794 28727 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:35.662653 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:35.645264  2421 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.636171  2455 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.670413 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.671751 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.672423 29255 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:35.673368  2477 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:35.673934 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:35.674037  2477 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:35.674736 28648 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.674805  2477 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.665133  2526 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:35.677211  2526 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.677546  2526 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.679207  2378 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.679311 28725 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:13:35.673269  2487 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:35.682519  2288 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:35.684886 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.692068  2463 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.667191  2421 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.696573  2421 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:35.702714 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:35.704298  2378 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:35.704686  2378 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.706070  2464 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:35.711355 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.712066 28725 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
I20260709 13:13:35.711131  2477 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.715363  2477 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.715730 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.716524 28721 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:35.713478  2552 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:13:35.721565 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.722589 28723 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:35.736447 29257 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 16. Ops: []
I20260709 13:13:35.737233 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.737977 29260 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:35.738510 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1379) took 1233 ms. Trace:
W20260709 13:13:35.739256 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 49905.2us
I20260709 13:13:35.739120 28652 rpcz_store.cc:276] 0709 13:13:34.505567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.633721 (+128154us) service_pool.cc:224] Handling call
0709 13:13:35.738254 (+1104533us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b540027d654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:35.738423 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980785920}
I20260709 13:13:35.740226  2477 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:13:35.741652  2554 log.cc:927] Time spent T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:13:35.750922 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.752568 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1514) took 2242 ms. Trace:
I20260709 13:13:35.752929 28580 rpcz_store.cc:276] 0709 13:13:33.510077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.510242 (+   165us) service_pool.cc:224] Handling call
0709 13:13:33.521512 (+ 11270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.269446 (+747934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.752329 (+1482883us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54001fb654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:35.752479 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714760064}
W20260709 13:13:35.753640 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 72521us
I20260709 13:13:35.748281 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.754706 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1527) took 1303 ms. Trace:
I20260709 13:13:35.754809  2288 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:35.706130  2378 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.756781 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.757232  2496 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:35.756603 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 71420.3us
I20260709 13:13:35.758244 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.759272 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.759694  2455 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:35.760136 28729 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:35.764621  2348 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:35.765326  2348 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.767478  2348 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.768365 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.755159 28578 rpcz_store.cc:276] 0709 13:13:34.451693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.599241 (+147548us) service_pool.cc:224] Handling call
0709 13:13:35.361412 (+762171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:35.400020 (+ 38608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.754506 (+354486us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540031e050. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:35.754644 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752138112}
I20260709 13:13:35.769412 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.769870  1910 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.771791 28723 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:35.772045  2378 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.706095 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:35.772992  2282 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:35.773974  2541 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:35.774206  2308 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:35.774783  2308 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:35.774664  2541 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.775691 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:35.775779  2308 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.744181 28724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:13:35.745608 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.748407 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.803893 29254 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:35.748998 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.805162 28726 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.805321  2359 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.809415  2287 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.810083  2287 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.813367  2341 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:35.813942  2341 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.817279 28724 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.817662 28724 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:35.822388  2379 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:35.822960  2379 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:35.823957  2379 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.749955 28696 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.750228 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2764) took 1324 ms. Trace:
I20260709 13:13:35.825568  2404 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:35.751070 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.829432 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.825310 28655 rpcz_store.cc:276] 0709 13:13:34.425902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.426047 (+   145us) service_pool.cc:224] Handling call
0709 13:13:34.432728 (+  6681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:35.748310 (+1315582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:35.748339 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:35.748382 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:35.748414 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.749999 (+  1585us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003b1354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:35.750042 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.750173 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025063296}
I20260709 13:13:35.830281 28581 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:35.830905  2287 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.750134 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.831692 29257 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.833349 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.778599  2541 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.759426 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:35.837822 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 78456.9us
I20260709 13:13:35.838574 28578 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:13:35.838860  2378 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:35.788976 29251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1749) took 3240 ms (client timeout 1654 ms). Trace:
I20260709 13:13:35.791057 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2761) took 1422 ms. Trace:
I20260709 13:13:35.794059 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.837822  2530 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:35.839752 28727 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:35.839519 28654 rpcz_store.cc:276] 0709 13:13:34.368949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.369127 (+   178us) service_pool.cc:224] Handling call
0709 13:13:34.369450 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:34.524051 (+154601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.790804 (+1266753us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400259254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:35.790989 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265732352}
I20260709 13:13:35.840329  2532 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:35.840862  2532 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:35.840736 29251 rpcz_store.cc:269] 0709 13:13:32.548455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.550027 (+  1572us) service_pool.cc:224] Handling call
0709 13:13:35.788681 (+3238654us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b54001559d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:35.788832 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6094558464}
I20260709 13:13:35.841266 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:35.841521  2532 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:35.842386  2541 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:35.842868  2455 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:35.843418  2455 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:35.843881  2455 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.844610 28581 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:35.846956 28579 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:35.847822 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.848642 28581 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:35.794448  2464 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:35.787004 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.849529 28580 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:35.849828  2464 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:35.850277  2464 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:35.743098 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:35.799790  2537 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.687s	user 0.003s	sys 0.001s
I20260709 13:13:35.800045  2326 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:35.800210 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 94169.8us
W20260709 13:13:35.802409 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48006.9us
I20260709 13:13:35.876531  2404 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:13:35.825690 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 75861.9us
W20260709 13:13:35.877274 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 134242us
I20260709 13:13:35.878070 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.878857 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.880321 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:35.884367 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.884965 29255 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.885948 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.839083 28578 pending_rounds.cc:85] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 13
I20260709 13:13:35.887844 28578 pending_rounds.cc:107] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:13:35.853070  2299 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:35.891546 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.853607 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:35.854552 28726 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:35.839921  2530 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.854234 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.855294 28721 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:35.855978  2379 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:35.856050 28724 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:35.856805 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.903683 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:35.856796  2309 consensus_queue.cc:1175] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "178f22d83287460fb8c0db0ba2799895" responder_term: 15 status { last_received { term: 12 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:13:35.905803 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 51651.4us
I20260709 13:13:35.858049 28729 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:35.907778 28728 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 16. Ops: []
I20260709 13:13:35.859067 28580 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:35.816900  2341 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:35.774951 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.862706 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.917251 28654 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:35.863715 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:35.918617 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55002.1us
I20260709 13:13:35.792171  2526 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.885939 28648 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:35.888129 28578 raft_consensus.cc:2889] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:35.881454 28622 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:35.888438 28656 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:35.851390  2464 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.890300 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.891074 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.924924 28730 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.894361 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.896420 29255 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:35.901760 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.901325  2546 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:35.929318 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47987.8us
I20260709 13:13:35.929468 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.903800 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.930657 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.930816 28721 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:35.905835 28574 raft_consensus.cc:2410] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:35.907151 28722 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:35.860179 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:35.934335 28572 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 13: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:35.909718 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:35.940439 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.941437 28726 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:35.888805  2477 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:35.873124 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.924917 28727 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:35.893419 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.948490 28721 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:35.927271 28724 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:35.901779  2285 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:35.921851 29257 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:35.927178 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.903827  2288 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:35.904613  2404 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:35.930272 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:35.948659 28725 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:35.776695 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:35.951460 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:35.907549 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.956313 29256 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:35.957261 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.919857  2462 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.974399 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.975273  2391 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:35.975745 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:35.975991  2530 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:35.923431  2493 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:35.976645  2391 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:35.976698  2493 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:35.977185 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.977383  2493 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:35.978320 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:35.979053 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.982074 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.982404 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:35.982702 28724 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.983168 28725 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:35.984026 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:35.984684 28729 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:35.985395 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:35.960052 28723 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:13:35.961246 28656 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:13:35.987289 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.961647 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.962281 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:35.991030 28652 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:35.962651 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.963637 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:35.965456 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:35.968467 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:35.992614 28653 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:35.972096  2546 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.969470 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:35.904102  2299 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:35.995721 28651 raft_consensus.cc:2368] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:35.996882 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:36.005499 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54171.5us
I20260709 13:13:36.001652 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.005407 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.011917 28647 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:36.012629 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:36.011041 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:36.013451 28655 raft_consensus.cc:2368] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14.
W20260709 13:13:35.962651 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 55208us
I20260709 13:13:36.008659 28724 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:36.011827 28730 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:35.954093  2541 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:35.952778  2503 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:35.954260  2288 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:36.017388 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 64244.5us
I20260709 13:13:36.017781 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:36.019141  2558 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.019266 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:35.927064  2458 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:13:35.988122  2364 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:36.021185 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.003890 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:35.981853  2359 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:35.958562  2307 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:36.020995 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:36.083586 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62673.6us
I20260709 13:13:35.989362  2360 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:36.019758  2558 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:36.088543 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:36.012506  2551 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:36.005645  2093 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:36.063457 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:36.030417 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.061575 28546 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.046607  2402 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:36.014680  2496 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:36.013178  2285 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:36.024662  2474 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:36.021422  2503 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.044150  2287 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:36.046276  2526 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:36.087621  2541 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:36.123929 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52423.3us
I20260709 13:13:36.025177  2361 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:36.128316 28653 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:13:36.121426 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59955.8us
I20260709 13:13:36.118839  2282 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:36.085342  2548 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:36.117739  2093 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:36.004691  2462 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.132854  2473 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:36.012997  2468 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:36.120941 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 117150us
I20260709 13:13:36.099949  2506 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:36.024485  2530 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.103s
I20260709 13:13:36.139587  2287 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.132601  2352 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:36.050336  2299 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:36.101374 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.151399  2282 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.148380 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:36.171762 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 70468us
I20260709 13:13:36.155498  2093 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.015924  2487 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:13:36.175449 29255 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:36.176043 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.140072  2503 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.159547  2506 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.014078  2463 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:13:36.174402  2282 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.200536  2285 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.203715 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:36.154565  2326 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:13:36.205588  2462 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:36.173137  2532 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.206768 29258 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:13:36.208431 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:36.209718 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.210398 29260 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:13:36.021564  2288 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:36.113641  2360 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.045051  2404 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.144796  2378 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:36.132992  2481 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:13:36.152014  2403 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.137905  2455 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.179672  2473 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:36.147346 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 388728us
I20260709 13:13:36.268932 29253 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:36.174024 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.173372 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:36.178318 29251 raft_consensus.cc:2393] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:36.120673  2402 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:36.138398  2496 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.086048  2364 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:36.193889 29259 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:36.161741  2287 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:36.168866  2468 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:36.221750 29252 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:36.178815  2548 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:36.246146 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.312079 29260 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:36.172657 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.199790  2506 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:36.177371  2321 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:36.208493  2532 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:36.286142 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 112834us
I20260709 13:13:36.322552 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:36.290107 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 282598us
I20260709 13:13:36.296473 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:36.298089 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.245497  2351 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.247119  2308 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.338454  2308 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:36.339068 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.227429  2391 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:36.342700  2391 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.343746 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.344560 29256 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 12.
I20260709 13:13:36.300505  2364 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:36.347949 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:36.349540  2557 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:36.350063  2557 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.350481  2557 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:36.353593  2402 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.355638  2402 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:36.359222  2558 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:36.370975  2282 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:36.247370  2403 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.381217  2282 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:36.383358  2403 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:36.319689 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 147092us
I20260709 13:13:36.392127 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:36.327448 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:36.327966 28730 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:36.327448 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:36.394555 28728 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.331982 29251 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:13:36.332803 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:36.396618 29251 pending_rounds.cc:85] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 10
I20260709 13:13:36.397029 29251 pending_rounds.cc:107] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:13:36.336637  2546 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:36.397373 29251 raft_consensus.cc:2889] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:36.398017  2464 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:36.397186 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 64498.2us
I20260709 13:13:36.336943  2351 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.337802  2482 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:36.311734  2548 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:36.414665 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 257464us
I20260709 13:13:36.394888 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:36.413506 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:36.400238 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 280635us
I20260709 13:13:36.340837  2308 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:36.421408 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.253542  2541 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.422399 29251 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:36.404155  2558 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:36.454522 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.456933 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.462005 28728 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:36.463861 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:36.464987 28696 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:36.323706  2321 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.422497  2548 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:36.469223 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:36.415537  2481 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:36.439841  2462 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:36.414373  2494 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:13:36.424786  2473 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:36.441159  2391 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:36.415735  2487 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:13:36.420550  2474 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:13:36.472563  2309 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:36.466418  2307 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:36.474440  2558 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:36.506423  2462 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.510118  2546 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:36.529316  2566 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:13:36.556824 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 120691us
I20260709 13:13:36.517664  2473 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:36.596279 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.518118  2391 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:36.468456  2557 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.565858 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:36.570390  2455 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:36.515563  2481 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.571609 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:36.620014 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 202580us
W20260709 13:13:36.578358 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.557224  2462 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:36.472463  2403 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:13:36.599267 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:36.622757 28650 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.600090 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.623121 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.623464 28652 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:36.462049  2468 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.503230  2568 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
W20260709 13:13:36.616920 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.554519  2309 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:36.561199  2360 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:36.626087 29224 leader_election.cc:400] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:36.639966 29224 leader_election.cc:403] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:13:36.626224 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 157108us
I20260709 13:13:36.551647  2307 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.641755 29260 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:36.643690 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.648471 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:36.649137 29224 leader_election.cc:400] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14.
I20260709 13:13:36.651273 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.621697  2391 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:36.660512 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:36.649695 29224 leader_election.cc:403] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:13:36.628429  2584 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:36.662901 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 331664us
I20260709 13:13:36.665616 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:36.667784 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.668553 28652 raft_consensus.cc:2393] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:36.671002 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.642270  2496 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:36.671989  2359 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.679044 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.647852  2455 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:36.680518 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:36.658979  2360 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:36.683146 28728 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.711555 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.717150 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.717898 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.718583 28656 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:36.720669 28651 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:36.721290 28728 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:36.724400 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.725106 28649 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
I20260709 13:13:36.672551  2571 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14.
I20260709 13:13:36.725154 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:36.725917 29256 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
W20260709 13:13:36.726382 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 50446.2us
I20260709 13:13:36.726904 28651 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:36.731675 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.740883 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.743970 28577 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:36.747116 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:36.748829 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 100498us
I20260709 13:13:36.750515 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.751368 28579 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:36.714807  2233 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:36.758803 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.763509 28656 raft_consensus.cc:2410] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:13:36.736879 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:36.649704  2558 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:36.682472  2580 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:36.777130 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.770538 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:36.783277 28651 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:36.771870 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.680874  2093 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:36.725497  2561 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:36.789680 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:36.668973  2473 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:36.790391 28656 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:36.674338  2584 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.709656  2455 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.684262  2359 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:36.714812  2496 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:13:36.774883  2580 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.787326  2594 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:36.796548  2351 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:36.808267  2570 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:13:36.719044  2309 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.821969 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.893157 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.897423 28578 raft_consensus.cc:2410] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:13:36.897266 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:36.897891 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.898008 28576 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:36.893090 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:36.899247 28581 raft_consensus.cc:2393] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 11: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:13:36.896754 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 159989us
W20260709 13:13:36.828944  2477 consensus_meta.cc:287] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.877s	user 0.006s	sys 0.006s
I20260709 13:13:36.819880  2580 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.907330 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:36.905019 28656 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
W20260709 13:13:36.905427 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 155513us
I20260709 13:13:36.910022 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.911180 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:36.950009 28580 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:36.951013 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:36.948732 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 163274us
I20260709 13:13:36.953965 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.956295  2582 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:36.957064  2582 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:36.957325 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:36.958279  2582 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.958920 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:36.960032  2582 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:36.971822 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62314.3us
I20260709 13:13:36.895489  2593 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.790956  2391 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.901487  2557 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:36.900988  2586 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:36.907543  2561 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.907202  2341 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:37.038262  2575 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 13:13:36.906955  2307 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:36.982167  2579 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:13:37.067602 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:37.069262 28650 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:37.069818 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:37.071143 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.084815 29255 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:36.913408  2477 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:37.072810 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.092712 29259 raft_consensus.cc:2410] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 12 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:13:36.823150  2594 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.075237 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:36.976783  2481 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:37.088310 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 114654us
W20260709 13:13:37.105556 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 130250us
I20260709 13:13:37.094720 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.097229 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.099858 28654 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:37.100947 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:37.113222 28724 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:37.091120 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:37.102955  2493 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.116s	user 0.013s	sys 0.001s
I20260709 13:13:37.121922 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:37.132296 28724 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:13:37.111354  2577 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.423s	user 0.001s	sys 0.000s
I20260709 13:13:37.094619  2606 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:37.137271 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:37.084612  2341 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.123449  2307 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:37.163113 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 57714.6us
I20260709 13:13:37.138051  2603 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:37.130548  2351 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:37.080891  2561 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.073578  2593 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.169770 28578 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:37.074949  2586 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.146339  2359 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:37.157902  2574 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:13:37.125098  2481 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 13:13:37.198165  2364 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.008s
I20260709 13:13:37.129870  2493 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.199791 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1542) took 1345 ms. Trace:
I20260709 13:13:37.193969 28650 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:37.214327 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1792) took 1212 ms. Trace:
I20260709 13:13:37.214536 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:37.220063 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:37.219514 29255 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:37.237537 29259 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:37.189793  2607 raft_consensus.cc:2764] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:13:37.195415  2598 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:13:37.193821  2455 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:37.193758  2610 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.233836 28573 rpcz_store.cc:276] 0709 13:13:35.854461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.854882 (+   421us) service_pool.cc:224] Handling call
0709 13:13:35.855242 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:35.856919 (+  1677us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:36.160286 (+303367us) log.cc:844] Serialized 14 byte log entry
0709 13:13:36.683399 (+523113us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:36.695107 (+ 11708us) log.cc:844] Serialized 26 byte log entry
0709 13:13:36.695353 (+   246us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:36.695401 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:36.695585 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:37.199581 (+503996us) raft_consensus.cc:1685] finished
0709 13:13:37.199604 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.199731 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":447902,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":40,"raft.queue_time_us":42181,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":4591,"thread_start_us":823989,"threads_started":3,"wal-append.queue_time_us":470634}
I20260709 13:13:37.190564  2603 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.223874  2609 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:37.163910 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:37.224321  2601 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:37.277968  2341 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:37.280118  2548 consensus_meta.cc:287] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.000s
I20260709 13:13:37.280575 28723 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:37.280978 28723 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:37.281775 28723 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.282948 28723 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:37.283423  2402 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.927s	user 0.012s	sys 0.002s
I20260709 13:13:37.253221  2584 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.251446  2351 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:37.280601  2548 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.286230  2561 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:37.287564  2548 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:37.293118  2093 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:37.294126 28656 raft_consensus.cc:2410] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:13:37.298512 28723 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:37.299041  2493 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:37.299757  2590 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260709 13:13:37.300859 28580 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:13:37.301745 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 137918us
I20260709 13:13:37.263463 28576 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:37.271106  2610 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.272001  2599 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:13:37.273092  2600 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:13:37.260492  2597 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:13:37.313158 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:37.366330 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:37.341513  2287 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.998s	user 0.010s	sys 0.003s
W20260709 13:13:37.342293  2462 consensus_meta.cc:287] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.000s
W20260709 13:13:37.373147 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 60117.9us
W20260709 13:13:37.314477  2568 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:13:37.265132  2603 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:37.315623  2503 consensus_meta.cc:287] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.101s	user 0.012s	sys 0.004s
I20260709 13:13:37.274051  2601 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.314767  2307 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:37.320962  2506 consensus_meta.cc:287] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.994s	user 0.006s	sys 0.007s
I20260709 13:13:37.309897  2615 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.358860 29259 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 13.
W20260709 13:13:37.371937  2288 consensus_meta.cc:287] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 1.103s	user 0.010s	sys 0.006s
I20260709 13:13:37.383040  2309 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:37.245720  2364 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.357252  2606 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:37.379122  2464 consensus_meta.cc:287] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.981s	user 0.014s	sys 0.000s
I20260709 13:13:37.426921 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:37.419847  2352 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.225s	user 0.017s	sys 0.026s
W20260709 13:13:37.425494 28695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.000s	sys 0.026s
W20260709 13:13:37.437431 28695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.026s
W20260709 13:13:37.423300  2403 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.019s	sys 0.063s
I20260709 13:13:37.311975  2609 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.423347  2307 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:37.441758 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.383359  2287 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.441768 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.422905  2561 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:13:37.441161 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.449961 28723 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:37.450779  2609 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:37.439924  2403 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.020s	sys 0.063s
I20260709 13:13:37.451779  2321 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:37.430583  2615 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.455245  2615 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:37.457238 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:37.457841 28730 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:37.459349 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:37.460268 28656 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:13:37.460481 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:37.443959 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.463114  2601 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:37.463454 28722 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:37.443133 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.464496 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.464857 28721 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:37.465706 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.465791 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.466418  2594 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.444592 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.442077 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.467212 28726 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:37.468043 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.445533 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:37.437371  2352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.018s	sys 0.026s
I20260709 13:13:37.439867  2532 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:37.469658  2352 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:37.470242  2532 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:37.470788  2352 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.471143  2532 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.471895 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.472697 29260 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:37.466265 28722 raft_consensus.cc:2376] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18. Re-sending same reply.
I20260709 13:13:37.466454 28721 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:13:37.390108  2462 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.449303 28729 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
W20260709 13:13:37.469290  2559 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 1.159s	user 0.003s	sys 0.000s
I20260709 13:13:37.447069 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.480300 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:37.481702 28728 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:37.450805 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.481922 28650 raft_consensus.cc:2368] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:37.482106 28730 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:37.482268 28723 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:37.483409 28650 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:37.478479 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:37.468900 28725 raft_consensus.cc:2410] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 12 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
W20260709 13:13:37.484807 28649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.010s	sys 0.015s
I20260709 13:13:37.479703 29258 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:13:37.485904 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:37.486696 28649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.010s	sys 0.015s
I20260709 13:13:37.448350  2307 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:37.493876 28579 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:37.490875 28572 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:13:37.428807  2506 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.492097 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:37.492422 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:37.526940 29224 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:37.431929  2288 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:36.776769 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:37.509712 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 1847) took 1182 ms. Trace:
I20260709 13:13:37.528671 28724 rpcz_store.cc:276] 0709 13:13:36.327012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.327136 (+   124us) service_pool.cc:224] Handling call
0709 13:13:37.509469 (+1182333us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54000a6ed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:37.509633 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655505664}
I20260709 13:13:37.515288 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 3173) took 1056 ms. Trace:
I20260709 13:13:37.529772  2288 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:37.516680  2382 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:37.530618  2288 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:37.533597 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:37.534174 28656 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:37.535163 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:37.427243  2503 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.493368  2365 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.535722 28581 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:37.535843  2606 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.546005  2593 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.545929  2365 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.551159 28648 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:37.552184  2503 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.554459  2233 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:37.546000  2586 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.569046 28656 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:37.570497 28577 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 18: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:37.568706 28581 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:37.530048 28574 rpcz_store.cc:276] 0709 13:13:36.458714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.458845 (+   131us) service_pool.cc:224] Handling call
0709 13:13:36.459275 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:36.468710 (+  9435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:36.468754 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:36.479668 (+ 10914us) log.cc:844] Serialized 52 byte log entry
0709 13:13:36.677777 (+198109us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:36.710834 (+ 33057us) log.cc:844] Serialized 14 byte log entry
0709 13:13:37.299385 (+588551us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b24001213b8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24baf9c4 00007f4a24badacb 00007f4a24d68dc9 00007f4a24d68a55 00007f4a24d6809d 00007f4a2799a10e 00007f4a279b188c 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221
0709 13:13:37.514625 (+215240us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b18002c4760. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a27e0e060 00007f4a27e20716 00007f4a27e31287
0709 13:13:37.514799 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.514914 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:37.514974 (+    60us) raft_consensus.cc:1685] finished
0709 13:13:37.514994 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.515203 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18432,"prepare.queue_time_us":33096,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":194895,"spinlock_wait_cycles":109109376,"thread_start_us":152871,"threads_started":2,"wal-append.queue_time_us":381310}
I20260709 13:13:37.585638 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:37.535408  2583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.006s	sys 0.026s
I20260709 13:13:37.576351  2477 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:37.581398  2233 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:37.590368  2583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.006s	sys 0.026s
I20260709 13:13:37.580940  2609 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:37.594450  2321 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:13:37.611495 29253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1791) took 1610 ms (client timeout 1871 ms). Trace:
W20260709 13:13:37.616524 29253 rpcz_store.cc:269] 0709 13:13:36.001196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.001863 (+   667us) service_pool.cc:224] Handling call
0709 13:13:37.611280 (+1609417us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54004b5ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:37.611421 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572544896}
W20260709 13:13:37.620952  2592 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:13:37.601723  2477 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.579391  2623 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:13:37.639469 28622 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:37.645656  2628 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:37.646134  2628 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:37.646664  2628 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:37.648880  2620 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:13:37.650108 29258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 2039) took 1447 ms (client timeout 1737 ms). Trace:
W20260709 13:13:37.650538 29258 rpcz_store.cc:269] 0709 13:13:36.202317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.208119 (+  5802us) service_pool.cc:224] Handling call
0709 13:13:37.649905 (+1441786us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400596354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:37.650044 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842927360}
I20260709 13:13:37.652288 28575 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:37.652689 28575 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:37.652179  2307 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.635722  2321 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:37.686836 28729 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:37.687474  2321 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.689590  2569 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:37.690016  2569 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:37.690871  2569 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.660115 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:37.615384  2609 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.661542  2628 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.703040  2609 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:37.704134  2233 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.636054  2477 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.710421 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.711243 29256 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:37.713356  2462 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:37.714066  2625 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:37.639142  2610 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.717134  2364 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.719045 29255 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:13:37.720683 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:37.669518 28475 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.722597  2609 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:37.234006 29257 rpcz_store.cc:276] 0709 13:13:36.001649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.001962 (+   313us) service_pool.cc:224] Handling call
0709 13:13:36.002350 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:36.002641 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:36.298772 (+296131us) log.cc:844] Serialized 14 byte log entry
0709 13:13:37.201889 (+903117us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b18003cfee0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b623a
0709 13:13:37.213901 (+ 12012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:37.213960 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:37.214016 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.214105 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.214241 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6070,"prepare.queue_time_us":513135,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":16188,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":4696,"spinlock_wait_cycles":33477888,"thread_start_us":492807,"threads_started":2,"wal-append.queue_time_us":320986}
I20260709 13:13:37.723168  2609 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:37.725637 28648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1380) took 1765 ms (client timeout 1981 ms). Trace:
W20260709 13:13:37.726089 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.726012  2623 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:37.726794  2623 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.727770 28653 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:13:37.728111  2596 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:37.728447 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1794) took 1104 ms. Trace:
I20260709 13:13:37.728709  2596 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.729324 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2969) took 1056 ms. Trace:
I20260709 13:13:37.729434  2623 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.729748 28653 rpcz_store.cc:276] 0709 13:13:36.673319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.673448 (+   129us) service_pool.cc:224] Handling call
0709 13:13:37.727539 (+1054091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.728136 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.729152 (+  1016us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400258d50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:37.729273 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2337402624}
I20260709 13:13:37.730417 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 3172) took 1272 ms. Trace:
I20260709 13:13:37.731114 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:37.732059 28580 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:37.730752 28572 rpcz_store.cc:276] 0709 13:13:36.458397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.458527 (+   130us) service_pool.cc:224] Handling call
0709 13:13:36.461156 (+  2629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.494612 (+1033456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.730194 (+235582us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003fe154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:37.730363 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367467776}
I20260709 13:13:37.732631  2628 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.728883 29251 rpcz_store.cc:276] 0709 13:13:36.624248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.624998 (+   750us) service_pool.cc:224] Handling call
0709 13:13:37.727791 (+1102793us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1eee 0000000000375939 00007f4a2cd651e0 00007f4a2ce2e0c4 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:13:37.727937 (+   146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:37.728120 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.728146 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:37.728195 (+    49us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:37.728236 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.728280 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.728393 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2782208}
I20260709 13:13:37.733527  2596 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.733907  2625 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:37.726055 28648 rpcz_store.cc:269] 0709 13:13:35.960011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:35.961383 (+  1372us) service_pool.cc:224] Handling call
0709 13:13:37.725456 (+1764073us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400258d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:37.725583 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3588441472}
I20260709 13:13:37.735249  2609 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:37.675498  2506 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:37.678409  2617 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.254s	user 0.000s	sys 0.003s
I20260709 13:13:37.736235  2607 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:37.678628 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.736662  2607 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:37.679298  2458 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.681315  2455 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:37.682224 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:13:37.753350 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 71210.2us
I20260709 13:13:37.682401  2463 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:37.684264 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.764101 28728 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:13:37.684959 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.686008 28730 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:37.695396 29258 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:37.664043  2557 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:37.705367 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.767125 29259 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:37.706909 29260 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:37.734961  2625 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.735776 29255 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:37.737672 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:37.739785 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:37.741171 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:37.674604  2580 consensus_meta.cc:287] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.693s	user 0.006s	sys 0.003s
I20260709 13:13:37.742770 28722 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:37.743969 28729 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:37.744684 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.810099 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1844) took 1132 ms. Trace:
I20260709 13:13:37.812279 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:37.814183 28724 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:37.736819  2365 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.809775  2458 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.826756  2603 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:37.827957  2458 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:37.815627 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:37.811326 29254 rpcz_store.cc:276] 0709 13:13:36.677921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.678860 (+   939us) service_pool.cc:224] Handling call
0709 13:13:36.679416 (+   556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.037872 (+358456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.037904 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.038389 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.128083 (+ 89694us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:37.128166 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.128265 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:37.677864 (+549599us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:37.737821 (+ 59957us) raft_consensus.cc:1685] finished
0709 13:13:37.737846 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:37.810027 (+ 72181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33502,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8910,"spinlock_wait_cycles":32932608,"thread_start_us":394574,"threads_started":2,"wal-append.queue_time_us":307432}
I20260709 13:13:37.829593 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:37.819523  2463 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.830360  2571 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:37.819155 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:37.820430 28572 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:13:37.822681  2309 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.822783  2287 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:37.823177  2464 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.823864  2233 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.824301  2361 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:37.692204  2569 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.834688 29257 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:13:37.869923 29257 pending_rounds.cc:85] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 12
I20260709 13:13:37.870311 29257 pending_rounds.cc:107] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:13:37.870682 29257 raft_consensus.cc:2889] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:37.839569 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:37.815104  2530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.636s	user 0.006s	sys 0.012s
I20260709 13:13:37.810495  2609 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:13:37.863579 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 53331.6us
I20260709 13:13:37.810263  2608 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:37.868765 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 382871us
I20260709 13:13:37.874544 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:37.876974  2307 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:37.879452 28579 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:37.862913  2637 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.878777 28696 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:37.835938  2601 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:13:37.873308  2530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.697s	user 0.006s	sys 0.012s
I20260709 13:13:37.865532  2640 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:37.851328  2458 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:37.894243 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:37.834075  2580 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.860249  2591 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:13:37.921702 29251 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:37.901316 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.809770  2455 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.880966  2596 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:37.860471  2309 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.873380  2482 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:13:37.924141 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:37.971215 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 44470.2us
I20260709 13:13:37.901535 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:37.931435 29254 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 14: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:37.925824 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:37.893950  2601 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.866412  2464 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:37.976689 28620 leader_election.cc:336] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.624s (SENT)
I20260709 13:13:37.982496 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:37.896359  2621 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:37.983039 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2917) took 1226 ms. Trace:
W20260709 13:13:37.980103 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 47160.5us
I20260709 13:13:37.983492 28577 rpcz_store.cc:276] 0709 13:13:36.757862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.771516 (+ 13654us) service_pool.cc:224] Handling call
0709 13:13:37.982839 (+1211323us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54001a9354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:37.982978 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781621504}
W20260709 13:13:37.981119 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 57429.5us
I20260709 13:13:37.890575  2233 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.987728 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:37.873960  2361 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.989921 28725 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:37.992581 28577 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:37.890959  2288 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:13:37.999680 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:38.001554 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75802.5us
I20260709 13:13:37.890712  2608 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.928413  2596 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:37.977679  2462 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:37.988770  2530 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:37.878513  2607 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.982076  2601 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:37.893693  2637 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:37.926362  2639 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:13:37.991178  2458 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:37.920535  2606 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:13:38.093717  2551 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:38.094134 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 2980) took 1318 ms. Trace:
I20260709 13:13:38.095265  2603 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.094869 28475 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 12 to 15, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.094818  2477 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.096448  2607 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:38.097688  2477 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:38.061381  2621 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:38.062920 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49689.2us
I20260709 13:13:37.978195  2602 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:13:38.020365  2462 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:38.077701  2644 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:13:37.990248  2610 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:13:38.011865  2596 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:37.979164  2568 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:13:38.003605  2233 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.078888  2463 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:38.080363  2580 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.082618  2309 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:38.100723  2458 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.086957  2455 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.007472  2624 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:38.088376  2326 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:38.101446 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.102092 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:38.094600 28649 rpcz_store.cc:276] 0709 13:13:36.775806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.775992 (+   186us) service_pool.cc:224] Handling call
0709 13:13:36.799401 (+ 23409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.487117 (+687716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:37.487138 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.492864 (+  5726us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.745592 (+252728us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:37.745649 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.745749 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.093906 (+348157us) raft_consensus.cc:1685] finished
0709 13:13:38.093925 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.094071 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156205,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":861609,"threads_started":2,"wal-append.queue_time_us":443496}
I20260709 13:13:38.068989  2360 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:38.085347  2464 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.091831  2637 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.133853 29255 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:38.111016  2462 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:38.157389  2404 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:38.157918  2404 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:38.133808  2624 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.162014  2624 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:38.111980  2382 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.135489  2458 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:38.140139  2326 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:38.176380 29255 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
W20260709 13:13:38.168601  2644 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:13:38.174849  2309 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:38.160602  2360 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.166882  2637 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:13:38.183183  2621 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.211575  2624 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.214330  2624 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.215216  2640 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:38.215828  2640 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:38.216099  2601 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.216930  2640 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.219995  2608 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.220268  2640 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:38.111056 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:38.252581 28620 leader_election.cc:336] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.751s (SENT)
I20260709 13:13:38.253703 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:38.255517 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:38.111135 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:38.258260 28620 leader_election.cc:336] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.700s (SENT)
I20260709 13:13:38.259068 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:38.253610 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 144404us
I20260709 13:13:38.274505 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1396) took 1205 ms. Trace:
I20260709 13:13:38.275250 28651 rpcz_store.cc:276] 0709 13:13:37.068985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.106069 (+ 37084us) service_pool.cc:224] Handling call
0709 13:13:37.106471 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:37.440342 (+333871us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:37.571622 (+131280us) log.cc:844] Serialized 14 byte log entry
0709 13:13:37.790091 (+218469us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:37.790772 (+   681us) log.cc:844] Serialized 26 byte log entry
0709 13:13:37.790946 (+   174us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:37.790991 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:37.791083 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:38.273706 (+482623us) raft_consensus.cc:1685] finished
0709 13:13:38.273777 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:38.274197 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6012,"prepare.queue_time_us":184426,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":166051,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":258,"thread_start_us":603588,"threads_started":3,"wal-append.queue_time_us":288869}
W20260709 13:13:38.281708 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.290141 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:38.286214 28575 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.291301 28726 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:38.294931 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 410748us
I20260709 13:13:38.305315 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:38.306979 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:38.303627 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 2970) took 1628 ms. Trace:
I20260709 13:13:38.309034 28577 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:38.309357 28655 rpcz_store.cc:276] 0709 13:13:36.675112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.675269 (+   157us) service_pool.cc:224] Handling call
0709 13:13:38.302987 (+1627718us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540027db54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:38.303333 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2661366016}
I20260709 13:13:38.311694 28580 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:38.312045 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:38.296742 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.314798 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:38.315090 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:38.316089 29254 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:38.317544 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:38.317838 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.318902 29252 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:38.322214 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:38.322989 28722 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:38.325153 28728 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:38.328320 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:38.329834 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:38.272985 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.331199 29259 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:38.293607 28575 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:38.356438 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:38.357659  2580 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:38.358798  2580 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.359053  2233 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.172058  2382 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.362929  2573 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.364966  2573 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.365561  2421 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.366101 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:38.366468  2421 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.367208 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:38.368435 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:38.369406 28581 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.369807  2463 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:38.370186  2093 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.371124  2093 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.371785 29258 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:13:38.372226  2326 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.374151  2309 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.374890 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:38.218204  2601 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.376060 28577 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 21: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:38.376995 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.368630 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:38.385629 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:38.351897  2612 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.382470 28572 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
W20260709 13:13:38.396929 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 66831us
I20260709 13:13:38.403385 29256 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:38.403730  2093 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:38.398882  2532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.012s	sys 0.004s
W20260709 13:13:38.405589  2532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.012s	sys 0.004s
I20260709 13:13:38.407035 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:38.409129  2364 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:38.410485 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.411453 28650 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:38.412817  2307 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:38.415179  2607 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:38.415931  2607 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.417207 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:38.418340 28580 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:38.418573  2607 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.419256 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.419970  2360 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:38.425184 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.426307  2421 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.425189 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.429458 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:38.432721 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.399036 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.398856  2352 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.304665 28475 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.439766 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:38.445101 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 136168us
W20260709 13:13:38.437621 29223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.035s	sys 0.032s
I20260709 13:13:38.441840 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:38.460400  2307 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:38.461426 29223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.036s	sys 0.032s
I20260709 13:13:38.461385 28726 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:38.466919 28581 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:38.468266 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:38.468806  2307 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:38.469333  2307 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.469755  2307 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.439833  2530 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:38.473929  2308 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:38.475386  2308 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:38.475884  2308 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:38.477110 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 646330us
I20260709 13:13:38.478252 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:38.465310  2612 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.483719 29259 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
W20260709 13:13:38.484370 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 172623us
I20260709 13:13:38.486711  2382 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.486528  2530 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.493548  2308 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.495458  2308 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:38.496064  2404 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.466516  2607 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:13:38.468315  2591 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:38.500517  2591 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.450277  2352 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.510946 29254 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:38.504770 28651 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:13:38.504786 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:38.513392 28651 pending_rounds.cc:85] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 12
I20260709 13:13:38.525692 29252 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 11.
W20260709 13:13:38.550915 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 80660.6us
I20260709 13:13:38.526304 28651 pending_rounds.cc:107] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:13:38.554386 28651 raft_consensus.cc:2889] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:38.526091  2364 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:38.500998  2361 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.505976  2352 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.558907 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.509356  2309 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:38.503399  2591 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.562883 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.506803  2299 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:13:38.564673 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 141357us
I20260709 13:13:38.572556 28726 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:38.569666 28620 leader_election.cc:336] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.916s (SENT)
I20260709 13:13:38.574879 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:38.562930  2404 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:38.582139  2526 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:38.567956  2299 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:38.577994  2530 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.585979 28721 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:38.587349 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:38.605188 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 127103us
I20260709 13:13:38.614071 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:38.618594 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55371.2us
I20260709 13:13:38.589591 28729 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:38.600073 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:38.611004 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:38.642896 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 73811.5us
I20260709 13:13:38.584283 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:38.587570  2612 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.590464 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:38.650683  2421 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:38.585460 29256 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:38.655400 28726 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
W20260709 13:13:38.655771 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55824.1us
W20260709 13:13:38.618754  2569 consensus_meta.cc:287] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.745s	user 0.014s	sys 0.005s
I20260709 13:13:38.597843  2573 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.658483 28722 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
W20260709 13:13:38.659157 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48308.9us
I20260709 13:13:38.624789  2608 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.596424  2625 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:38.675922  2660 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:38.677906 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 93825.5us
I20260709 13:13:38.680624 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:38.612823  2477 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:13:38.614511  2621 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:13:38.622359  2596 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.660076  2612 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:38.613583  2487 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:13:38.676487  2660 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.690748 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:38.603524  2299 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.697944 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:38.684278  2307 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.674376  2308 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:38.720991 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:38.722663  2640 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.502s	user 0.014s	sys 0.002s
I20260709 13:13:38.723301  2307 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.700477  2660 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:38.690165  2233 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:38.723441  2662 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:38.735244 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.731652 28547 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:38.739475 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.718678  2591 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:38.746490 28575 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:38.747773  2591 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.750030  2568 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:38.750722  2568 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:38.752019  2568 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.757701 29258 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:13:38.745958  2308 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.758994 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:38.759702 28647 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:13:38.761098 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:38.761322 28620 leader_election.cc:336] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.105s (SENT)
I20260709 13:13:38.761571  2573 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:38.761785 28654 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:38.763002  2628 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.763537  2628 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.765780 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:38.767603 28656 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:38.768371 28545 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:38.769510  2628 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.772037  2655 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.774854 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:38.775394  2606 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:38.719003  2530 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:13:38.776346 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:38.778791  2233 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:38.767654  2656 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:13:38.782344  2659 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.196s	user 0.003s	sys 0.000s
W20260709 13:13:38.785039  2458 consensus_meta.cc:287] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.602s	user 0.014s	sys 0.000s
W20260709 13:13:38.785239 28575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2925) took 1684 ms (client timeout 1576 ms). Trace:
I20260709 13:13:38.785637  2458 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:38.785789 28575 rpcz_store.cc:269] 0709 13:13:37.100475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:37.100660 (+   185us) service_pool.cc:224] Handling call
0709 13:13:37.652144 (+551484us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400323320. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8ddc0 00007f4a27e19e18 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6
0709 13:13:38.267524 (+615380us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4c002ea280. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a260e2a20 00007f4a260f3a29 00007f4a260b9644 00007f4a260e0f2d 00007f4a260e0b93 00007f4a27e1118b 00007f4a27e11cb5 00007f4a27e0cf30 00007f4a27e0e7de 00007f4a27e1a27c 00007f4a2cddbb17
0709 13:13:38.785130 (+517606us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847490048}
I20260709 13:13:38.787178 29257 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:13:38.787679  2658 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:13:38.767654 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.753830  2662 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:38.790143  2665 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.197s	user 0.003s	sys 0.000s
I20260709 13:13:38.790239  2662 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.737929  2612 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.798746  2299 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:38.717571  2625 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.800207 28724 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:38.800201 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:38.801131  2421 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:38.801509  2421 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:38.801635  2364 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:38.801978 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:38.802687 28648 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:38.802559  2421 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.768886 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:38.803654 28656 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:38.804097  2421 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:38.799649 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:38.804975 28648 raft_consensus.cc:1240] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:38.809556 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:38.817530 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 165444us
I20260709 13:13:38.824203 28651 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:13:38.837035 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 66068.4us
W20260709 13:13:38.839990 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.837107 28650 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:38.837715 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:38.838217 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 140355us
I20260709 13:13:38.812340 28722 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:38.824051 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:38.849690 28647 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:38.814747 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:38.823346 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:38.856156 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.857327 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.825871 28475 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 8 to 9, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 9 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.859530 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:38.860523 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.817319  2596 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.837286  2595 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:13:38.822022  2326 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:38.834538  2462 consensus_meta.cc:287] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.002s
I20260709 13:13:38.805517  2477 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:38.861881  2462 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.862437  2477 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:38.863358 28579 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:38.864210  2668 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:38.865209  2462 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.864816  2668 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.865631  2591 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.860198 28475 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.854120 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:38.872960 28654 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:38.852094 29251 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:38.877249 28656 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:13:38.866245  2623 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:38.864755  2233 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:38.899662 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 50556.3us
I20260709 13:13:38.885056 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.830415  2660 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:38.885564 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 155543us
W20260709 13:13:38.907969 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 48559.9us
I20260709 13:13:38.882109  2458 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.915608 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:38.912449 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:38.918663 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:38.921094 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 254782us
I20260709 13:13:38.923385 29260 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:38.931159 28620 leader_election.cc:336] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.106s (SENT)
I20260709 13:13:38.907037  2462 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:38.925105 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:38.938582 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.944739  2668 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:38.945863  2403 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:38.947070  2403 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:38.947430  2403 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:38.948050 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.949193  2602 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:38.948369  2403 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.951794  2586 raft_consensus.cc:2764] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:13:38.952757 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 129660us
I20260709 13:13:38.955143 29259 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:38.956117  2391 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:13:38.956419 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.957237  2391 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:38.947065  2612 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.957732  2391 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:38.958046  2638 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.958565  2638 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.958781  2391 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.959225  2608 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.959170  2660 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:38.960058  2391 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:38.960191 29253 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:38.961128  2589 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:38.917182  2625 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.957254  2308 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.910564  2623 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:38.961762  2557 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:38.962298  2557 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.962692  2557 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:38.962958  2623 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.956048 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:38.965535 28647 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:38.966452  2609 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:13:38.966868 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59129.7us
I20260709 13:13:38.967581  2609 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:38.967993 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:38.968987  2421 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.969175  2458 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:38.969604  2458 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:38.970449  2458 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.971661  2458 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:38.966506 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:38.974144  2660 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:38.974231 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:38.974573  2660 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.974934  2660 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:38.975776  2595 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:38.976429 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:38.977458 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.977943  2532 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.978443  2532 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:38.979732  2591 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:38.980149  2595 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:38.980679  2532 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:38.981848  2233 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:38.982232  2403 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:38.960798  2638 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:38.980152  2591 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.984202 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:38.984771 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:38.933576  2364 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:38.985369 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:38.985864  2596 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:38.986150 28574 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:38.986747 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:38.945680  2477 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:38.989187 28647 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:38.943241 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:38.989094 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:38.997180 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:38.999706 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:39.002010 28577 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:38.992556 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:39.012960 28575 raft_consensus.cc:2410] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:13:39.008033 28652 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:38.991128  2233 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.016395 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:39.016981 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:38.991550  2589 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:39.021445 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 53732.7us
I20260709 13:13:38.999194  2591 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:38.994926  2532 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.048593 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:39.027889 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:39.044132 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:39.051765 28656 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:39.027717 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:39.056354 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:39.059077 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.059516 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:39.061192 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:39.065699 28722 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:39.065876 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:39.018575  2609 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.022878  2233 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:39.064385 28725 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:39.027305  2308 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:39.069314 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:39.069288 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 148080us
I20260709 13:13:39.075716 29259 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
W20260709 13:13:39.077342 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65982.3us
I20260709 13:13:39.028520  2364 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:39.081064 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:39.081858 29257 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:39.057073  2282 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:39.057431  2532 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.085754 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:39.086566  2532 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:39.080102 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:39.086722 28653 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:13:39.096423  2589 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:39.070220  2477 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:39.105439 29260 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 11.
I20260709 13:13:39.106962 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:39.112754 28647 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:39.115989  2561 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:13:39.121142  2671 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:39.126965 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 139177us
I20260709 13:13:39.080691  2602 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:13:39.141872 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69872.9us
I20260709 13:13:39.106945  2668 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.156204 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:39.161829 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:39.169380 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 100398us
I20260709 13:13:39.171445 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:39.172741 28656 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:39.143947  2532 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:39.180363 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 73485.7us
I20260709 13:13:39.184916  2596 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:39.185774  2596 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:39.079850  2609 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:39.195041 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 56579.3us
I20260709 13:13:39.209260 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:39.218241 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:39.218545  2596 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:39.221378 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59639.3us
I20260709 13:13:39.222481 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:39.225109 28473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 278) took 31735 ms (client timeout 15000 ms). Trace:
I20260709 13:13:39.208669  2421 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:39.229465  2679 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:13:39.214385  2307 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:39.232756  2307 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.233536  2307 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:39.234172 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 190179us
I20260709 13:13:39.218271 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:39.235775 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 78365us
I20260709 13:13:39.218541 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:39.248116 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:39.249207 28729 pending_rounds.cc:85] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 11
I20260709 13:13:39.249636 28729 pending_rounds.cc:107] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:13:39.249940 28729 raft_consensus.cc:2889] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:39.253934 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 124599us
I20260709 13:13:39.204470  2607 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:39.261862 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:39.205092  2602 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:39.228536  2660 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.186676  2668 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.243017  2568 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.141742  2364 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.288182 28575 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 19: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:39.232683  2557 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.262142  2640 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:39.297503 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:39.298355 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 76034.2us
W20260709 13:13:39.316000 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 145487us
I20260709 13:13:39.310688  2610 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:39.319715  2288 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:13:39.321276 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:39.322418  2602 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:39.323761  2675 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:13:39.326747 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:39.330545  2233 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.313923 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:39.343679 28577 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:39.310405  2652 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 13:13:39.357988 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 58684.4us
W20260709 13:13:39.366531 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:39.371304 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.299500  2607 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.385511 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:39.411943  2307 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:39.413780 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 121479us
I20260709 13:13:39.415109  2607 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:39.415380 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:39.316547  2568 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.419049  2568 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:39.421072 28724 raft_consensus.cc:2410] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:13:39.422013  2591 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.424330  2591 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:39.424988 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 53635.4us
W20260709 13:13:39.445324 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 59945.8us
I20260709 13:13:39.445595  2557 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:39.446512  2561 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:39.447091  2561 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.447422  2561 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:39.448247 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:39.425665  2625 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:39.427073  2458 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:39.449872  2458 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:39.450034  2609 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:39.450402  2458 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:39.370451  2610 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.451018  2638 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:13:39.453329 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 132120us
I20260709 13:13:39.454828 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:39.455668 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:39.428966  2661 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:13:39.434010 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:39.427809  2681 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:13:39.435250  2688 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:13:39.441437 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 127742us
I20260709 13:13:39.442417  2648 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:39.442839 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:39.444130  2683 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 13:13:39.449689  2671 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:39.455399  2612 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:39.427412  2686 log.cc:927] Time spent T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:13:39.225854 28473 rpcz_store.cc:269] 0709 13:13:07.489832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.491440 (+  1608us) service_pool.cc:224] Handling call
0709 13:13:39.224699 (+31733259us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:31.436656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:31.538943 (+102287us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:31.539001 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:13:31.539023 (+    22us) tablet.cc:662] Decoding operations
0709 13:13:31.540673 (+  1650us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:31.540776 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:31.540820 (+    44us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:13:31.811539 (+270719us) tablet.cc:701] Row locks acquired
0709 13:13:31.811606 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:13:31.811908 (+   302us) write_op.cc:270] Start()
0709 13:13:31.812101 (+   193us) write_op.cc:276] Timestamp: P: 1783602811811823 usec, L: 0
0709 13:13:31.812149 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:13:31.841617 (+ 29468us) log.cc:844] Serialized 6230 byte log entry
0709 13:13:32.823917 (+982300us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180042b5c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:33.176838 (+352921us) op_driver.cc:464] REPLICATION: finished
0709 13:13:33.343486 (+166648us) write_op.cc:301] APPLY: starting
0709 13:13:33.354540 (+ 11054us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:34.436722 (+1082182us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:34.436770 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:35.011627 (+574857us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:35.012007 (+   380us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:13:35.012067 (+    60us) write_op.cc:312] APPLY: finished
0709 13:13:35.012492 (+   425us) log.cc:844] Serialized 148 byte log entry
0709 13:13:35.198708 (+186216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:35.198878 (+   170us) write_op.cc:454] Released schema lock
0709 13:13:35.198968 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:35.202376 (+  3408us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:35.202406 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1385288,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":142255,"apply.run_cpu_time_us":81455,"apply.run_wall_time_us":1858936,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70975,"num_ops":16,"prepare.queue_time_us":367395,"prepare.run_cpu_time_us":73281,"prepare.run_wall_time_us":794073,"raft.queue_time_us":158602,"raft.run_cpu_time_us":11562,"raft.run_wall_time_us":68012,"replication_time_us":1364329,"spinlock_wait_cycles":23575936,"thread_start_us":777200,"threads_started":5,"wal-append.queue_time_us":527060,"wal-append.run_cpu_time_us":19028,"wal-append.run_wall_time_us":2299519}]]}
I20260709 13:13:39.456404 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:39.456961 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:39.457926  2308 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:39.479177 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:39.480123 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:39.480751 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:39.488111 29254 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:39.458294 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:39.458316 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.474367 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:39.466207 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:39.467527 29253 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:39.484722 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:39.492357 29252 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:39.452818  2610 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:39.457144  2557 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:13:39.458041  2648 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:39.494840 28620 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.889s (SENT) [suppressed 21 similar messages]
I20260709 13:13:39.499405  2608 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:39.500706 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:39.495458  2591 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:39.499415  2648 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:39.502067  2403 consensus_meta.cc:287] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
I20260709 13:13:39.460969  2660 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:39.495783 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:39.496729 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:39.504070 28724 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:39.504581  2591 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:39.504990  2591 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:39.505393  2591 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:39.497427 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:39.457398  2382 consensus_queue.cc:1059] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:13:39.455662  2307 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:39.497242  2606 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:39.515887 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:39.516906  2558 raft_consensus.cc:3055] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:39.495124 28726 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:39.520298 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:39.525640 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:39.526489 28725 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:13:39.527630 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69470.5us
I20260709 13:13:39.539863 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:39.541370 28726 raft_consensus.cc:2393] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:39.550097 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 52739.1us
I20260709 13:13:39.551308 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:39.552310  2382 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:39.546490  2589 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:39.557713  2589 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:39.559029  2589 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:39.539479  2568 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:39.561724  2568 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:39.523247  2558 raft_consensus.cc:740] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:39.563002  2568 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:39.563757  2558 consensus_queue.cc:260] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.566012  2233 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:39.566802  2606 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:39.527259  2662 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:39.568063 28579 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:39.568130 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:39.552755 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:39.569720 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:39.568885 29223 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:39.582710 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.589401 28725 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:39.567655 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:39.658350 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 105677us
I20260709 13:13:39.539673  2307 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:39.673089 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:39.680701 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:39.683277 28695 leader_election.cc:400] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:39.683673 28695 leader_election.cc:403] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:13:39.687810 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 118973us
I20260709 13:13:39.689088 29223 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:39.665131  2606 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:39.689929 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:39.557736  2458 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.674297  2660 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:39.745173 29254 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:39.708132 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:39.594350  2662 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:39.671830  2299 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:13:39.683100  2668 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:39.761466 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:39.771981 28620 leader_election.cc:336] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.188s (SENT)
I20260709 13:13:39.782383 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:39.783978 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 126997us
I20260709 13:13:39.772792 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:39.704329  2532 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:39.774895 29257 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:39.758044 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:39.737283  2671 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:39.700151  2288 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:39.778180  2694 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:13:39.778625 28648 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:39.691619  2595 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:13:39.805083  2687 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:39.809636 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:39.786289 28649 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:39.810465 28575 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 18: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:39.777911  2648 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.788069  2591 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.797541  2662 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:39.797166  2288 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.798110  2458 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:39.787393  2532 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.798590  2671 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:39.758980  2660 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.703742  2652 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:13:39.708760  2606 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:39.751534  2596 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:39.812031 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:39.815917 29257 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:39.835790 29252 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:39.858712 28577 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
W20260709 13:13:39.855113 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 83192us
I20260709 13:13:39.814671  2299 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:39.829814  2551 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:39.832731  2532 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:39.831509  2610 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.882922  2473 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:39.892655  2671 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:39.898571 28620 leader_election.cc:336] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.694s (SENT)
I20260709 13:13:39.899675 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:39.881490  2458 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:39.870196  2477 consensus_queue.cc:1059] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:13:39.913166 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 233353us
I20260709 13:13:39.917124  2606 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.921427  2288 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:39.926126  2660 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:39.927238  2591 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:39.919961  2391 raft_consensus.cc:3055] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:39.929803  2561 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.882381  2610 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:39.931545  2648 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:39.907069  2458 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:40.002365 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 250951us
I20260709 13:13:39.971122  2391 raft_consensus.cc:740] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:40.003373 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:40.009845 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 320822us
I20260709 13:13:40.011790 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.014326 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:40.016255 28695 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:40.018366 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:40.030639 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.013741  2648 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:40.029814 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.035221 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.025544  2652 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:40.079593 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.080451 28722 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:40.032750  2660 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:40.082196 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:40.017800  2532 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.066681  2561 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.057358  2391 consensus_queue.cc:260] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.100811 28572 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:40.082876  2648 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:13:40.090166  2640 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:40.104804 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 64629.7us
I20260709 13:13:40.109153 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:40.154824  2702 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.355s	user 0.003s	sys 0.000s
W20260709 13:13:40.155767 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.157156  2689 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.484s	user 0.006s	sys 0.000s
I20260709 13:13:40.145285  2610 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:40.158229  2717 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:13:40.161361  2648 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:40.162009  2648 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.163372 28722 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:40.164229  2648 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:40.164790  2391 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:40.166112  2532 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.166741  2458 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.149706  2640 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.167651  2640 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:40.170188  2299 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:40.170425 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 281603us
I20260709 13:13:40.169863  2640 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:40.174093 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.175040 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:40.186533 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.187266 28725 raft_consensus.cc:2393] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:40.189910 28725 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:40.194346 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:40.193068 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:40.201035 28572 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:13:40.196887 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:40.175493  2660 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:40.211102 28579 raft_consensus.cc:2368] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:40.213873 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:40.216574 28653 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:40.187112  2307 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.195763  2640 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.188727  2607 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:40.224664  2722 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:40.230937 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.238334 28724 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:40.231104 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 230954us
I20260709 13:13:40.224402 28652 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:13:40.232890 28649 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:40.231916 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.235496 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:40.240974 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:40.250532 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 79372.9us
I20260709 13:13:40.226313  2660 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:40.235986  2307 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:40.257285  2462 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:40.259896 28728 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:13:40.237553  2722 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.248710  2288 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:40.253276  2607 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:40.289857 28649 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:13:40.291016 28620 leader_election.cc:336] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.229s (SENT)
I20260709 13:13:40.280985  2608 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:40.237464  2640 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:40.284453  2722 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:40.279934  2382 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:13:40.304476 28653 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:40.334755  2722 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.337193 28725 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:40.338469  2640 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:40.323181  2719 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:13:40.340329 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.297729  2608 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.341225  2660 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.343345  2608 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:40.343956 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.345847 28724 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:40.350246 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1414) took 1360 ms. Trace:
I20260709 13:13:40.353873  2722 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.365471 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.350911 28654 rpcz_store.cc:276] 0709 13:13:38.990182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.990327 (+   145us) service_pool.cc:224] Handling call
0709 13:13:40.349990 (+1359663us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b540006d6d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:40.350164 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772986112}
W20260709 13:13:40.385133 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.383271 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1883) took 1305 ms. Trace:
W20260709 13:13:40.386502 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 203758us
W20260709 13:13:40.393308 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.393772 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:40.379014  2610 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:40.393030 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:40.386080 29251 rpcz_store.cc:276] 0709 13:13:39.073607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.082434 (+  8827us) service_pool.cc:224] Handling call
0709 13:13:39.108327 (+ 25893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.262790 (+154463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.262842 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:39.284844 (+ 22002us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.785469 (+500625us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:39.785530 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.377125 (+591595us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54006cbe54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:40.377198 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:40.377262 (+    64us) raft_consensus.cc:1685] finished
0709 13:13:40.377281 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.379057 (+  1776us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9689,"raft.queue_time_us":9869,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14171,"spinlock_wait_cycles":299957120,"thread_start_us":471759,"threads_started":1,"wal-append.queue_time_us":602465}
I20260709 13:13:40.394506 29252 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:40.397744 29257 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:40.383085  2722 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.412621 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.424315 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:40.424571  2288 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:40.425042 28649 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:40.425104  2722 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.425936  2610 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.427841  2722 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.344933  2607 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.429062 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.430625 28653 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:40.423561 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:40.431378 28654 raft_consensus.cc:2368] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:40.442436  2558 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:40.447634 28649 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
W20260709 13:13:40.448740 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.450486 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:40.451146 28652 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:13:40.456224 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:40.457252 29252 raft_consensus.cc:2368] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:13:40.498705 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.498996 28652 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:40.499854 28649 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:40.502213 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:40.502888 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:40.502992 29253 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
W20260709 13:13:40.510694 28620 leader_election.cc:336] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.912s (SENT)
I20260709 13:13:40.511437 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:40.515143 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.515779 28649 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:40.519743 28575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:40.518621 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:40.520579 28575 raft_consensus.cc:606] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:40.520938 28575 raft_consensus.cc:614] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:40.517869  2734 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:40.522871 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:40.523461 28649 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:40.524199  2307 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.527482  2660 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.529559 28547 leader_election.cc:400] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:13:40.529881 28547 leader_election.cc:403] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:13:40.528052  2660 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.531680 29259 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:40.533349 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.534890  2568 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:40.535941 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:40.533430  2660 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.539903 28729 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:40.540192  2668 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.540007  2720 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:40.541828  2506 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:40.528087  2462 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.544735 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.548630  2640 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:13:40.585564 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 74909.6us
I20260709 13:13:40.586153  2640 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:40.587532 28724 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:13:40.587076  2640 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.551259  2734 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:40.554042  2737 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:13:40.557562  2595 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:40.561154  2557 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.563727 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:40.565351  2612 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:40.598619 28574 raft_consensus.cc:2410] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:40.600940 28654 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 18. Ops: []
W20260709 13:13:40.566028 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 44403.3us
I20260709 13:13:40.566541  2628 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:40.567330  2722 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.567736 29224 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:40.567407 28622 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:40.569710  2558 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:40.572211  2610 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:40.635038  2648 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:40.570467 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:40.575333  2713 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:40.570287  2307 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.584028  2730 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:40.583915 28649 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:40.584390 29223 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:40.588317  2640 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:40.626488  2608 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:40.668494  2608 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:40.626948 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 59618.3us
I20260709 13:13:40.629477  2391 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:40.630242 28695 connection.cc:256] RPC call timeout handler was delayed by -2.2016433589999451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:13:40.631721 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 64046.2us
I20260709 13:13:40.603009  2568 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:40.590324  2506 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:40.625177  2557 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:40.590497  2462 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:40.634066  2722 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.705865 29224 leader_election.cc:400] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:40.634781 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.705565 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.635936 28650 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:40.707374 28655 raft_consensus.cc:2410] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:13:40.636936  2307 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:40.636451  2713 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:40.707736  2557 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.642083 29258 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: [11.13-11.13]
I20260709 13:13:40.652753 28547 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:40.597520  2668 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:40.657531 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 73215.5us
W20260709 13:13:40.709144 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 56483.7us
I20260709 13:13:40.662093 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:40.710150 28656 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:40.673250 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:40.711422 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:40.680460  2612 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
W20260709 13:13:40.675607 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 109033us
I20260709 13:13:40.686452 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:40.686721  2740 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
I20260709 13:13:40.677961  2608 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:40.678604  2725 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.683663  2391 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.669288  2660 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:40.689023  2648 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:40.706661 29224 leader_election.cc:403] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:13:40.642552 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.713697 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 148495us
I20260709 13:13:40.674224 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.743319 29251 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:40.743563 28649 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:13:40.714947 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:40.711802  2557 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:40.708294  2722 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:40.728669 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:40.735324 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:40.755775 28655 raft_consensus.cc:2368] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:13:40.755878 28577 raft_consensus.cc:2368] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18.
I20260709 13:13:40.756644 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.732211  2652 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:13:40.757851 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.740139  2725 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.758419 28655 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:40.760703  2725 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:40.724931 28652 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:40.671696  2730 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.767168 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:40.769312 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:40.749119 28653 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:40.750532 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.750891  2462 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.751221 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.751350 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.777778 28728 raft_consensus.cc:2410] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:40.753182 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.753862 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.756815 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.741480  2607 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:40.761924 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.739537 28574 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:40.694231  2568 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:40.764297 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 74201.9us
I20260709 13:13:40.812294 28652 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
W20260709 13:13:40.765432 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.810052 28723 raft_consensus.cc:2376] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15. Re-sending same reply.
I20260709 13:13:40.736055 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.814417 28725 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:13:40.720110  2712 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:40.772498 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:40.789305 29257 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:40.818516  2712 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:40.818993  2712 raft_consensus.cc:3060] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:40.812106 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.821440 28729 raft_consensus.cc:2368] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 13. Current term is 14.
I20260709 13:13:40.762847  2557 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.827872 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:40.830034 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:40.830716 28580 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:40.829955 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.834431 28656 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:40.829504 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:40.883028 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 53578.5us
I20260709 13:13:40.837448 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.885532 28728 raft_consensus.cc:2410] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:13:40.886466  2606 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:40.886345  2712 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.887140  2606 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.887656  2606 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:40.837570 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 70097.8us
I20260709 13:13:40.890829 28722 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:40.892858 28652 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:40.893337  2640 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:40.894827  2712 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:40.895200  2640 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:40.766495  2652 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:40.838574 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:40.778842  2749 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:13:40.840008 28653 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:40.841411 28721 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:40.842929 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.801218  2725 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:40.900125  2725 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.903154  2725 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:40.903901  2725 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:40.904362  2725 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:40.847229 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.817850  2720 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.905701 28729 raft_consensus.cc:2410] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:13:40.905441  2720 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:40.907174  2299 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.908396  2720 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:40.777930  2714 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:40.866888 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:40.909567 28576 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:13:40.909901  2720 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:40.810585  2477 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:13:40.706013  2506 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.910455  2720 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:40.836959  2557 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:40.909469  2714 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.907909  2299 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.915413  2714 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:40.915882  2299 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:40.912809  2720 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:40.917281  2725 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.880098 28575 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:40.877807 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:40.921308 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:40.925228  2557 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.927259 28572 raft_consensus.cc:2368] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:40.928969 28655 raft_consensus.cc:1240] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:13:40.811129  2746 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.098s
W20260709 13:13:40.933904 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.934614 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.742388  2713 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.946868 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:40.831409  2607 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:40.961942  2307 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:40.962386  2750 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:13:40.962512 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:40.962845  2742 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:13:40.962848  2743 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:13:40.963603  2391 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:40.992352 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 135977us
I20260709 13:13:40.933784  2458 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:41.086230 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:41.057353 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 83890.1us
I20260709 13:13:41.089291 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.092428 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.083573 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:41.057397 28579 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:13:41.102995 28729 raft_consensus.cc:2376] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15. Re-sending same reply.
I20260709 13:13:41.108287 28580 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:40.964948  2668 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:41.110484 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 282686us
I20260709 13:13:41.118602 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:41.083710  2729 log.cc:927] Time spent T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:41.120790 28722 raft_consensus.cc:2468] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:41.118609 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:41.127508 28620 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.831s (SENT)
W20260709 13:13:41.088846  2744 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:13:41.133922 28579 raft_consensus.cc:1217] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Deduplicated request from leader. Original: 17.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 13:13:41.134959 28579 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:13:41.136709 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.106482  2660 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:41.137506 28726 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:41.139600 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:41.140618 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:41.116698  2458 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:41.147508 29224 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:13:41.158774 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 267012us
I20260709 13:13:41.159039 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.160006 28726 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:13:41.140872  2668 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:41.180989 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:41.184109 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:41.152931  2714 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:41.159664  2730 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:41.184978 28722 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:13:41.189098 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.162675  2557 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:41.194514 28721 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:41.194977 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:41.203928 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 85374.1us
I20260709 13:13:41.164942  2668 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:41.200783 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:41.187676 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:41.193969 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:41.202593 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.171770  2760 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:41.210883 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:41.208035 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:41.212324 28580 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 19: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:41.200719 28722 pending_rounds.cc:85] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 9
I20260709 13:13:41.197333  2652 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:41.207855 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.213078 28722 pending_rounds.cc:107] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:13:41.213485 28722 raft_consensus.cc:2889] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:41.213644 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:41.214359 29252 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:41.185416  2662 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:41.179561  2761 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:41.219766 28729 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:41.225466 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:41.225437 29253 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:41.230172 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:41.212296  2668 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:41.244486 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 119243us
I20260709 13:13:41.288594 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2819) took 1104 ms. Trace:
W20260709 13:13:41.290874 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 51568.9us
I20260709 13:13:41.290784 28648 rpcz_store.cc:276] 0709 13:13:40.184108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.184291 (+   183us) service_pool.cc:224] Handling call
0709 13:13:40.184885 (+   594us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:40.213651 (+ 28766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.213694 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:40.228444 (+ 14750us) log.cc:844] Serialized 52 byte log entry
0709 13:13:40.546097 (+317653us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b18000d33c0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:40.715181 (+169084us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:40.715222 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.715287 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.241417 (+526130us) raft_consensus.cc:1685] finished
0709 13:13:41.241448 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.288510 (+ 47062us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21601,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":11535,"spinlock_wait_cycles":12208512,"thread_start_us":168879,"threads_started":1,"wal-append.queue_time_us":597196}
I20260709 13:13:41.317135 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:41.332435 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 204926us
I20260709 13:13:41.225569  2761 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.200114  2714 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:41.348806 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 161241us
I20260709 13:13:41.349931 29224 leader_election.cc:400] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:13:41.332149 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:41.240667  2760 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:41.389151 28577 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:41.349090  2726 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.111s	user 0.000s	sys 0.008s
I20260709 13:13:41.395671 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:41.417266  2752 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:13:41.418445  2763 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:13:41.211508  2660 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.351788  2761 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:41.368219  2288 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:41.432216 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:41.433228 28648 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:41.409348  2730 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:41.436866  2730 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:41.437326  2730 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:41.437641  2700 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.438202  2700 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.440469  2700 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:41.441893 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:41.241303  2458 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.446417  2714 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:41.447068  2714 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.447646  2714 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.454878 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:41.464214 28653 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
W20260709 13:13:41.458770  2606 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:13:41.426826  2607 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:41.423528  2652 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:41.461431 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:41.452745  2608 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.688s	user 0.008s	sys 0.000s
I20260709 13:13:41.465545 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:41.511046 28580 raft_consensus.cc:606] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:41.466663 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:41.479702 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:41.507120 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.514410 28581 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:41.515805 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:41.427150  2288 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:41.516738  2288 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:41.516606 28581 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:41.520413 28581 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:13:41.509917 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.521307  2760 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.522994 29224 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:41.524848  2648 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:41.525489  2648 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:41.526032  2648 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:41.535003 28575 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:41.537024  2648 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.479429  2606 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:41.540426  2606 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:41.542306 28577 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:41.425876  2307 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.566318 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 44803.7us
I20260709 13:13:41.570395 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:41.553359 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:41.571228 28651 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:41.585132 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:41.605809 28620 leader_election.cc:336] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.672s (SENT)
I20260709 13:13:41.850530 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:41.540683  2648 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:41.632591 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:41.572894  2765 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:41.576005  2712 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 13:13:41.564049  2608 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.610836  2660 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:41.687994 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:41.872454 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 266691us
I20260709 13:13:41.575294  2307 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:41.757927 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 178134us
W20260709 13:13:41.791595 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 456173us
I20260709 13:13:41.671864  2391 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:41.674626  2762 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:41.861941 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.863687 29255 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:41.869323 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 403792us
W20260709 13:13:41.873340 28620 leader_election.cc:336] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.865s (SENT)
I20260709 13:13:41.873340 28729 raft_consensus.cc:2393] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 21: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
W20260709 13:13:41.921574 28726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.026s	sys 0.037s
I20260709 13:13:41.866163  2403 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:41.925578 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52272.7us
W20260709 13:13:41.926463 28620 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.875s (SENT)
I20260709 13:13:41.926961 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:41.903918  2660 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:41.953102 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.006s	sys 0.026s
I20260709 13:13:41.915309  2628 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:41.978479 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:41.953783  2403 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.706523  2568 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:41.988359  2784 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:13:42.000875 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:41.872253  2765 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:41.955260  2660 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:42.014598  2786 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:13:41.943392  2391 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.102644  2391 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.055413 28728 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:13:42.056378  2795 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:41.925175  2762 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.011135  2753 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.105310  2753 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.107354  2753 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:42.108115 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:42.108507  2288 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.004s
W20260709 13:13:42.046732  2770 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:13:42.039073  2714 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.108771 28721 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
W20260709 13:13:42.068518 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 157055us
I20260709 13:13:42.113641 28651 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
W20260709 13:13:42.069144 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.007s	sys 0.026s
W20260709 13:13:42.072988 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 146564us
I20260709 13:13:42.074412 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:42.120335 28620 leader_election.cc:336] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.181s (SENT)
W20260709 13:13:42.076756 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.055472  2787 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:42.113538 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.128124 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.086704  2557 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:42.092105  2765 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:42.093546  2730 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.656s	user 0.013s	sys 0.000s
W20260709 13:13:42.095408  2761 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 13:13:42.097275  2568 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:42.056708  2307 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.098912  2403 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:42.099107  2791 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
I20260709 13:13:42.099906  2608 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.109393 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.109812 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.108995  2288 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.205824 28726 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
W20260709 13:13:42.205953 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85649.5us
I20260709 13:13:42.207005 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.208039 28726 raft_consensus.cc:2410] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:13:42.208189  2288 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:42.208909 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.209602 28726 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:42.210639 28726 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.121258 29255 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:42.214917  2734 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.215226  2532 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.215899  2532 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.215793  2734 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.218387  2532 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:42.223930  2734 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.225687  2762 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.226450  2762 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:42.227447  2780 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.365s	user 0.003s	sys 0.002s
I20260709 13:13:42.227092  2762 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.228754 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 2079) took 1067 ms. Trace:
I20260709 13:13:42.229152 29251 rpcz_store.cc:276] 0709 13:13:41.160865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.161191 (+   326us) service_pool.cc:224] Handling call
0709 13:13:41.161509 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:41.172425 (+ 10916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.172471 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:41.173291 (+   820us) log.cc:844] Serialized 26 byte log entry
0709 13:13:41.389571 (+216280us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:41.389616 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.389691 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.226776 (+837085us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:42.228420 (+  1644us) raft_consensus.cc:1685] finished
0709 13:13:42.228447 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.228668 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24969,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":15417,"spinlock_wait_cycles":5846784,"thread_start_us":162709,"threads_started":1,"wal-append.queue_time_us":453348}
I20260709 13:13:42.231510 28696 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:42.232596  2403 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.233351  2772 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.233104  2403 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.233856  2772 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.235721  2403 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:42.236049  2772 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:42.236387  2403 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:42.133993  2557 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.231398 28726 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:13:42.239563  2557 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.243780  2506 raft_consensus.cc:993] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
W20260709 13:13:42.070426 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 122082us
I20260709 13:13:42.122541 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.244747  2506 raft_consensus.cc:1081] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:13:42.245251 28580 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:42.123456 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.114105 28695 leader_election.cc:400] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18.
I20260709 13:13:42.128455 28725 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:42.129055 29258 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: [11.13-11.13]
W20260709 13:13:42.247409 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 325199us
I20260709 13:13:42.246337 28695 leader_election.cc:403] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:42.131558 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:42.133811 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.271693 28721 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:42.134511 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.135965  2758 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:13:42.197850 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.183459  2730 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.295452 29223 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:42.297812 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:42.298190  2760 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.299024  2725 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:42.298930  2760 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.273911 29260 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:42.302357  2713 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.416676  2713 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:42.425136 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 311208us
I20260709 13:13:42.438129 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:42.439014 28652 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:42.385044 28654 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:42.379706 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:42.447958 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:42.448167  2713 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:42.453184 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:42.448643 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:42.441493  2760 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:42.466066 28653 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:42.467449 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:42.468549 28651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:13:42.453155 28655 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:42.452895 28656 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:13:42.469237 28651 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:42.471369 28651 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:42.454950  2730 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.469641  2802 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:42.477501  2802 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.478011  2802 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:42.458055 28650 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:42.482470 28695 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:42.470033  2391 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18.
I20260709 13:13:42.483680  2391 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:42.484048 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:42.485219  2391 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:42.485540  2640 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:42.486217  2640 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:42.487332  2640 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.489581  2391 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:42.415707  2660 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.490947 29256 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 20: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:42.488903  2640 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:42.492249  2660 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:42.495589 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49584 (request call id 1443) took 1064 ms. Trace:
I20260709 13:13:42.496030 28654 rpcz_store.cc:276] 0709 13:13:41.431454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.431594 (+   140us) service_pool.cc:224] Handling call
0709 13:13:42.495412 (+1063818us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54003d4fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:42.495528 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005067648}
I20260709 13:13:42.497781 29257 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:13:42.498447 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1843) took 1299 ms. Trace:
I20260709 13:13:42.498744 29257 rpcz_store.cc:276] 0709 13:13:41.201618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.201900 (+   282us) service_pool.cc:224] Handling call
0709 13:13:42.497158 (+1295258us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:13:42.497364 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.498187 (+   823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.498391 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3981568}
I20260709 13:13:42.509160  2787 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:42.510514 28649 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:13:42.510682 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.513880  2801 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.514715 28650 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:42.515784  2762 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.517385 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:42.476765  2792 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.275s	user 0.001s	sys 0.001s
I20260709 13:13:42.359288  2532 raft_consensus.cc:2804] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:42.519793  2532 raft_consensus.cc:697] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:42.337476  2765 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.302098  2288 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.514817  2801 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.526013 28721 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:42.526181 28723 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:13:42.560024 28723 pending_rounds.cc:85] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 12
I20260709 13:13:42.560384 28723 pending_rounds.cc:107] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:13:42.560784 28723 raft_consensus.cc:2889] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:42.526401 28727 raft_consensus.cc:2393] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:42.263870  2403 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:42.527391 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 68550us
I20260709 13:13:42.524978 28651 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.533214  2606 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:42.564461  2606 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.566586  2606 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.530913  2765 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.567471 28546 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:42.568744  2765 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:42.533331  2308 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:42.569424  2796 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:42.569972  2796 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.569757  2308 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.570565  2796 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:42.572705  2308 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.534462 28729 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:42.573911  2714 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:42.576773  2595 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:42.576170  2714 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:13:42.578327  2747 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:42.578773  2747 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:42.535283 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:42.579681  2747 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.581139  2747 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:42.581445  2308 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:42.543220  2802 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.530431  2532 consensus_queue.cc:237] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:42.580925 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 45779.6us
I20260709 13:13:42.531256  2288 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.584429  2802 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.584662 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:42.185171  2761 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.585390  2595 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:42.585597  2558 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:42.585813  2288 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:42.526863 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 231485us
I20260709 13:13:42.588430  2761 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:42.536114 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52162.3us
I20260709 13:13:42.589798 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:42.592017  2787 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.592700  2725 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:42.593379  2725 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:42.594601  2725 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.592746  2787 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.598863  2787 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:42.569782 28651 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:42.602977 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.607779 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:42.612205 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:42.607631 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:42.613384 29256 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
W20260709 13:13:42.288818  2668 consensus_meta.cc:287] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.957s	user 0.012s	sys 0.006s
I20260709 13:13:42.616639  2668 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.618146 29259 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:42.619381 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1908) took 1156 ms. Trace:
I20260709 13:13:42.619668  2668 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:42.619717 29259 rpcz_store.cc:276] 0709 13:13:41.463079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.479271 (+ 16192us) service_pool.cc:224] Handling call
0709 13:13:41.514594 (+ 35323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.618525 (+1103931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.619166 (+   641us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540048ab54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:42.619326 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537422080}
I20260709 13:13:42.621893 28577 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:42.534274  2801 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:42.629874 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:42.631425 29260 raft_consensus.cc:2410] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:13:42.632967 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:42.634183 29258 raft_consensus.cc:2368] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20.
I20260709 13:13:42.638676  2403 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:42.640731 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:42.640976 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:42.641655 28572 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:42.641793 28579 raft_consensus.cc:2393] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 19: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:42.642035 28572 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:42.642983 28572 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.643997 28572 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:42.647030  2787 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:42.649490 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.653409 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:42.657595 28722 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
W20260709 13:13:42.666077 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 418964us
I20260709 13:13:42.677737 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.678427 28729 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:42.679896 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:42.682548 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:42.705256 28652 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:42.694104 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:42.693228 28622 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:42.709723 28572 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:42.719465 28622 leader_election.cc:400] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20.
I20260709 13:13:42.707585  2668 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:42.724273  2802 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:42.733808 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.765506 28729 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:42.735824  2747 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:42.740928 28622 leader_election.cc:403] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:13:42.755795 28722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 3032) took 1481 ms (client timeout 1672 ms). Trace:
I20260709 13:13:42.718014 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:42.755666 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.013s	sys 0.051s
I20260709 13:13:42.768822 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:42.771754 28572 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:42.766554 28693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.018s	sys 0.048s
W20260709 13:13:42.772838 28693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.018s	sys 0.048s
W20260709 13:13:42.773257 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.014s	sys 0.051s
W20260709 13:13:42.773402 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:42.773617 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 640534us
W20260709 13:13:42.773826 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.772938 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:42.771131 28722 rpcz_store.cc:269] 0709 13:13:41.229483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.229848 (+   365us) service_pool.cc:224] Handling call
0709 13:13:42.659018 (+1429170us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400281ed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:42.710430 (+ 51412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3002824576}
I20260709 13:13:42.775226 28727 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:42.775954 28547 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:42.780167 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62265.3us
W20260709 13:13:42.781185 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.784579 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:42.786295 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 67005.3us
I20260709 13:13:42.788645 28547 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:42.796855 28723 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:13:42.821555 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.712006  2403 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260709 13:13:42.832504 28620 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.009s	sys 0.032s
W20260709 13:13:42.832828 28620 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.032s
W20260709 13:13:42.833196 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 626096us
I20260709 13:13:42.807246 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:42.834159 28621 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:42.834489 28729 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:13:42.793943  2714 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:42.797369  2551 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:42.797137  2767 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:42.828934  2777 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:13:42.834414 28724 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.018s	sys 0.053s
W20260709 13:13:42.854000 28724 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.018s	sys 0.053s
W20260709 13:13:42.798816  2700 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.010s	sys 0.010s
W20260709 13:13:42.834189 28620 leader_election.cc:336] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.889s (SENT)
I20260709 13:13:42.828727  2775 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:42.838394 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.770329  2668 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.869426 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:42.877645 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.869426 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.798807 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:42.850919 29259 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:13:42.877321 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.851208  2308 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.851665 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.855814 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.848693 28572 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:13:42.853078 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.858768 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:42.858811 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:42.854988 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:42.874689 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.808341  2802 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:42.863704 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.870642 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:42.894531 29257 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:42.895109 28577 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
W20260709 13:13:42.884205 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 85498.3us
W20260709 13:13:42.857966  2700 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.011s	sys 0.011s
I20260709 13:13:42.906337 28576 raft_consensus.cc:2368] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
I20260709 13:13:42.894441 28579 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:42.799167  2762 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.901604 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.903563 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2570) took 1692 ms. Trace:
I20260709 13:13:42.910413 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:42.911490 29259 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:42.855834  2595 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:42.914927 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:42.912842 28724 rpcz_store.cc:276] 0709 13:13:41.165664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.165783 (+   119us) service_pool.cc:224] Handling call
0709 13:13:41.196670 (+ 30887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.196944 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:41.581471 (+384527us) log.cc:844] Serialized 14 byte log entry
0709 13:13:42.856951 (+1275480us) log.cc:844] Serialized 14 byte log entry
0709 13:13:42.857208 (+   257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.857272 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:42.857338 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.857423 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.857566 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132796,"prepare.queue_time_us":283882,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":25670,"raft.queue_time_us":146398,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":64421,"thread_start_us":1545618,"threads_started":3,"wal-append.queue_time_us":528722}
W20260709 13:13:42.921180 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.846352  2403 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.925419 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.926488 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:42.927282 28574 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:42.893286  2775 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:42.885842  2714 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:42.880410  2804 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:13:42.945528 28573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.028s	sys 0.040s
W20260709 13:13:42.945996 28573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.028s	sys 0.040s
W20260709 13:13:42.939206 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 105032us
W20260709 13:13:42.946885 28620 leader_election.cc:336] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.002s (SENT)
I20260709 13:13:42.947427 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:42.848385  2722 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:13:42.901121  2807 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:42.870905  2458 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:13:42.901345  2777 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:42.914147  2713 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:42.961558 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.955442  2462 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:42.925426  2760 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:42.969364 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:42.969992 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:42.901103  2308 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.946202  2775 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:42.938930  2608 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:42.972023 28547 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:42.880247  2796 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.906030  2802 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.974694 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:42.969623  2568 consensus_meta.cc:287] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.002s
I20260709 13:13:42.925835  2762 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:42.915831  2660 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:13:42.963258  2807 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:42.974880 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:42.929078  2753 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:13:42.981583 29256 raft_consensus.cc:2393] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 22: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:42.946247  2403 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:42.983177 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:43.021960 28730 raft_consensus.cc:2410] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 12 because replica has last-logged OpId of term: 11 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
W20260709 13:13:43.024246 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 77405.8us
W20260709 13:13:43.026895 28620 leader_election.cc:336] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.105s (SENT)
I20260709 13:13:43.027442 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:43.020730 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:42.979907  2558 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:43.031175 28580 raft_consensus.cc:2393] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:42.981325  2299 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:13:43.032492 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.036656 28648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.014s	sys 0.027s
W20260709 13:13:43.038816 28648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.014s	sys 0.027s
W20260709 13:13:43.042899 28620 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.647s (SENT)
I20260709 13:13:43.043494 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:43.046844 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:43.026005  2807 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:42.983302  2640 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:43.053108 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:43.026635  2648 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:43.068624 28574 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 22.
I20260709 13:13:42.983214  2747 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:13:43.077893 28572 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:43.033838  2608 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:42.983142  2589 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:13:43.039076  2805 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:43.086843  2391 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:43.089149 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 3034) took 1401 ms. Trace:
I20260709 13:13:43.051429  2558 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:42.971634  2760 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:42.983528  2713 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.080404  2648 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.098630 28730 rpcz_store.cc:276] 0709 13:13:41.687580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.851125 (+163545us) service_pool.cc:224] Handling call
0709 13:13:43.088882 (+1237757us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002814d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:43.089074 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447610752}
I20260709 13:13:43.104773 28574 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:42.973559  2462 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.033308  2714 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:43.098408  2391 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:43.115665  2757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.004s	sys 0.065s
I20260709 13:13:43.082171  2640 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:43.116919  2760 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:43.119861  2753 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:43.152105  2391 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:43.154789 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.125952  2668 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:43.147272  2757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.004s	sys 0.066s
W20260709 13:13:43.190366 28649 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.004s	sys 0.024s
W20260709 13:13:43.194060 28649 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.004s	sys 0.024s
I20260709 13:13:43.123474  2713 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.195420  2551 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:43.182622  2806 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:43.190407  2532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.008s	sys 0.020s
I20260709 13:13:42.928625  2595 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.190304  2391 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:43.202751 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.108330  2805 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:43.193281  2403 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:43.212411 28647 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.022s	sys 0.037s
I20260709 13:13:43.185789  2753 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:43.214139 28647 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.022s	sys 0.037s
I20260709 13:13:43.215756 28575 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:43.049963  2777 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:43.223192 28651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.016s	sys 0.019s
W20260709 13:13:43.223608 28651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.016s	sys 0.019s
I20260709 13:13:43.209182  2802 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:43.237376 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1588) took 1115 ms. Trace:
I20260709 13:13:43.237958 28573 rpcz_store.cc:276] 0709 13:13:42.121605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.121730 (+   125us) service_pool.cc:224] Handling call
0709 13:13:42.133867 (+ 12137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.232178 (+ 98311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.232208 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:42.232913 (+   705us) log.cc:844] Serialized 26 byte log entry
0709 13:13:42.946446 (+713533us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:42.946499 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.946584 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:43.228967 (+282383us) raft_consensus.cc:1685] finished
0709 13:13:43.228986 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.237251 (+  8265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97883,"raft.queue_time_us":98033,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":713141,"threads_started":1,"wal-append.queue_time_us":983895}
I20260709 13:13:43.212724  2796 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:43.204646  2806 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:43.207751  2532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.009s	sys 0.020s
W20260709 13:13:43.249632 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.285315  2640 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:43.284909  2762 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:43.286397  2308 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:43.288558 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.293856  2462 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:43.248920  2765 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.018s	sys 0.029s
I20260709 13:13:43.309223  2762 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:43.314826  2765 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.018s	sys 0.030s
I20260709 13:13:43.273155  2648 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:43.322490  2805 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:43.327905 28695 connection.cc:256] RPC call timeout handler was delayed by -1.002955694000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 13:13:43.329133 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:43.330421 28655 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.011s	sys 0.035s
W20260709 13:13:43.331837 28655 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.012s	sys 0.035s
W20260709 13:13:43.343303 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.318606  2804 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:43.367210 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 449865us
W20260709 13:13:43.373134 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 319934us
I20260709 13:13:43.373886 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:43.330248  2652 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:13:43.384171 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 529213us
I20260709 13:13:43.396615 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:43.324560  2762 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.397660 28723 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:13:43.421406 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 92542us
I20260709 13:13:43.385210 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:43.427407 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:43.428368 28725 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:43.427820 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:43.369424  2805 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.382035  2595 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:43.381500  2713 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:43.443094 28622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.018s	sys 0.037s
W20260709 13:13:43.443679 28622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.018s	sys 0.037s
W20260709 13:13:43.444052 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.436386 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 415748us
I20260709 13:13:43.436547 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:43.436633 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 393748us
I20260709 13:13:43.384606  2660 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:43.438362 29224 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:43.447078 28620 leader_election.cc:336] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.984s (SENT)
I20260709 13:13:43.404318  2722 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:43.447594 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:43.431442 28696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.011s	sys 0.015s
W20260709 13:13:43.456353 28696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.012s	sys 0.016s
W20260709 13:13:43.456952 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 1.22538e+06us
I20260709 13:13:43.423638  2608 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:43.464821 29257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:13:43.465724 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:43.466440 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:43.469223 28620 leader_election.cc:336] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.655s (SENT)
I20260709 13:13:43.472906 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:43.471112 29257 raft_consensus.cc:606] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:43.471781 29255 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:43.451152  2761 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:43.448307  2753 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:43.444165  2299 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:43.447953  2660 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:43.431906  2668 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:43.463959  2801 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:43.505111 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:43.506896 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:43.510133 29255 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:43.512069 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:43.512377 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 75936.5us
I20260709 13:13:43.517529 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:43.492511  2660 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:43.494511  2648 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:43.495312  2806 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:43.522323 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:43.524569 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55386.5us
I20260709 13:13:43.561574 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:43.562032 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:43.562925 28728 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:13:43.480132  2722 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.574733 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:43.516498  2828 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:43.498967  2668 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.579094 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:43.632229 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.568917  2648 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:43.648808 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69818.9us
I20260709 13:13:43.654287 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:43.654932 28695 leader_election.cc:400] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 11 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12.
I20260709 13:13:43.564406  2824 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:13:43.658124 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.595700  2725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.020s	sys 0.052s
I20260709 13:13:43.660941 29256 raft_consensus.cc:2410] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:13:43.585032  2801 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:43.668231 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:43.562507  2826 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 13:13:43.585815  2822 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:43.675984 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 204418us
I20260709 13:13:43.502194  2804 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:43.665796  2808 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
W20260709 13:13:43.665115  2725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.020s	sys 0.052s
W20260709 13:13:43.670917  2819 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:13:43.732846 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50784.2us
W20260709 13:13:43.733116 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.660787  2595 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:43.749868 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 74693.3us
I20260709 13:13:43.661435  2825 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:43.744247  2765 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:43.751904 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 246891us
W20260709 13:13:43.737932  2820 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:13:43.759815 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:43.763243 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:43.650545  2299 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:43.767617 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:43.779040 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:43.780491 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:43.764743  2816 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:13:43.770042  2652 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:43.749274  2595 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.769153  2761 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:43.761782  2765 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.798960 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2865) took 1139 ms. Trace:
I20260709 13:13:43.809458 28651 rpcz_store.cc:276] 0709 13:13:42.660058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.661148 (+  1090us) service_pool.cc:224] Handling call
0709 13:13:42.681537 (+ 20389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.690403 (+  8866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.690446 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:42.716987 (+ 26541us) log.cc:844] Serialized 26 byte log entry
0709 13:13:43.223981 (+506994us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:43.224020 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.224109 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:43.798677 (+574568us) raft_consensus.cc:1685] finished
0709 13:13:43.798707 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.798888 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8401,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":29337,"spinlock_wait_cycles":26368,"thread_start_us":501413,"threads_started":1,"wal-append.queue_time_us":766339}
W20260709 13:13:43.812755 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.784853  2714 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:43.761349  2801 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:13:43.796713  2834 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.799427  2652 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:43.813606  2765 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:43.846382 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:43.866106 28726 pending_rounds.cc:85] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 12
I20260709 13:13:43.866549 28726 pending_rounds.cc:107] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 11.13
I20260709 13:13:43.866851 28726 raft_consensus.cc:2889] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.825667  2758 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:43.873100 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:43.840971  2730 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:43.836246  2831 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:43.897130 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:43.796854  2648 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.864658  2826 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:43.907347 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:43.908260 28722 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
W20260709 13:13:43.890463  2827 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
W20260709 13:13:43.889829  2821 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:13:43.840425  2834 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:43.927747 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:43.939463  2838 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:13:43.940083  2842 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:13:43.940949  2839 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:13:43.941901  2595 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:43.943513  2836 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:13:43.899289  2855 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.956416 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:43.911662  2826 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:43.925730  2722 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:43.985396  2767 consensus_meta.cc:287] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.126s	user 0.012s	sys 0.002s
I20260709 13:13:43.985934  2558 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.986588  2558 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:43.989567  2841 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:43.993398 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2866) took 1332 ms. Trace:
W20260709 13:13:43.962610  2391 consensus_meta.cc:287] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.003s
I20260709 13:13:43.974607  2826 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:43.969475  2855 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.893397  2758 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.993916 28655 rpcz_store.cc:276] 0709 13:13:42.660959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.661135 (+   176us) service_pool.cc:224] Handling call
0709 13:13:42.679630 (+ 18495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.680038 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:43.333359 (+653321us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.784912 (+451553us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.835242 (+ 50330us) log.cc:844] Serialized 26 byte log entry
0709 13:13:43.835485 (+   243us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:43.835533 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.835626 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:43.993119 (+157493us) raft_consensus.cc:1685] finished
0709 13:13:43.993147 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.993328 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8238,"prepare.queue_time_us":617941,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":183213,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":37909,"spinlock_wait_cycles":30592,"thread_start_us":997860,"threads_started":3,"wal-append.queue_time_us":552379}
I20260709 13:13:44.040011 28721 raft_consensus.cc:2410] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:13:44.039649 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 119630us
I20260709 13:13:44.042310  2844 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.043069  2834 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:44.043766  2834 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.045542  2848 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:44.046007  2848 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:44.046348  2848 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:44.044294  2834 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:44.046931  2807 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.962s	user 0.011s	sys 0.000s
I20260709 13:13:44.047354  2807 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.048354 29254 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:44.048466  2824 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:44.042960  2844 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.048975  2824 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:43.995651  2833 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:43.985949  2767 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20.
W20260709 13:13:44.067250 28647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.003s	sys 0.007s
I20260709 13:13:44.068284 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:44.074385 28647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.003s	sys 0.007s
I20260709 13:13:43.900611  2761 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:44.076505 28547 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:43.910751  2831 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.080502 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1858) took 1292 ms. Trace:
I20260709 13:13:44.084430 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2858) took 1627 ms. Trace:
I20260709 13:13:44.089394  2833 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:44.090438  2828 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:44.090677  2833 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.082888 29260 rpcz_store.cc:276] 0709 13:13:42.787837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.788023 (+   186us) service_pool.cc:224] Handling call
0709 13:13:42.812145 (+ 24122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.812608 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.812648 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:42.841484 (+ 28836us) log.cc:844] Serialized 26 byte log entry
0709 13:13:43.329251 (+487767us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:43.329294 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.330983 (+  1689us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.080262 (+749279us) raft_consensus.cc:1685] finished
0709 13:13:44.080288 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.080440 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":260,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":455804,"threads_started":1,"wal-append.queue_time_us":605646}
I20260709 13:13:44.093902  2831 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:44.098840 28652 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
W20260709 13:13:44.080413  2856 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:13:44.084894 28647 rpcz_store.cc:276] 0709 13:13:42.457268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.480154 (+ 22886us) service_pool.cc:224] Handling call
0709 13:13:42.480589 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.480851 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:43.214780 (+733929us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.075048 (+860268us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.084051 (+  9003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.084114 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:44.084163 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.084240 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.084370 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19013,"prepare.queue_time_us":818765,"prepare.run_cpu_time_us":162,"prepare.run_wall_time_us":66,"raft.queue_time_us":346023,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":6045,"thread_start_us":1583335,"threads_started":3,"wal-append.queue_time_us":456023}
I20260709 13:13:44.077067  2308 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:44.036824  2722 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
W20260709 13:13:44.131753 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 322551us
W20260709 13:13:44.129352 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 227400us
I20260709 13:13:44.141355 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:44.142174 28727 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:44.135432 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:44.149394 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 217797us
I20260709 13:13:44.153366 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:44.155557 28695 leader_election.cc:400] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15.
I20260709 13:13:44.156657 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:44.157297 28730 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:13:44.141099  2807 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:44.174556 28622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.006s	sys 0.014s
W20260709 13:13:44.177557 28622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.007s	sys 0.014s
W20260709 13:13:44.179095 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 690147us
W20260709 13:13:44.175854 28649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.000s	sys 0.020s
I20260709 13:13:44.152092  2606 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:13:44.182732 28649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.000s	sys 0.021s
I20260709 13:13:44.150712  2861 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:44.186458 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2862) took 1621 ms. Trace:
W20260709 13:13:44.187839 28620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.006s	sys 0.017s
I20260709 13:13:44.191953 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.193128 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:44.201279 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 124870us
W20260709 13:13:44.189589 28620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.006s	sys 0.017s
I20260709 13:13:44.202219 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:44.208657 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.213791 28647 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:13:44.187364 28649 rpcz_store.cc:276] 0709 13:13:42.564833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.564956 (+   123us) service_pool.cc:224] Handling call
0709 13:13:42.565271 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.565467 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:43.195031 (+629564us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.185896 (+990865us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.185975 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:44.186128 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.186228 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.186387 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12366,"prepare.queue_time_us":732343,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":315559,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":21680,"thread_start_us":1602330,"threads_started":3,"wal-append.queue_time_us":761809}
W20260709 13:13:44.190268  2843 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:13:44.178072  2864 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:44.223268 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:44.225137 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:44.226138 29253 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:44.227667 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.187760  2787 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:44.231683 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.193701  2606 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:44.249447 29257 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:44.247726 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.260322 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.279182 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:44.241318  2846 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.294s	user 0.000s	sys 0.002s
I20260709 13:13:44.286783 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.211135  2725 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:13:44.286593 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.193764  2861 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:44.245486  2862 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:13:44.242290  2760 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 1.056s	user 0.014s	sys 0.000s
W20260709 13:13:44.280432  2856 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:44.241747  2864 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:44.240618  2876 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:44.240589  2868 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:44.243330  2824 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:44.290933 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 126307us
W20260709 13:13:44.299659 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 97491.7us
I20260709 13:13:44.233812  2391 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:13:44.301433 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.308320 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.318818 28650 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:13:44.319515 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.320447 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.321334 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:44.322253 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:44.322700 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.322794 28650 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:44.324126 28650 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:44.312850 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.313423 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:44.316277 29255 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:44.316871 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:44.309737 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:44.323688  2288 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:44.329613 28654 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:13:44.330183 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.246341  2826 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.340248 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:44.342012 29257 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:44.344002 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.345247 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:44.328099  2660 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.003s
W20260709 13:13:44.346868 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 154467us
I20260709 13:13:44.300859  2855 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:44.351603 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:44.353041 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.349392 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:44.358045 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.341471  2299 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:13:44.367439  2853 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:13:44.326400  2725 consensus_queue.cc:1243] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer 178f22d83287460fb8c0db0ba2799895 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:44.343753  2857 raft_consensus.cc:2764] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:13:44.345604  2844 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:44.423635 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 82673.3us
I20260709 13:13:44.294385  2866 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:13:44.357137  2804 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.316847  2761 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:13:44.458957 28730 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:13:44.339823  2551 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:44.360201 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:44.331259  2868 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:44.486040 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 134530us
W20260709 13:13:44.461066 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 97940.4us
I20260709 13:13:44.297775  2760 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.331580  2824 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:13:44.315907  2876 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.517398 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:44.518061 29224 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.2:39245 timed out after 1.550s (SENT) [suppressed 11 similar messages]
W20260709 13:13:44.533097 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 173362us
W20260709 13:13:44.533695 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 224024us
I20260709 13:13:44.523190  2850 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:44.418287  2810 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:44.460368  2299 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.557565 29259 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:44.526549  2775 consensus_meta.cc:287] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.545s	user 0.015s	sys 0.000s
I20260709 13:13:44.459365  2391 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:44.553865 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1926) took 1105 ms. Trace:
I20260709 13:13:44.347925  2606 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:44.561676 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 44334.3us
I20260709 13:13:44.562502 28727 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:44.359972  2660 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.532697  2648 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:44.572096 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:44.551779  2804 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:44.566704 29251 rpcz_store.cc:276] 0709 13:13:43.448115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.455882 (+  7767us) service_pool.cc:224] Handling call
0709 13:13:43.456225 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.680331 (+224106us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:43.785909 (+105578us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.899767 (+113858us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.905660 (+  5893us) log.cc:844] Serialized 26 byte log entry
0709 13:13:43.905984 (+   324us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:43.906051 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.906197 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.553563 (+647366us) raft_consensus.cc:1685] finished
0709 13:13:44.553593 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.553786 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22113,"prepare.queue_time_us":29950,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":223347,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":47326,"thread_start_us":250929,"threads_started":2,"wal-append.queue_time_us":209867}
I20260709 13:13:44.579492 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:44.493904  2801 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:13:44.563858  2462 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:44.562250  2299 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:44.589781 29253 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:44.590554 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:44.583671  2725 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:44.573756  2391 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:44.574586  2858 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:13:44.466905  2805 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.108s
I20260709 13:13:44.600942 28696 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:44.597530 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:44.602927 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:44.605350 29253 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:44.598146  2882 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:13:44.584820  2804 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:44.608739  2835 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 13:13:44.622794 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2578) took 1124 ms. Trace:
I20260709 13:13:44.597539  2861 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:44.640333 28573 raft_consensus.cc:2393] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:44.600296  2810 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.513623  2864 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.641737 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:44.601321  2725 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:44.639643 28725 rpcz_store.cc:276] 0709 13:13:43.498015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.499163 (+  1148us) service_pool.cc:224] Handling call
0709 13:13:43.511483 (+ 12320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:43.518927 (+  7444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.518969 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:43.524683 (+  5714us) log.cc:844] Serialized 52 byte log entry
0709 13:13:43.763976 (+239293us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:44.067656 (+303680us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.067873 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.067947 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:44.622556 (+554609us) raft_consensus.cc:1685] finished
0709 13:13:44.622582 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.622732 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19702,"prepare.queue_time_us":293457,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":8865,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":19320,"thread_start_us":472467,"threads_started":2,"wal-append.queue_time_us":566822}
I20260709 13:13:44.557993  2850 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:44.608999  2886 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.572644  2775 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.663794 28648 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:44.654517  2805 consensus_queue.cc:1243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:13:44.665716  2891 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:13:44.658121  2725 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:44.642318  2804 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:44.638944  2462 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.584738  2648 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.665987  2760 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:44.676573 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 142512us
I20260709 13:13:44.670532  2551 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:44.673374  2826 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:44.692667 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:44.681658  2805 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:13:44.706511  2885 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:13:44.707046  2805 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:44.708192  2890 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:44.708061  2805 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.671293  2391 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:44.689641  2462 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.679250  2810 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.708643  2558 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:44.695742 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:44.698597  2551 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:44.731316 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.732084 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.703751  2660 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:44.705508  2775 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:44.706418  2876 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:44.736465 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:44.732283 28649 raft_consensus.cc:2410] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:13:44.737895 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.733282 28654 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:44.702256  2762 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:44.735153 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.739923 28648 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:44.741039 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.741724 28648 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:44.742727 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.744680 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.822678 28575 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:13:44.799546 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:44.778493 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.792840 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:44.874266 28648 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
W20260709 13:13:44.762997 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.794679 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.779340 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:44.875586 28574 raft_consensus.cc:606] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:13:44.745705 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 227648us
I20260709 13:13:44.779660 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.796667 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:44.794468 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:44.711264  2848 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.000s
I20260709 13:13:44.797360 28579 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 21. Current term is 22. Ops: []
W20260709 13:13:44.738188  2765 consensus_meta.cc:287] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.854s	user 0.005s	sys 0.008s
I20260709 13:13:44.721551  2810 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:44.876139 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:45.095229 28647 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
W20260709 13:13:45.098242  2901 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:13:45.096692 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:44.954927 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1861) took 1508 ms. Trace:
I20260709 13:13:44.712224  2391 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:45.037294 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:45.114394 29258 rpcz_store.cc:276] 0709 13:13:43.446223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.446499 (+   276us) service_pool.cc:224] Handling call
0709 13:13:43.446857 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.596322 (+149465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.596348 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.596390 (+    42us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:43.596426 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.954669 (+1358243us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400610154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:44.954718 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.954859 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343288192}
I20260709 13:13:45.120496 28654 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:44.716789  2825 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:44.876024 28574 raft_consensus.cc:614] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:44.886464 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:44.884234 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.121440 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:44.883160 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 303733us
I20260709 13:13:44.717612  2867 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:45.129031 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:45.127907 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:45.126886 28580 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:45.133623 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1928) took 1659 ms. Trace:
I20260709 13:13:44.777429  2787 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:44.875856  2558 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.125561 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:44.714613  2462 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:44.940351  2889 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:13:45.134645 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 533781us
W20260709 13:13:44.994678  2652 consensus_meta.cc:287] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 1.139s	user 0.015s	sys 0.000s
I20260709 13:13:45.131265 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:44.953395  2834 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:44.941079  2887 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:44.941263  2883 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:13:45.128847  2868 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:44.942178  2894 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:13:44.941490  2869 log.cc:927] Time spent T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 13:13:44.942526  2896 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:13:44.939819  2761 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:44.940603  2881 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:13:45.024533  2801 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:45.134338 29256 rpcz_store.cc:276] 0709 13:13:43.465283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.465418 (+   135us) service_pool.cc:224] Handling call
0709 13:13:45.124076 (+1658658us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400596354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:45.124850 (+   774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434697984}
I20260709 13:13:45.125124  2648 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.150067 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:45.126010  2825 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:45.155387 28695 leader_election.cc:400] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
I20260709 13:13:45.183349 28695 leader_election.cc:403] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:45.138731  2787 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:45.188961  2787 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:45.191252  2660 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:45.144232  2762 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.193300  2762 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.145382  2558 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:45.197414  2558 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.197566  2852 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:13:45.198608 28581 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:45.199354 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1921) took 2243 ms. Trace:
I20260709 13:13:45.199769 29259 rpcz_store.cc:276] 0709 13:13:42.955843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.956364 (+   521us) service_pool.cc:224] Handling call
0709 13:13:42.956784 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.561116 (+1604332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.199061 (+637945us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54006bf154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:45.199259 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3681005824}
I20260709 13:13:45.162477  2725 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.162967  2850 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.144093  2886 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:45.201501  2886 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:45.202984  2804 consensus_meta.cc:287] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:13:45.205575  2551 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.131306  2765 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.151602  2826 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:45.187701 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:45.156082  2894 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:45.124601  2848 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:45.211010 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 55756.7us
W20260709 13:13:45.241930 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.221676  2902 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:13:45.263573 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:45.268325 29260 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:45.275558 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1927) took 1441 ms. Trace:
I20260709 13:13:45.276053 28726 rpcz_store.cc:276] 0709 13:13:43.834644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.834828 (+   184us) service_pool.cc:224] Handling call
0709 13:13:43.865881 (+ 31053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.867480 (+  1599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.867535 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.868037 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.025020 (+156983us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:44.025077 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.025167 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.275274 (+1250107us) raft_consensus.cc:1685] finished
0709 13:13:45.275304 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.275493 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":143940,"threads_started":1,"wal-append.queue_time_us":715869}
I20260709 13:13:45.160493  2652 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.267109  2753 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:45.208285  2801 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.158221  2887 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.181679  2761 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.216190  2905 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:45.211033  2804 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.306834  2652 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.300520  2905 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:45.308071  2299 consensus_meta.cc:287] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.002s
I20260709 13:13:45.311225  2761 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.314460  2765 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.286466  2826 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:45.330535 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.266705  2912 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
I20260709 13:13:45.331591 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.332542 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.318714  2887 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.335966 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.337371 29256 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:45.292289  2909 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:45.332301  2762 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.352690 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:45.357434 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:45.359479 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:45.329577  2403 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:45.319857  2833 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
W20260709 13:13:45.353744  2871 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.035s	sys 0.048s
I20260709 13:13:45.330598  2905 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:45.336817  2299 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.385433  2403 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.363332  2909 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.395071  2403 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.392295 28653 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:45.382810  2848 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.371937  2762 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:45.371274  2668 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.405236  2762 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:45.405810  2762 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:45.387177  2871 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.036s	sys 0.049s
I20260709 13:13:45.429773  2730 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:45.426445  2848 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:45.430358  2730 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:45.430742  2848 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.433144  2848 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.435573  2886 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.437249  2810 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.410810  2868 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:45.438159  2868 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:45.442797  2804 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.367977  2825 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.447042  2825 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:45.473881  2810 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.426811 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1472) took 1107 ms. Trace:
I20260709 13:13:45.474776  2810 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.478088 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1863) took 2004 ms. Trace:
I20260709 13:13:45.478677 29254 rpcz_store.cc:276] 0709 13:13:43.473372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.525403 (+ 52031us) service_pool.cc:224] Handling call
0709 13:13:43.567954 (+ 42551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.048722 (+480768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.477737 (+1429015us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400610dd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:45.478004 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104357120}
W20260709 13:13:45.482616 28652 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 2870) took 1637 ms (client timeout 1666 ms). Trace:
W20260709 13:13:45.483091 28652 rpcz_store.cc:269] 0709 13:13:43.845073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.846065 (+   992us) service_pool.cc:224] Handling call
0709 13:13:45.482413 (+1636348us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540006d1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:45.482536 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548795136}
W20260709 13:13:45.486956 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.488091 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 2591) took 1839 ms. Trace:
I20260709 13:13:45.488909  2868 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.488642 28721 rpcz_store.cc:276] 0709 13:13:43.648963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.649156 (+   193us) service_pool.cc:224] Handling call
0709 13:13:45.487821 (+1838665us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54000a64d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:45.488018 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849918848}
I20260709 13:13:45.494801 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2878) took 1189 ms. Trace:
I20260709 13:13:45.495244 28655 rpcz_store.cc:276] 0709 13:13:44.305418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.493946 (+1188528us) service_pool.cc:224] Handling call
0709 13:13:45.494298 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.494480 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.494504 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:45.494540 (+    36us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:45.494574 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.494631 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.494745 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:45.496507  2810 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.503595  2787 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:45.475358 28650 rpcz_store.cc:276] 0709 13:13:44.319495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.324812 (+  5317us) service_pool.cc:224] Handling call
0709 13:13:44.325118 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:44.325521 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:13:44.327084 (+  1563us) log.cc:844] Serialized 14 byte log entry
0709 13:13:45.405458 (+1078374us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b18003489a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a279be4bc 00007f4a24d0c48b 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a2b80e3c7 00007f4a27e209a7 00007f4a27e300bf
0709 13:13:45.405632 (+   174us) log.cc:844] Serialized 14 byte log entry
0709 13:13:45.405850 (+   218us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:45.406410 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:13:45.406666 (+   256us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:45.406712 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.406797 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.426488 (+ 19691us) raft_consensus.cc:1685] finished
0709 13:13:45.426520 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.426729 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2828,"prepare.queue_time_us":209066,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":3961,"raft.queue_time_us":32914,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":15012,"spinlock_wait_cycles":5052800,"thread_start_us":400497,"threads_started":2,"wal-append.queue_time_us":316122}
I20260709 13:13:45.507030  2787 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.507330  2801 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.515009  2894 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.516631  2894 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:45.517271 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:45.517971 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.518204 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.518940 29251 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:45.521513 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 2090) took 1275 ms. Trace:
I20260709 13:13:45.522056 29252 rpcz_store.cc:276] 0709 13:13:44.246508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.246636 (+   128us) service_pool.cc:224] Handling call
0709 13:13:45.124212 (+877576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.124450 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.124476 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:45.124525 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:45.124568 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.124635 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.521343 (+396708us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b5400596350. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:45.521456 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017345408}
I20260709 13:13:45.527534 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:45.528127 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:45.529145 28656 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:45.530437 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:45.531296 28650 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:45.532478  2758 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:45.535259  2899 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:45.538146 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:45.538444 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:45.538946 28581 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 18: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:45.539306 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:45.539966 28579 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 9.
I20260709 13:13:45.540416 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:45.539875 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:45.539806 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:45.544608  2762 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.545490 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46388 (request call id 1869) took 1193 ms. Trace:
I20260709 13:13:45.546068 29260 rpcz_store.cc:276] 0709 13:13:44.352019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.357746 (+  5727us) service_pool.cc:224] Handling call
0709 13:13:45.545261 (+1187515us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54004b5ad4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:45.545428 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088916864}
I20260709 13:13:45.548506 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:45.557466 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 2093) took 1310 ms. Trace:
I20260709 13:13:45.571295 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:45.579638 29260 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:45.560806 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.577438 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.581030 28722 raft_consensus.cc:2410] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:13:45.582228 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:45.583529 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.584210 28722 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:45.573251 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.578976 29255 rpcz_store.cc:276] 0709 13:13:44.247462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.287668 (+ 40206us) service_pool.cc:224] Handling call
0709 13:13:44.288008 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.327432 (+ 39424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.557240 (+1229808us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b54006aa754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:45.557414 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64487680}
I20260709 13:13:45.556833 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2585) took 2008 ms. Trace:
I20260709 13:13:45.587138 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.591925 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.592724 28722 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:45.594743 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:45.595494 28722 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:45.588546 28723 rpcz_store.cc:276] 0709 13:13:43.548293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.548467 (+   174us) service_pool.cc:224] Handling call
0709 13:13:43.548818 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.460441 (+911623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.460486 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.460545 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:44.460598 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.556510 (+1095912us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54001cb454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:45.556576 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.556755 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885219712}
I20260709 13:13:45.404327  2909 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.620512 28723 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:13:45.621614 28723 pending_rounds.cc:85] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 9
I20260709 13:13:45.621929 28723 pending_rounds.cc:107] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:13:45.622164 28723 raft_consensus.cc:2889] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:45.625748 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.626762 28721 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:13:45.556757  2785 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:45.630033 28727 raft_consensus.cc:2410] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:45.632908  2877 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:45.634479 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.609666  2899 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.612089  2391 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:13:45.564991  2906 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:13:45.563144  2551 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:13:45.558494  2558 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:45.613149  2299 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.642778 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.656898 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:45.641441 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:45.630417 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:45.640517  2909 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.657804 28725 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:45.560784  2762 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.657851 28723 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:45.657058 28722 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:45.637439 29260 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:45.662412 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.667709 28728 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:45.663812  2725 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:45.664157  2606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.025s	sys 0.050s
W20260709 13:13:45.665899 28695 connection.cc:256] RPC call timeout handler was delayed by -1.1398715660000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:13:45.668715 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.611084  2905 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:45.669345 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:45.677695 29260 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:13:45.671461 28695 connection.cc:256] RPC call timeout handler was delayed by -1.1191715659999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 13:13:45.672271 28722 raft_consensus.cc:2393] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:45.679294 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.680018 28695 connection.cc:256] RPC call timeout handler was delayed by -1.0192715660000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 13:13:45.682394 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:45.682605 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:45.640314  2785 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.684861  2391 consensus_queue.cc:1243] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:13:45.688588  2458 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:45.684242 29223 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:45.690769  2762 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:45.669584  2810 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.694375 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:45.696238 28722 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:13:45.710273 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.739718 28725 raft_consensus.cc:2468] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:45.665398  2801 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.669786  2551 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:45.776280 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:45.777127 29255 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:45.745882 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61739.4us
I20260709 13:13:45.780570 29253 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:45.781097 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:45.748643 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:45.745466 28695 connection.cc:256] RPC call timeout handler was delayed by -1.001271566000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 13:13:45.748839 29260 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:13:45.760500 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 78184.4us
I20260709 13:13:45.644780  2899 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.762756  2810 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.763682  2762 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:45.763797  2905 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:45.764307  2864 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:45.769239  2299 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.769922  2288 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:45.770465 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:45.665580  2823 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:45.774087 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.775377  2551 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:45.784796 28725 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:45.817878 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:45.839496 28722 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:45.671243  2606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.026s	sys 0.050s
I20260709 13:13:45.821628 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.819603 28695 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:45.655476  2730 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.843808 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:45.744482  2824 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.853750  2785 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.854558  2825 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:45.855224  2730 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.859380 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:45.861378  2905 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:45.864059  2810 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.865473  2762 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.836268  2299 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:45.868151  2299 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.670188  2909 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:45.815531  2801 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.871152  2801 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.871266 28723 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:45.871989 28721 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:45.872572 28728 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:45.873183 28729 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:45.814563  2458 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:45.873709  2899 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.824997  2725 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:45.874935  2725 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.836695 28727 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:45.823449  2761 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:13:45.878356  2761 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:45.878775  2761 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:45.879760  2761 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.836395  2831 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:13:45.882805  2915 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:45.883256  2915 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:45.884188  2915 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.833175  2608 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:45.850620  2823 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.836836  2288 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:45.853591  2824 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.933670  2288 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:45.935474  2824 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.937397 28726 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:13:45.938982 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.938982  2725 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:45.880209 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.836166  2767 consensus_queue.cc:1059] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:13:45.957984 29252 raft_consensus.cc:2393] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:45.848274 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:45.782810 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:45.898579 28727 raft_consensus.cc:2468] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:13:45.826772 28620 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.038s
I20260709 13:13:45.829037  2864 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:45.916092 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:45.921521 29260 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:45.920655  2458 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:45.921866  2551 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:45.924276  2909 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:45.929979 28728 raft_consensus.cc:1275] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:45.930696  2608 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:45.932690 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.933116  2823 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:45.947932 28725 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:45.948422 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:45.961104 28620 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.009s	sys 0.039s
W20260709 13:13:45.983440 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 657773us
W20260709 13:13:45.963712 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 181013us
W20260709 13:13:45.973212 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.974627 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 126427us
I20260709 13:13:45.978008  2725 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:45.978366  2551 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:45.958709  2761 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:45.978873  2391 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:45.990455 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:45.967492  2864 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:45.967106  2919 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:45.997845 28722 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:45.982878  2915 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:46.005224 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:46.029114 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:46.030612 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:45.991585 29223 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:46.006102  2871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.015s	sys 0.004s
W20260709 13:13:46.017402  2652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.011s	sys 0.015s
I20260709 13:13:46.017369  2391 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:45.998719 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 212695us
I20260709 13:13:45.983157  2909 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:46.035529 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:46.042749 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:46.044508 29223 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:46.046696 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:46.017364  2725 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:46.057264 28653 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:13:46.058333 29223 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:46.064021 28654 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:46.036337  2652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.011s	sys 0.016s
I20260709 13:13:46.071802 29259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:13:46.051105 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:46.052896 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:46.072820 28656 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:46.054103 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:46.041342  2391 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:46.069815 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:46.070817 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.071262 28579 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:13:46.034361  2871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.015s	sys 0.004s
I20260709 13:13:46.050138 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:46.019814  2857 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:46.085450 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:46.036583  2810 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:46.033133  2823 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:46.078097 28573 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:13:46.072924 28577 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:46.082425 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.058585  2905 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:46.067791  2713 raft_consensus.cc:2804] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:46.099671 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.067852  2884 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:46.103598 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.086521 28653 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:46.055804 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:46.033329  2894 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:46.041915  2919 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:46.091943 28578 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:13:46.046742  2648 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:46.067390  2824 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:46.074790  2595 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:46.078928  2722 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:46.114193 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:46.114578 28574 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.024s	sys 0.024s
I20260709 13:13:46.084894  2660 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:46.060072  2909 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:46.081600 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:46.088275  2700 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.087942  2822 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:46.136602 29252 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:46.084566  2730 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:46.089804  2725 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:46.074836  2458 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:13:46.114951 28574 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.024s	sys 0.024s
I20260709 13:13:46.117741 28572 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:46.119545 28656 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:46.099058  2905 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:46.117173  2855 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.016s	sys 0.072s
I20260709 13:13:46.134430 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:46.138551 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 57059.1us
I20260709 13:13:46.141624 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:46.144927 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:46.120468 28730 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.016s
I20260709 13:13:46.093040  2857 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:46.108817  2713 raft_consensus.cc:697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:46.099536  2871 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:13:46.153625 29252 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:46.154804 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:46.118005  2722 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:46.154131 28730 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.016s
W20260709 13:13:46.161110 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.155892 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:46.171295 29253 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:46.135344  2595 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.177320  2608 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:46.153183  2855 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.434s	user 0.018s	sys 0.072s
I20260709 13:13:46.148202  2894 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:46.109398  2884 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.146808  2725 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:46.186076 28695 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:46.181187 28724 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.003s	sys 0.017s
I20260709 13:13:46.151826  2660 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:46.152737  2905 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:46.191015 28724 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.003s	sys 0.017s
I20260709 13:13:46.121467  2824 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.179957  2722 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:46.210505 28577 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:46.149192  2700 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:46.152390  2730 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.150619  2822 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:46.233197 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:46.234163 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.009s	sys 0.017s
W20260709 13:13:46.235636 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.009s	sys 0.017s
I20260709 13:13:46.229485 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:46.239082 28649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.010s	sys 0.013s
W20260709 13:13:46.241888 28649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.010s	sys 0.014s
I20260709 13:13:46.210836  2917 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:46.240931 28573 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
W20260709 13:13:46.240080 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 702755us
I20260709 13:13:46.226898  2608 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.232519  2906 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.217787  2894 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:46.192513  2725 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:46.265813  2595 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:46.266314 28648 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:46.270784 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:46.272719 28654 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
W20260709 13:13:46.275235 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.277559 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:46.283710 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:46.242451  2308 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:46.321889  2922 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:13:46.323938  2824 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:46.327191  2288 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.290753  2660 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.297663  2906 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.331677  2906 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:46.289573 28573 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:13:46.292145 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49663.5us
I20260709 13:13:46.332587  2700 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:46.235069  2606 consensus_queue.cc:1059] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:13:46.282202  2713 consensus_queue.cc:237] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.334537  2822 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:46.336110  2857 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:46.291006  2608 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.338039  2730 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:46.338843  2608 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:46.300635  2558 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:13:46.286490 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.305416 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:46.227286  2919 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.310510  2884 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:46.311969  2909 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:46.246750  2917 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:46.357347 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.359002 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:46.361929 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.372857 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.373749 28579 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
W20260709 13:13:46.371536  2762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.032s
W20260709 13:13:46.398806 28721 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.003s	sys 0.032s
I20260709 13:13:46.399255 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:46.391695  2805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.015s	sys 0.020s
W20260709 13:13:46.418509 28721 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.004s	sys 0.032s
W20260709 13:13:46.427340 28475 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43518 (request call id 377) took 50064 ms (client timeout 15000 ms). Trace:
I20260709 13:13:46.430197  2288 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:46.396307  2887 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:46.441366  2887 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:46.441629  2928 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:46.442564  2887 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:46.443761 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46607.6us
I20260709 13:13:46.444867 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:46.446485 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:46.447903  2906 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:46.448770  2906 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:46.395546  2462 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.450531  2462 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:46.419078  2917 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.452803  2917 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:46.455400 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:46.443107  2551 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:46.461845 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:46.431951 28472 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:46.465077  2551 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:46.482949 28729 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.013s	sys 0.037s
I20260709 13:13:46.465763  2906 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:13:46.486966 28729 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.013s	sys 0.038s
W20260709 13:13:46.428332 28475 rpcz_store.cc:269] 0709 13:12:56.334485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.335459 (+   974us) service_pool.cc:224] Handling call
0709 13:13:46.398138 (+50062679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:39.995747 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:40.007824 (+ 12077us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:40.007895 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:13:40.007921 (+    26us) tablet.cc:662] Decoding operations
0709 13:13:40.008910 (+   989us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:40.009030 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:40.009073 (+    43us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:13:40.148309 (+139236us) tablet.cc:701] Row locks acquired
0709 13:13:40.186044 (+ 37735us) write_op.cc:260] PREPARE: finished
0709 13:13:40.231463 (+ 45419us) write_op.cc:270] Start()
0709 13:13:40.253615 (+ 22152us) write_op.cc:276] Timestamp: P: 1783602820219171 usec, L: 0
0709 13:13:40.255635 (+  2020us) op_driver.cc:348] REPLICATION: starting
0709 13:13:40.313257 (+ 57622us) log.cc:844] Serialized 2074 byte log entry
0709 13:13:40.819300 (+506043us) op_driver.cc:464] REPLICATION: finished
0709 13:13:41.201284 (+381984us) write_op.cc:301] APPLY: starting
0709 13:13:41.212515 (+ 11231us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:41.449562 (+237047us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:41.449711 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:41.954729 (+505018us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:42.061374 (+106645us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:13:42.072450 (+ 11076us) write_op.cc:312] APPLY: finished
0709 13:13:42.090751 (+ 18301us) log.cc:844] Serialized 57 byte log entry
0709 13:13:43.201148 (+1110397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:43.213746 (+ 12598us) write_op.cc:454] Released schema lock
0709 13:13:43.244182 (+ 30436us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:43.312581 (+ 68399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:43.314580 (+  1999us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1344493,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":333159,"apply.run_cpu_time_us":84213,"apply.run_wall_time_us":2076350,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25017,"num_ops":5,"prepare.queue_time_us":466625,"prepare.run_cpu_time_us":20218,"prepare.run_wall_time_us":381839,"raft.queue_time_us":185567,"raft.run_cpu_time_us":36597,"raft.run_wall_time_us":292073,"replication_time_us":563468,"thread_start_us":1914012,"threads_started":5,"wal-append.queue_time_us":1361250,"wal-append.run_cpu_time_us":51478,"wal-append.run_wall_time_us":2883245}]]}
W20260709 13:13:46.426784  2762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.005s	sys 0.032s
I20260709 13:13:46.488829 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:46.498852 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:46.501696 29259 raft_consensus.cc:606] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:46.502338 29259 raft_consensus.cc:614] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:46.514235 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.486094  2595 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:46.487344  2462 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:46.516350  2714 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:46.542021 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:46.544004 28727 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 22.
W20260709 13:13:46.545749 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 470171us
I20260709 13:13:46.546482 29223 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:46.545222 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:46.522475  2595 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.542410 28723 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:46.574755 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.575181 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:46.576035 28723 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 22 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:13:46.576190 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:46.552996 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.577527  2595 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:46.577764 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.579226 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.580412  2767 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:46.587112  2595 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:46.551546 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:46.585196  2822 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:46.586395  2873 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:13:46.561187 28620 leader_election.cc:336] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.611s (SENT)
I20260709 13:13:46.591194 28620 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:46.592491 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:46.592862  2873 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:46.537856  2462 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:13:46.598085 28472 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 11, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 11 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:46.600636  2864 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 13:13:46.601235  2864 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.526875  2785 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:13:46.584789 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:46.602617 29255 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:46.603257  2925 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:46.603808 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:46.544840  2551 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.604612  2767 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:46.605110  2761 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.587s	user 0.016s	sys 0.000s
I20260709 13:13:46.605273  2767 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:13:46.594843  2391 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.503s	user 0.014s	sys 0.002s
I20260709 13:13:46.606518  2887 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:46.606881  2391 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.518368  2606 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:13:46.543726  2714 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:46.608587 28653 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:46.602664  2785 consensus_queue.cc:1243] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:46.527877  2801 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:46.547951 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:46.634330 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:46.634895 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 86962.9us
I20260709 13:13:46.635020 28724 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:46.575311  2288 raft_consensus.cc:2804] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:46.636976 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:46.626122 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.026s
I20260709 13:13:46.606586 28621 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:13:46.643169 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.011s	sys 0.026s
W20260709 13:13:46.643553 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 565551us
I20260709 13:13:46.627156  2906 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:46.662412 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1936) took 1091 ms. Trace:
W20260709 13:13:46.653795 28574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.011s	sys 0.012s
W20260709 13:13:46.663148 28574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.012s	sys 0.012s
I20260709 13:13:46.627902  2714 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:46.644189  2823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.025s
I20260709 13:13:46.665424 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1617) took 1125 ms. Trace:
I20260709 13:13:46.574551  2652 consensus_queue.cc:1048] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:13:46.627375  2462 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:13:46.693302 29256 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.027s	sys 0.064s
I20260709 13:13:46.635910  2595 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:46.640789  2458 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:46.691910 28574 rpcz_store.cc:276] 0709 13:13:45.539525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.540092 (+   567us) service_pool.cc:224] Handling call
0709 13:13:45.540385 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.540634 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:13:46.149837 (+609203us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.665033 (+515196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:46.665133 (+   100us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:46.665181 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.665244 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.665358 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":812038,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":1963,"raft.queue_time_us":68,"thread_start_us":1123654,"threads_started":2}
I20260709 13:13:46.600261 28472 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.646689  2822 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:46.699079 29256 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.027s	sys 0.064s
I20260709 13:13:46.711175 28724 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:46.647991  2761 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:46.646935  2767 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:46.730985 28578 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 13:13:46.737463 28695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.018s	sys 0.024s
I20260709 13:13:46.662802  2906 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:46.695269  2823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.000s	sys 0.025s
I20260709 13:13:46.691048  2648 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:46.755501  2906 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:46.743243  2462 consensus_queue.cc:1243] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer ed517a03edd141a798f07798667c1c04 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:13:46.757128 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.758204  2905 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:13:46.758656  2905 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:46.759552 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:46.760921 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:46.754365 28695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.018s	sys 0.024s
W20260709 13:13:46.761979 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 575979us
I20260709 13:13:46.764668 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:46.765139 28722 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:46.766044 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:46.766464 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:46.766640 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:46.767235 28728 raft_consensus.cc:2368] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16.
I20260709 13:13:46.768896 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:46.744582 28545 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:46.773404 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:46.775641 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:46.797760 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.801348 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.760651  2905 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:46.863334 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:46.741555  2458 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:46.731642  2822 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:46.897286 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:46.852559  2713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.018s	sys 0.013s
W20260709 13:13:46.905750 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.712214  2722 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:46.918536 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:46.995128 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 250664us
I20260709 13:13:46.758245  2648 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:46.928512 28721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.003s	sys 0.038s
W20260709 13:13:46.876317 28656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.023s	sys 0.010s
W20260709 13:13:46.931077 28620 leader_election.cc:336] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.873s (SENT)
W20260709 13:13:47.004160 28656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.024s	sys 0.015s
W20260709 13:13:47.004068 28721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.003s	sys 0.038s
W20260709 13:13:47.004608 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 73588.2us
I20260709 13:13:46.762884  2855 raft_consensus.cc:3055] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:46.931702 28724 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:47.025538 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:46.951313 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 68807.3us
I20260709 13:13:46.712515  2857 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.952636 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1953) took 1270 ms. Trace:
I20260709 13:13:46.960088 29254 raft_consensus.cc:2410] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:13:46.964665 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:47.051652 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1946) took 1405 ms. Trace:
I20260709 13:13:47.052760 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:46.761835  2761 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:46.927450 29252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.024s	sys 0.015s
I20260709 13:13:46.975492 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:47.056236 29252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.026s	sys 0.015s
I20260709 13:13:46.767083  2767 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:47.052220 28721 rpcz_store.cc:276] 0709 13:13:45.645998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.873309 (+227311us) service_pool.cc:224] Handling call
0709 13:13:45.873570 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.873783 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:46.424023 (+550240us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.051288 (+627265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:47.051347 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:47.051402 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.051471 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.051598 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46175,"prepare.queue_time_us":579838,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"thread_start_us":1130392,"threads_started":2}
W20260709 13:13:46.967370  2725 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.007s
I20260709 13:13:47.001772 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:47.003460 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.005s	sys 0.042s
W20260709 13:13:47.077512 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.005s	sys 0.042s
W20260709 13:13:47.077853 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 639692us
I20260709 13:13:47.009176 28723 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:46.929780  2730 raft_consensus.cc:476] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Not starting pre-election -- already a leader
W20260709 13:13:46.986872  2919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.030s
W20260709 13:13:46.994987  2660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.024s	sys 0.020s
W20260709 13:13:47.057565 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.973553  2762 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.981389  2822 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:47.067199 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.076539 29257 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:47.078830 29253 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:47.138052  2905 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.161629  2762 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.157320  2648 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.163107  2905 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:47.164291  2938 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:13:47.164489  2762 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:47.106082 28546 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.024261  2595 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:13:47.162369  2933 log.cc:927] Time spent T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 13:13:47.095727 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:47.110085 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:47.101890 28723 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 13:13:47.159595 28649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1482) took 1802 ms. Trace:
I20260709 13:13:47.171175 28721 raft_consensus.cc:2410] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:13:46.995504  2873 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:47.187565 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.170081 28726 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
W20260709 13:13:47.176388 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 80789.9us
W20260709 13:13:47.150559  2935 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
W20260709 13:13:47.179898 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.034s
W20260709 13:13:47.068288  2917 consensus_meta.cc:287] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.001s
I20260709 13:13:47.062345  2825 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:47.157369  2951 log.cc:927] Time spent T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:13:47.139423  2864 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:47.176263 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 70266.2us
I20260709 13:13:47.192620 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:47.217299 28723 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:47.221518 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:47.188774 28721 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
W20260709 13:13:47.173213  2660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.027s	sys 0.022s
I20260709 13:13:47.231607  2761 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:47.165146  2458 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.233414 29260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 2110) took 1239 ms. Trace:
I20260709 13:13:47.067749  2857 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:47.233814 29260 rpcz_store.cc:276] 0709 13:13:45.994356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.995294 (+   938us) service_pool.cc:224] Handling call
0709 13:13:45.995811 (+   517us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:45.996361 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.996405 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:46.005093 (+  8688us) log.cc:844] Serialized 52 byte log entry
0709 13:13:46.485552 (+480459us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:46.500802 (+ 15250us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.501387 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.501478 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:47.233170 (+731692us) raft_consensus.cc:1685] finished
0709 13:13:47.233194 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.233354 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14290,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":277,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":17831,"thread_start_us":428006,"threads_started":1,"wal-append.queue_time_us":819224}
I20260709 13:13:47.184583  2462 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:47.231841 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:47.024646  2855 raft_consensus.cc:740] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:47.172034  2919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.016s	sys 0.032s
W20260709 13:13:47.200940 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.010s	sys 0.035s
I20260709 13:13:47.211030 28728 pending_rounds.cc:85] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 11
W20260709 13:13:47.258065 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 613888us
I20260709 13:13:47.258211 28728 pending_rounds.cc:107] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:13:47.258831 28728 raft_consensus.cc:2889] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:47.258867 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:47.259528 28721 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 13:13:47.192212 28622 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:47.117084  2824 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:47.103106  2725 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:47.236637  2857 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:47.190205  2730 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:47.237259  2308 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:47.238345  2767 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:47.239627  2714 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.003s
I20260709 13:13:47.274098  2714 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:47.179764  2288 raft_consensus.cc:697] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:47.278447  2288 consensus_queue.cc:237] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:47.281682  2956 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:13:47.281932  2714 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:47.285408  2857 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:47.117357  2884 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:13:47.177695 28649 rpcz_store.cc:276] 0709 13:13:45.356861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.369115 (+ 12254us) service_pool.cc:224] Handling call
0709 13:13:45.369516 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:45.373181 (+  3665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.373212 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:45.390362 (+ 17150us) log.cc:844] Serialized 52 byte log entry
0709 13:13:46.243049 (+852687us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:46.745744 (+502695us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.159174 (+413430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.159304 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:47.159377 (+    73us) raft_consensus.cc:1685] finished
0709 13:13:47.159389 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.159532 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11054,"prepare.queue_time_us":207047,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":19122,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":73043,"thread_start_us":1675376,"threads_started":3,"wal-append.queue_time_us":1132906}
I20260709 13:13:47.203672  2595 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:47.265473 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.268564 28723 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:47.327741 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:47.328296 28723 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:47.328452 28573 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
W20260709 13:13:47.271247 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 79180.4us
I20260709 13:13:47.287889 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:47.260915 28721 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:47.305546 29256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1944) took 1522 ms. Trace:
I20260709 13:13:47.322535  2864 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:47.320904 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 62112.6us
I20260709 13:13:47.333182 28725 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:47.338219 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:47.342124  2871 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:47.343827  2871 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:47.343601  2595 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:47.344235  2871 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:47.293946  2308 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:47.345479  2308 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:47.345611  2871 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.346875  2871 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:47.347927 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:47.349509 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:47.352218 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.355741 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:47.360807 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.362730 28621 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:47.369875 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:47.348944 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:47.359428 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:47.330658 29256 rpcz_store.cc:276] 0709 13:13:45.782869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.783149 (+   280us) service_pool.cc:224] Handling call
0709 13:13:45.783502 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.783797 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:46.731984 (+948187us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.305035 (+573051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:47.305126 (+    91us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:47.305203 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.305302 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.305467 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64066,"prepare.queue_time_us":71496,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":38,"raft.queue_time_us":129767,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":120,"thread_start_us":1456264,"threads_started":3,"wal-append.queue_time_us":521672}
W20260709 13:13:47.351121  2906 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.002s
I20260709 13:13:47.321434  2714 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:47.394935 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 46076.9us
W20260709 13:13:47.397183 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.399907 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:47.395499 28573 raft_consensus.cc:2393] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 12: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:47.245172  2873 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:13:47.410332 28654 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:13:47.405036  2970 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:47.396319  2906 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:47.413576  2967 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:13:47.415132  2906 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:47.415964 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:47.418591  2959 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:13:47.421229 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.396489  2971 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:47.422642  2971 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.423192  2971 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:47.295930  2824 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.396507  2765 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:47.427194  2824 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:47.427533  2765 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:47.406512 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:47.428023  2765 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:47.386581  2855 consensus_queue.cc:260] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.430256 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:47.430764  2855 raft_consensus.cc:3060] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:47.119395 28472 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 16, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 16 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:47.434423 28472 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 16, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 16 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:47.438489  2725 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:47.408193  2714 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.441221  2714 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:47.439332 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1489) took 1377 ms. Trace:
W20260709 13:13:47.442536  2950 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:13:47.442687 28647 rpcz_store.cc:276] 0709 13:13:46.062291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.062399 (+   108us) service_pool.cc:224] Handling call
0709 13:13:46.062743 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:46.077794 (+ 15051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:46.077827 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:46.089337 (+ 11510us) log.cc:844] Serialized 26 byte log entry
0709 13:13:46.611138 (+521801us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:46.637279 (+ 26141us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.637507 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.637603 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:47.439121 (+801518us) raft_consensus.cc:1685] finished
0709 13:13:47.439153 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.439280 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5521,"prepare.queue_time_us":27343,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":15430,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":17197,"thread_start_us":498477,"threads_started":1,"wal-append.queue_time_us":1314147}
I20260709 13:13:47.433480 28576 raft_consensus.cc:3055] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:47.459581 28654 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:47.467724 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:47.459425 29260 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:47.470489 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.471817 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:47.436012 28472 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 13 to 19, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 19 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:47.461110 29259 raft_consensus.cc:1240] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:47.462644 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:47.463465 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:47.464462 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:47.458148 28581 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:47.466531 28576 raft_consensus.cc:740] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:47.499979 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 289059us
I20260709 13:13:47.499971 28576 consensus_queue.cc:260] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.506983 28576 raft_consensus.cc:3060] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:47.508888 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 46354.2us
I20260709 13:13:47.492674  2949 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.515781 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:47.516902 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53869.3us
I20260709 13:13:47.521736 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.498968  2905 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:47.533821 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.535594  2714 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:47.535898  2765 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:47.537891 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.538288  2946 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:47.051347 28729 rpcz_store.cc:276] 0709 13:13:45.682166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.935194 (+253028us) service_pool.cc:224] Handling call
0709 13:13:45.935553 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.935777 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:46.490573 (+554796us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.945075 (+454502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:46.952285 (+  7210us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:46.952341 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.952409 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.952538 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55649,"prepare.queue_time_us":518095,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":23,"raft.queue_time_us":106,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":16229,"thread_start_us":1008219,"threads_started":2}
I20260709 13:13:47.539906 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:47.540464 28729 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:47.532584  2822 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:47.546080 29223 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:47.549513 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.551204  2966 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:47.553139  2947 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:47.553303 28472 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 6 to 7, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 7 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:47.554533  2966 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:47.555051 28472 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 17, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.557638 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:47.510138  2960 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:47.565900 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:47.509119  2713 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:47.573799 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:47.575399 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:47.575809 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:47.576710 28653 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:47.577032 29251 raft_consensus.cc:1240] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:47.577378 28650 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:47.581382 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:47.585233 28576 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:13:47.508643  2857 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:13:47.615200 28654 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:46.665743 28730 rpcz_store.cc:276] 0709 13:13:45.570641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.577660 (+  7019us) service_pool.cc:224] Handling call
0709 13:13:45.588072 (+ 10412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.588274 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:46.171161 (+582887us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.662016 (+490855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:46.662095 (+    79us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:46.662147 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.662223 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.662356 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":865099,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":2170,"thread_start_us":1049903,"threads_started":2}
I20260709 13:13:47.616044 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:47.588110 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:47.620731 28648 raft_consensus.cc:2393] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:47.589985 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:47.594758 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:47.595080 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:47.595443 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:47.631588 29258 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: []
W20260709 13:13:47.644165 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.609724 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.510289  2767 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:13:47.569561  2966 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:13:47.682762 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 293110us
I20260709 13:13:47.567137  2761 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.645445  2969 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:13:47.694864 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 85288us
I20260709 13:13:47.680124 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:47.578828 28695 connection.cc:256] RPC call timeout handler was delayed by -2.2670807300000888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:13:47.676065  2700 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:13:47.695993 28576 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:13:47.614147  2947 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:47.523218  2558 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 13:13:47.697121 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.697943 28730 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
W20260709 13:13:47.713115 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.617235  2968 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:47.718955 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:47.719795 28730 raft_consensus.cc:2376] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21. Re-sending same reply.
W20260709 13:13:47.721689 28695 connection.cc:256] RPC call timeout handler was delayed by -1.7747807299999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
I20260709 13:13:47.531993  2949 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.724545 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:47.726161 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.729128 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:47.580936  2713 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.706899  2899 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:47.695813  2969 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:47.764837 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 67851.1us
I20260709 13:13:47.766132 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.768854 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:47.772442 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.773936 28730 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:47.776511 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.782509 28723 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:47.702175  2761 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.761389  2899 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:47.810832 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:47.811717 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 226615us
I20260709 13:13:47.721886  2972 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:13:47.759066  2975 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:47.759202  2947 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:47.815208 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 299277us
I20260709 13:13:47.850343 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.784523  2905 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:47.832937 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 146305us
I20260709 13:13:47.809273  2762 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:47.839622 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.727324  2968 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:47.833170  2942 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.725s	user 0.004s	sys 0.000s
I20260709 13:13:47.843912 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:47.844372 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.822734  2857 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:47.820921  2801 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:47.870388 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:47.877389 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.877661 28730 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:47.701884 28472 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.890412 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:47.883176 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 117096us
I20260709 13:13:47.891360 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:47.888908  2801 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:47.846376  2822 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:47.831966  2953 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:13:47.872282  2765 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:47.862905  2975 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:47.896967  2974 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:47.884174  2595 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:47.893249  2288 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.934374 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:47.906045  2762 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:47.944994 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:47.949160 28726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.005s	sys 0.007s
I20260709 13:13:47.891264  2725 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
W20260709 13:13:47.951251 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:47.949683 28726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.005s	sys 0.007s
W20260709 13:13:47.936919  2887 consensus_meta.cc:287] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 1.330s	user 0.014s	sys 0.002s
W20260709 13:13:47.919682  2308 consensus_meta.cc:287] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 13:13:47.840643  2969 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:47.971693  2990 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 13:13:47.950210  2762 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.972141 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1624) took 1911 ms. Trace:
I20260709 13:13:47.943723  3006 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:47.917066  2975 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:47.986040 28729 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 23.
I20260709 13:13:47.988438  3001 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:47.989373  3001 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:47.978322 28580 rpcz_store.cc:276] 0709 13:13:46.060660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.060815 (+   155us) service_pool.cc:224] Handling call
0709 13:13:46.061254 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:46.081288 (+ 20034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:46.081335 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:46.090428 (+  9093us) log.cc:844] Serialized 26 byte log entry
0709 13:13:46.549525 (+459097us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:46.594072 (+ 44547us) log.cc:844] Serialized 14 byte log entry
0709 13:13:46.594563 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.594660 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:47.586557 (+991897us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:47.971808 (+385251us) raft_consensus.cc:1685] finished
0709 13:13:47.971911 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:47.972060 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6410,"prepare.queue_time_us":44104,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":13186,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":10040,"spinlock_wait_cycles":13173504,"thread_start_us":442515,"threads_started":1,"wal-append.queue_time_us":886843}
I20260709 13:13:47.951360  3009 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:47.945799  2288 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:47.991751  2989 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:13:47.953738  2822 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:47.993451 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.953262  2996 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:13:47.994596 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:47.993820 28472 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 12, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 12 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:13:47.979815 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:47.995850  2982 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:13:47.885990  2899 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.996832  2899 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:47.997503 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:47.998287  2968 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:47.999682  2949 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.000283 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2891) took 1751 ms. Trace:
I20260709 13:13:48.001755  2761 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.000638 28656 rpcz_store.cc:276] 0709 13:13:46.249372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.249510 (+   138us) service_pool.cc:224] Handling call
0709 13:13:46.249868 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:46.342006 (+ 92138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:46.342055 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:46.342747 (+   692us) log.cc:844] Serialized 52 byte log entry
0709 13:13:47.004616 (+661869us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:47.073728 (+ 69112us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.074066 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.999869 (+925803us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b540006d1d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:47.999940 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:47.999988 (+    48us) raft_consensus.cc:1685] finished
0709 13:13:48.000088 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.000226 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146,"prepare.queue_time_us":61524,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":90147,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":5533,"spinlock_wait_cycles":210941696,"thread_start_us":661423,"threads_started":1,"wal-append.queue_time_us":759879}
I20260709 13:13:47.992774  2288 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:47.951779  2947 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:47.982030  2308 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.009577 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:48.010389 28729 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:47.976608 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 84883.4us
I20260709 13:13:48.011032 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.978169 28581 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:47.952211  2974 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:48.022110 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.998345 28728 raft_consensus.cc:2410] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:13:47.980508 29223 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:47.995282 28721 raft_consensus.cc:2368] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20.
I20260709 13:13:47.989712  3001 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:48.037161 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:48.030987 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50568.6us
I20260709 13:13:48.042060 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:48.044323 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 438787us
I20260709 13:13:48.046633 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:48.049790 28728 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:47.985260  2762 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:48.051717 28656 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:48.051153 28729 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:48.074018 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:48.081830 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:48.086416 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:48.099001  2997 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:48.087348 28655 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:48.102680 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.103631 28572 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:48.104391 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.122001 28730 raft_consensus.cc:1275] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:13:48.051501  2980 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:13:47.996248 28472 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:48.036264  2648 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:48.117617 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:48.051402  2761 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:13:48.121220  2976 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:13:48.030534  3004 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:48.051002  2725 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.030401  3003 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:48.075471  2979 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:13:48.139851 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:48.142588 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 268307us
I20260709 13:13:48.100404  2857 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:48.134667  2971 consensus_meta.cc:287] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.711s	user 0.014s	sys 0.000s
I20260709 13:13:48.108327  3011 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:48.156009 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 293361us
I20260709 13:13:48.135664  2871 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:48.144063  2997 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:48.170665 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:48.166805 28728 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:13:48.176991 28577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 3248) took 1473 ms. Trace:
I20260709 13:13:48.182011 28577 rpcz_store.cc:276] 0709 13:13:46.703392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.706588 (+  3196us) service_pool.cc:224] Handling call
0709 13:13:46.706912 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.158915 (+452003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.158952 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:47.167629 (+  8677us) log.cc:844] Serialized 26 byte log entry
0709 13:13:47.463562 (+295933us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:47.463601 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.463681 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.176781 (+713100us) raft_consensus.cc:1685] finished
0709 13:13:48.176801 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.176923 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120547,"raft.queue_time_us":42536,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":35482,"thread_start_us":633920,"threads_started":2,"wal-append.queue_time_us":476886}
I20260709 13:13:48.169234  2725 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.164723  2857 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:48.163978  2308 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.253425 29255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1882) took 2394 ms. Trace:
I20260709 13:13:48.253886 29255 rpcz_store.cc:276] 0709 13:13:45.858811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.861127 (+  2316us) service_pool.cc:224] Handling call
0709 13:13:45.861462 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:46.603335 (+741873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.253165 (+1649830us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b5400641ed4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:48.253364 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703933312}
I20260709 13:13:48.257725  2725 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.192094  2871 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.169190  3003 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.218840  3018 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:48.262923  2871 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:48.152417  3001 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.263329  3018 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:48.263932  3018 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:48.264135  3001 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:48.181478  3011 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.216302  2997 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:48.266461  3011 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:48.266579  2997 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.243891 28472 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 12, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 12 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.270260  2391 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:48.225600 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 48504.5us
I20260709 13:13:48.270925 28472 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 15 to 17, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 17 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:48.272204  3007 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:48.272626  3007 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:48.244524  2825 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:48.155633  2864 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:48.180692  2996 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:48.188584  2767 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:48.175884  2971 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.263391  3003 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:48.218168 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47587us
I20260709 13:13:48.295040 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:48.198464  2992 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:48.273490  2825 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.274521  2857 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:48.278582 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:48.277061  3012 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.279764 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:48.292482 29259 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: []
W20260709 13:13:48.274847  3008 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.057s	user 0.004s	sys 0.001s
I20260709 13:13:48.297224 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:48.276638  2988 log.cc:927] Time spent T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.118s	user 0.002s	sys 0.005s
I20260709 13:13:48.300664 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.300483 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.301214 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.301461 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.302384 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:48.302687 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:48.323864 28572 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:48.316155 28649 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:48.318847 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:48.320780 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:48.323971 28573 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:48.248813 28728 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:48.322471 28577 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 12.
W20260709 13:13:48.306594  2855 consensus_meta.cc:287] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.875s	user 0.014s	sys 0.000s
I20260709 13:13:48.332921 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:48.334441 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.335266 28580 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:48.336336 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:48.329658 28728 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:48.338132 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.329778 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:48.342391 28647 raft_consensus.cc:2410] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 14.
I20260709 13:13:48.341355 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.344067 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:48.315671  2992 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.361277  3015 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:48.363438 28728 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 13:13:48.291065  2864 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.364823 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2622) took 1357 ms. Trace:
I20260709 13:13:48.321059  2972 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.365715  2972 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.366707  2864 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:48.367030  2927 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.365473 28726 rpcz_store.cc:276] 0709 13:13:47.007125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.201878 (+194753us) service_pool.cc:224] Handling call
0709 13:13:47.202384 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.203409 (+  1025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.203465 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:47.204150 (+   685us) log.cc:844] Serialized 26 byte log entry
0709 13:13:47.960943 (+756793us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:47.961247 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.961349 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.364567 (+403218us) raft_consensus.cc:1685] finished
0709 13:13:48.364602 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.364749 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1682,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5342,"thread_start_us":756376,"threads_started":1,"wal-append.queue_time_us":1099728}
I20260709 13:13:48.367612  2927 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.352699 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:48.372982 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:48.315874  2391 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:48.273725  3007 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.333073  2767 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:48.294397  2996 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.369421  2855 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:48.376029  3003 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:48.378998  3014 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:48.402232  3014 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:48.403244  3014 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:48.411317  2996 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.389580  2462 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:48.390043  3011 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:13:48.419106  2974 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:48.419672  2974 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.422001  2974 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.389835  2391 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.375874  2871 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:48.420739 28726 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:13:48.422447 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.380324  2995 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:48.430958  2713 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:48.424444  2983 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.584s	user 0.001s	sys 0.000s
I20260709 13:13:48.424639 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:48.431979 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2611) took 1892 ms. Trace:
I20260709 13:13:48.432391 28725 rpcz_store.cc:276] 0709 13:13:46.539459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.539590 (+   131us) service_pool.cc:224] Handling call
0709 13:13:46.574950 (+ 35360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.337157 (+762207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.431754 (+1094597us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54001ba154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:48.431921 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742946560}
I20260709 13:13:48.436230 28573 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:48.381546  2927 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.437578 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:48.438913 28721 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 20: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:48.428342 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2626) took 1167 ms. Trace:
I20260709 13:13:48.442301 28723 rpcz_store.cc:276] 0709 13:13:47.260882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.330770 (+ 69888us) service_pool.cc:224] Handling call
0709 13:13:47.331181 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.783104 (+451923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.428053 (+644949us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54001270d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:48.428280 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037362432}
I20260709 13:13:48.440733 28722 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:48.443960 28722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 3071) took 1137 ms. Trace:
I20260709 13:13:48.386302  2971 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:48.329612  3002 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:48.427420  2391 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:48.455037  2801 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.003s
I20260709 13:13:48.399093 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:48.455708  2857 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.456302  2823 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:13:48.456497 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 57554.2us
I20260709 13:13:48.400942  2825 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:48.401629  2551 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:48.385784  3022 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:13:48.458491 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.460254 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:48.463191  2996 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:48.464854  2700 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:48.465263  2700 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:48.466284  2700 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.445784 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:48.438841 28653 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:48.468178  2864 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:48.468606 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:48.469491 28653 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
W20260709 13:13:48.469936  3017 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:13:48.329082  3012 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.471882  3018 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.444432 28722 rpcz_store.cc:276] 0709 13:13:47.307060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.440057 (+1132997us) service_pool.cc:224] Handling call
0709 13:13:48.440394 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.443627 (+  3233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.443880 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:48.427695  2871 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.272907 28472 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.474542  2871 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:48.475768 28472 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:48.476959 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.477324  3012 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.468606 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:48.383715  2975 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.449193  2995 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:48.482146  2995 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:48.483004  2762 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.392549  2767 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:48.491333  2767 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:48.492465  2992 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.395016 28578 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:48.493572 28572 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:13:48.484033 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:48.498157 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.498799 28572 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:48.500361  2722 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:48.501080  2857 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:48.502056  2928 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:48.504441 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:48.506953  2877 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:48.507393  2608 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:48.507524  2877 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 23 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:48.507877  2608 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:48.508472  2877 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.509770 29258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1888) took 1751 ms. Trace:
I20260709 13:13:48.510142 29258 rpcz_store.cc:276] 0709 13:13:46.758821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.762994 (+  4173us) service_pool.cc:224] Handling call
0709 13:13:46.763262 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.632231 (+868969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.509554 (+877323us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400610154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:48.509716 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996218240}
I20260709 13:13:48.378140 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:48.483052  2995 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.485946 28472 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 14, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 14 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:48.488308  2921 log.cc:927] Time spent T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.783s	user 0.001s	sys 0.002s
W20260709 13:13:48.513999 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 135970us
W20260709 13:13:48.447666 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.519240 28722 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:13:48.521514 28723 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:48.522989 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:48.525520 28652 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:48.535471 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:48.536958 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:48.454808  3014 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.541124 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:48.543632 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:48.549134 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.551388 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:48.552150 28652 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:48.549229 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.526263  2857 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:48.552685 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:48.506955  2762 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:48.549576 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:48.562599  2974 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:48.562235 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:48.565536 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.566534  2974 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:48.569268 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.569559 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:48.568414 28620 leader_election.cc:400] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20.
I20260709 13:13:48.567049  2974 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.567669 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:48.591413 28728 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:48.599534  2944 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.600168  2944 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.603089  2944 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:48.603394 28576 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:48.603497 28472 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.558902  2725 consensus_queue.cc:1059] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:13:48.605314  2965 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:48.584913  2825 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:48.606393  2975 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.508780  2608 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:48.526921  2801 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.607501  2884 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.607218  2939 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:13:48.607999  2884 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.608506  2939 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:48.610018  3018 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:48.611661 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62215.4us
I20260709 13:13:48.612265 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:48.613677 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:48.550860  2391 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:48.607175  2608 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:48.588676 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:48.617722 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:48.573730  2905 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:48.587080  2995 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:48.632459 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:48.634382 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:48.635102 28654 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:48.635651  3018 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:48.637888 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:48.640331 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 51767us
I20260709 13:13:48.598199  2974 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:48.550669  2928 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:13:48.637928  2966 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:48.575332  2864 consensus_queue.cc:1048] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:13:48.642962 28730 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:48.641412 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:48.618780  2762 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:48.608943  2939 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:48.651814  2939 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.653052  3007 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:48.653204  2939 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:48.655403 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 3249) took 1948 ms. Trace:
I20260709 13:13:48.646296 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:48.586685  2947 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:13:48.648898 28729 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:48.582557  2558 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:13:48.632982  2905 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:48.647943  2966 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:48.655857 28574 rpcz_store.cc:276] 0709 13:13:46.706808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.706915 (+   107us) service_pool.cc:224] Handling call
0709 13:13:46.707202 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:46.740354 (+ 33152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:46.740402 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:46.755509 (+ 15107us) log.cc:844] Serialized 52 byte log entry
0709 13:13:48.311904 (+1556395us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b180035c080. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:48.388456 (+ 76552us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:48.388602 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.388679 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.655015 (+266336us) raft_consensus.cc:1685] finished
0709 13:13:48.655043 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.655333 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216512,"raft.queue_time_us":25423,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10737,"spinlock_wait_cycles":33139456,"thread_start_us":64124,"threads_started":1,"wal-append.queue_time_us":1838207}
I20260709 13:13:48.632619  2965 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:48.669857 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 3059) took 1900 ms. Trace:
I20260709 13:13:48.670959 28725 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:48.670979  2801 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:48.657891  2391 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:48.605165  3024 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.116s
I20260709 13:13:48.641286  2825 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:48.703557 28654 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
W20260709 13:13:48.702618 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55228.4us
I20260709 13:13:48.622326  3015 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:13:48.632934  2871 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.701839 28724 rpcz_store.cc:276] 0709 13:13:46.769493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.059322 (+289829us) service_pool.cc:224] Handling call
0709 13:13:47.059821 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.100441 (+ 40620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.100495 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:47.175253 (+ 74758us) log.cc:844] Serialized 26 byte log entry
0709 13:13:47.476702 (+301449us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:47.771269 (+294567us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.888915 (+117646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.888993 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.666307 (+777314us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b18004a36e0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:48.669579 (+  3272us) raft_consensus.cc:1685] finished
0709 13:13:48.669673 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.669797 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19139,"prepare.queue_time_us":56469,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":67393,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":34357,"spinlock_wait_cycles":6775168,"thread_start_us":618765,"threads_started":3,"wal-append.queue_time_us":601723}
I20260709 13:13:48.632233  2722 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:13:48.716378 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:48.721938 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:48.685619  2972 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:48.752877 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.699348  2905 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:48.699445  2966 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:48.807761 29225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.009s	sys 0.020s
W20260709 13:13:48.809154 29225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.009s	sys 0.020s
I20260709 13:13:48.714736  2965 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.006925  2595 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:49.763309 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:50.008585  3001 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.009513 29253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 1900) took 1198 ms. Trace:
I20260709 13:13:50.009713  3001 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.009941 29253 rpcz_store.cc:276] 0709 13:13:48.811171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:49.845283 (+1034112us) service_pool.cc:224] Handling call
0709 13:13:49.846026 (+   743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.007713 (+161687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.007769 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:50.007858 (+    89us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:50.007943 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.009062 (+  1119us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400513bd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:50.009109 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.009289 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370424192}
I20260709 13:13:50.014008  2714 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:50.014540  2801 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.015136  2714 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.015805  2801 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:49.770675 28572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.162s	user 0.001s	sys 0.000s
W20260709 13:13:50.017388 28572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.001s	sys 0.001s
I20260709 13:13:48.675221 28580 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:49.771955 28578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.237s	user 0.002s	sys 0.007s
W20260709 13:13:49.775067 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:49.771368 28573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.185s	user 0.001s	sys 0.000s
W20260709 13:13:49.784689 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.786806 28654 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:13:49.790723 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:49.110502 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 472668us
W20260709 13:13:48.908317 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 271420us
I20260709 13:13:50.117349 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1646) took 1589 ms. Trace:
I20260709 13:13:50.118024 28572 rpcz_store.cc:276] 0709 13:13:48.527505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.527624 (+   119us) service_pool.cc:224] Handling call
0709 13:13:48.527939 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.528348 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.528376 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.552799 (+ 24423us) log.cc:844] Serialized 26 byte log entry
0709 13:13:50.018249 (+1465450us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:50.018363 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.018492 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.116873 (+ 98381us) raft_consensus.cc:1685] finished
0709 13:13:50.116901 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.117151 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22139,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":23394,"thread_start_us":1409100,"threads_started":1,"wal-append.queue_time_us":1514825}
I20260709 13:13:49.788046 28472 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 15, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 15 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:13:50.121416 28579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.440s	user 0.026s	sys 0.022s
W20260709 13:13:50.122072 28579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.490s	user 0.026s	sys 0.022s
W20260709 13:13:50.125034 28545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.464s	user 0.020s	sys 0.070s
W20260709 13:13:50.125588 28545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.542s	user 0.020s	sys 0.070s
W20260709 13:13:50.125950 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 1.55224e+06us
I20260709 13:13:50.129947 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:50.131553  2801 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.131749 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:49.108752 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:50.134057  3028 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:13:50.134498 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:50.138302  2767 consensus_meta.cc:287] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.646s	user 0.021s	sys 0.009s
I20260709 13:13:50.138015  2917 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:50.139019  2767 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:48.917966 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 305649us
I20260709 13:13:49.844421 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:49.846900 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:49.852546 29251 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:50.141194 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:48.888485  2391 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.143189  2391 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:48.899787  2825 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:49.924841  2857 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.145195 28695 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:49.943425  2855 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.145797  2825 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.146764  2855 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.147354  3014 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.148391  3014 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.916242  2944 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:49.958752 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1503) took 2354 ms. Trace:
I20260709 13:13:49.959090  2877 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:50.149556  3053 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:49.963351 28651 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:50.150053  2877 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.150854 28651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2915) took 1976 ms. Trace:
I20260709 13:13:50.150616  3053 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.151329  3044 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.151237 28651 rpcz_store.cc:276] 0709 13:13:48.174721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.174895 (+   174us) service_pool.cc:224] Handling call
0709 13:13:49.962294 (+1787399us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b5800186f98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1eee 0000000000375939 00007f4a2cd651e0 00007f4a2ce2e0c4 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:13:49.962776 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.150543 (+187767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.150796 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13851776}
I20260709 13:13:49.960107 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.152282  3044 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.152940  3015 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:50.153451  2997 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:50.153662 28577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2976) took 1850 ms (client timeout 1746 ms). Trace:
I20260709 13:13:50.154404  2997 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:50.155191 28621 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.918s (SENT) [suppressed 8 similar messages]
I20260709 13:13:50.155435  3044 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.149372 28648 rpcz_store.cc:276] 0709 13:13:47.604294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.647022 (+ 42728us) service_pool.cc:224] Handling call
0709 13:13:47.701399 (+ 54377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.832744 (+131345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.832791 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:47.835559 (+  2768us) log.cc:844] Serialized 26 byte log entry
0709 13:13:47.916193 (+ 80634us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:47.916226 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:49.957675 (+2041449us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54003d4fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:49.957804 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:49.957919 (+   115us) raft_consensus.cc:1685] finished
0709 13:13:49.957950 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:49.958447 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141608,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3966,"spinlock_wait_cycles":300868352,"thread_start_us":75929,"threads_started":1,"wal-append.queue_time_us":337252,"wal-append.run_cpu_time_us":24710,"wal-append.run_wall_time_us":1757103}
I20260709 13:13:49.957962  2871 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:49.971275  3010 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:49.976061  3021 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 1.712s	user 0.002s	sys 0.039s
I20260709 13:13:49.979324  3057 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:49.984163  2762 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.007728  2595 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:50.077486 28578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.543s	user 0.003s	sys 0.007s
W20260709 13:13:50.083724 28573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.497s	user 0.002s	sys 0.000s
I20260709 13:13:50.097189  2971 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:50.097892 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 85149.1us
I20260709 13:13:50.101393 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1515) took 1588 ms. Trace:
I20260709 13:13:50.114014  2823 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.141319 28652 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:50.083825 28654 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50992 (request call id 3031) took 1503 ms. Trace:
I20260709 13:13:48.714043  3018 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:13:49.967029 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 2634) took 1532 ms. Trace:
I20260709 13:13:49.970093  3002 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:50.154198 28577 rpcz_store.cc:269] 0709 13:13:48.303077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.337738 (+ 34661us) service_pool.cc:224] Handling call
0709 13:13:49.959629 (+1621891us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1eee 0000000000375939 00007f4a2cd651e0 00007f4a2ce2e0c4 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:13:50.153578 (+193949us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462080}
I20260709 13:13:50.145762  2857 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.168201 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:50.162606  2877 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.219054  2595 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.168658  2997 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.191075  2762 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.221385  2997 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.149080  2391 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.148782  2825 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.149935  3034 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:50.153524  3015 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:13:50.165601  2873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.673s	user 0.015s	sys 0.023s
I20260709 13:13:50.180310 28654 rpcz_store.cc:276] 0709 13:13:48.566501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.759043 (+192542us) service_pool.cc:224] Handling call
0709 13:13:49.785584 (+1026541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.048234 (+262650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.070232 (+ 21998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:50.162949  3044 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:50.144717  2965 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:50.177757 28653 rpcz_store.cc:276] 0709 13:13:48.512888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.513055 (+   167us) service_pool.cc:224] Handling call
0709 13:13:48.513497 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.520135 (+  6638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.520173 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.526329 (+  6156us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.807986 (+281657us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:48.808030 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.808116 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.100738 (+1292622us) raft_consensus.cc:1685] finished
0709 13:13:50.100800 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.101124 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6196,"raft.queue_time_us":6323,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5930,"spinlock_wait_cycles":28544,"thread_start_us":275426,"threads_started":1,"wal-append.queue_time_us":1565392}
I20260709 13:13:50.207496  2884 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.209133 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1643) took 1712 ms. Trace:
I20260709 13:13:50.208865  2823 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.214869  3002 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.216373 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:50.182400  2971 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.262250 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.211650 28725 rpcz_store.cc:276] 0709 13:13:48.434100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.442093 (+  7993us) service_pool.cc:224] Handling call
0709 13:13:49.966319 (+1524226us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54002d8554. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:49.966607 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483113856}
I20260709 13:13:50.149748  2944 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.259418  2391 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.235087  2877 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:50.260932 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 116203us
I20260709 13:13:50.261931 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:50.180975  3014 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.228003  3034 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:50.232501  2873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.765s	user 0.015s	sys 0.024s
I20260709 13:13:50.169451 28472 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 16, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 16 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.282446  3053 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:50.178680  2801 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.235615  3044 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.203083  3057 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.252072 28578 rpcz_store.cc:276] 0709 13:13:48.496620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.506176 (+  9556us) service_pool.cc:224] Handling call
0709 13:13:48.506516 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.510754 (+  4238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.510784 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.519700 (+  8916us) log.cc:844] Serialized 26 byte log entry
0709 13:13:50.208624 (+1688924us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:50.208705 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.208839 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.208911 (+    72us) raft_consensus.cc:1685] finished
0709 13:13:50.208931 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.209085 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1931,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1642618,"threads_started":1,"wal-append.queue_time_us":1463824}
I20260709 13:13:50.227722  2997 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.255872  2825 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.277616  2595 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.266310  3059 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:50.314700  2714 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.363598 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 2982) took 1821 ms. Trace:
I20260709 13:13:50.364199 28579 rpcz_store.cc:276] 0709 13:13:48.542048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.542208 (+   160us) service_pool.cc:224] Handling call
0709 13:13:48.542652 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:48.573971 (+ 31319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.573994 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:48.583540 (+  9546us) log.cc:844] Serialized 52 byte log entry
0709 13:13:50.122870 (+1539330us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:50.123657 (+   787us) log.cc:844] Serialized 14 byte log entry
0709 13:13:50.124055 (+   398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.124229 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.361944 (+237715us) raft_consensus.cc:1685] finished
0709 13:13:50.363237 (+  1293us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.363490 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30823,"prepare.queue_time_us":16363,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":53744,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":20466,"thread_start_us":1490402,"threads_started":1,"wal-append.queue_time_us":1623944}
I20260709 13:13:50.367774 28579 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:50.371068 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.371380 28655 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2916) took 2196 ms. Trace:
I20260709 13:13:50.372010 28729 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:50.318861 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:50.379148 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 66058.8us
I20260709 13:13:50.380285 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:50.275188  2391 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.383157  2391 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.319865  2877 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.315508  3053 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:50.385679 28647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 3021) took 2816 ms (client timeout 2907 ms). Trace:
W20260709 13:13:50.320637  2974 consensus_meta.cc:287] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.645s	user 0.021s	sys 0.026s
W20260709 13:13:50.320825 28649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 3020) took 2755 ms (client timeout 2050 ms). Trace:
I20260709 13:13:50.321017  2946 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.321177 28580 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:50.321597  3061 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.321841  2801 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.310374  3044 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:50.388947 28649 rpcz_store.cc:269] 0709 13:13:47.565205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.565554 (+   349us) service_pool.cc:224] Handling call
0709 13:13:50.320332 (+2754778us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540018f954. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:50.320583 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718509440}
I20260709 13:13:50.322264 28472 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:50.323647  2995 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 1.681s	user 0.024s	sys 0.072s
I20260709 13:13:50.320873  2855 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:50.327044  2905 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 1.569s	user 0.014s	sys 0.019s
I20260709 13:13:50.329708 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1983) took 1713 ms. Trace:
I20260709 13:13:50.330740 29252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1956) took 3236 ms. Trace:
W20260709 13:13:50.331101  2608 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 1.694s	user 0.016s	sys 0.016s
I20260709 13:13:50.331867  3015 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:50.406674 28580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 2987) took 1837 ms (client timeout 1925 ms). Trace:
I20260709 13:13:50.333246  2968 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:50.334026  2966 consensus_meta.cc:287] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 1.531s	user 0.007s	sys 0.025s
I20260709 13:13:50.338361  2971 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.338713  2823 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.340580  3002 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.341205  3018 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.342358  2762 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.349726  2767 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:50.354802  3025 log.cc:927] Time spent T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 2.084s	user 0.000s	sys 0.033s
I20260709 13:13:50.355119  2997 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.355917  3058 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.356678  2944 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:50.358690  3014 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.385329  3053 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.298523  3034 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:50.320528 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:50.383922  2391 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:50.386142 28647 rpcz_store.cc:269] 0709 13:13:47.570857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.581125 (+ 10268us) service_pool.cc:224] Handling call
0709 13:13:50.385249 (+2804124us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b540027ea54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:50.385505 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747975936}
I20260709 13:13:50.406301 28656 raft_consensus.cc:1275] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 13:13:50.415627  2877 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.406234  2714 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:50.412282  2855 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.404481 28726 rpcz_store.cc:276] 0709 13:13:48.615971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.616100 (+   129us) service_pool.cc:224] Handling call
0709 13:13:48.616417 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:48.623251 (+  6834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.623286 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:48.637614 (+ 14328us) log.cc:844] Serialized 52 byte log entry
0709 13:13:48.915624 (+278010us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:48.915694 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.915803 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.329074 (+1413271us) raft_consensus.cc:1685] finished
0709 13:13:50.329132 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.329423 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6248,"raft.queue_time_us":16095,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7291,"thread_start_us":256950,"threads_started":1,"wal-append.queue_time_us":1454112}
I20260709 13:13:50.371887 28655 rpcz_store.cc:276] 0709 13:13:48.175054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.175291 (+   237us) service_pool.cc:224] Handling call
0709 13:13:48.223937 (+ 48646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.306084 (+ 82147us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:48.553387 (+247303us) log.cc:844] Serialized 14 byte log entry
0709 13:13:49.785705 (+1232318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:49.785890 (+   185us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:49.786067 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.370953 (+584886us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b5400259754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:50.371000 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.371205 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":912717,"prepare.queue_time_us":340343,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":1096762,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":346,"spinlock_wait_cycles":187619328,"thread_start_us":542538,"threads_started":2,"wal-append.queue_time_us":1434445}
W20260709 13:13:50.435290 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 291736us
W20260709 13:13:50.407104 28580 rpcz_store.cc:269] 0709 13:13:48.569556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.621481 (+ 51925us) service_pool.cc:224] Handling call
0709 13:13:50.403045 (+1781564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:50.405722 29252 rpcz_store.cc:276] 0709 13:13:47.094497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.158086 (+ 63589us) service_pool.cc:224] Handling call
0709 13:13:47.678715 (+520629us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800003c98. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:13:47.678900 (+   185us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:47.915679 (+236779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.915748 (+    69us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:47.966501 (+ 50753us) log.cc:844] Serialized 52 byte log entry
0709 13:13:48.139014 (+172513us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:48.139058 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.139118 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.660914 (+521796us) spinlock_profiling.cc:243] Waited 9.95 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:50.330233 (+1669319us) raft_consensus.cc:1685] finished
0709 13:13:50.330286 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.330554 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5525,"raft.queue_time_us":23474,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9989,"spinlock_wait_cycles":26622720,"thread_start_us":371166,"threads_started":2,"wal-append.queue_time_us":196604}
I20260709 13:13:50.429817  3015 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.403637  2974 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.428459  2725 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:50.448963 28577 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:50.420532  2825 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.475028  2930 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.430020  3048 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.477078  2714 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.478193  2974 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.431676  3054 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.428208  3051 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.415408  2966 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.480147 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:50.486541 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:50.489099  2995 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.430546  3018 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.489213  2855 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.481420  2857 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.489888  2823 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:50.490337 28472 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 13, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 13 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:50.493929 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.494853 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.483657  3014 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.497751  2930 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.499254 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:50.501289  2714 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:50.551864 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 396706us
W20260709 13:13:50.505705  2939 consensus_meta.cc:287] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 1.852s	user 0.040s	sys 0.063s
I20260709 13:13:50.506361 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.507082  2801 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:50.510576  3053 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:50.417424  2905 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.510639 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:50.510639 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.511967  3057 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:50.423285  3061 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.420851  2946 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.540948 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.522310  2725 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:50.495954 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.546428  2971 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.547102 29253 raft_consensus.cc:2368] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20.
W20260709 13:13:50.547012 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 67123.1us
I20260709 13:13:50.522874  2595 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.547735 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.547715  2855 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.445611  3059 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:13:50.485102  2997 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.525931  2767 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.559446  2391 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:50.587514 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 88495.6us
W20260709 13:13:50.598178 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.555371  3048 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.599785 28573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1645) took 2072 ms. Trace:
I20260709 13:13:50.600340  2966 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.600239 28573 rpcz_store.cc:276] 0709 13:13:48.527130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.537038 (+  9908us) service_pool.cc:224] Handling call
0709 13:13:48.537307 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.537573 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:13:50.221442 (+1683869us) log.cc:844] Serialized 14 byte log entry
0709 13:13:50.559590 (+338148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:50.571175 (+ 11585us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:50.589047 (+ 17872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.597754 (+  8707us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.599719 (+  1965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":639,"prepare.queue_time_us":99277,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1887,"raft.queue_time_us":225,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":26332,"thread_start_us":1923820,"threads_started":2}
I20260709 13:13:50.602286  2877 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:50.602718  3018 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.602810  2877 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.562448  2995 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.603403  2877 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:50.603238  2595 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.605090  3060 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.605299  2595 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.606052 28577 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:50.605836  3060 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.607707  2997 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.609236  2995 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:50.609445  2767 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.611584  2767 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.612216 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:50.547631  3051 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.613072 28574 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:50.615638  3051 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.616528 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.617367 29251 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:50.602357  2946 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:50.618204  2857 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:50.619035  2857 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.620730  2997 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:50.621248 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.522977  3058 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.621862 28575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1636) took 2460 ms. Trace:
I20260709 13:13:50.617494 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.586994  3014 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.651700  2730 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:50.652496  2730 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:50.586766  2714 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:50.653338  2714 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.653757  3014 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.644872  2767 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.656708  2767 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.657205  3055 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.657892  3055 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.659277 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.661165  2973 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.656026  2714 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.661960  2973 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.663852 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.663607  2730 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.664516 28729 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:50.664855  2730 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:50.644996  2997 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.661311  3064 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.665601 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.665930  3064 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.666394 28729 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:50.668422  3064 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.669927  2997 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.671066 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:50.671891 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 77830.1us
I20260709 13:13:50.671684  3034 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.672526  2997 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.673094 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:50.673426 28574 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:50.619335 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.627094 28472 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 14, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 14 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:50.679183 29256 raft_consensus.cc:2368] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:13:50.646394 28575 rpcz_store.cc:276] 0709 13:13:48.080105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.080348 (+   243us) service_pool.cc:224] Handling call
0709 13:13:48.105735 (+ 25387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:48.106040 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:48.106095 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:48.106758 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:13:48.168660 (+ 61902us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:13:48.168705 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.168895 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:50.353720 (+2184825us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:50.481291 (+127571us) raft_consensus.cc:1685] finished
0709 13:13:50.481324 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.540783 (+ 59459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50941696,"thread_start_us":61500,"threads_started":1,"wal-append.queue_time_us":163703}
I20260709 13:13:50.695022 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.695231  2969 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.696408 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.696693  3059 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:50.700315 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1509) took 2616 ms. Trace:
I20260709 13:13:50.700801 28656 rpcz_store.cc:276] 0709 13:13:48.083927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.084099 (+   172us) service_pool.cc:224] Handling call
0709 13:13:50.402476 (+2318377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.439157 (+ 36681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.700064 (+260907us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b540027ea50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:50.700242 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5294260480}
I20260709 13:13:50.695261  3069 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:50.702102  3069 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.702597 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.703250 29255 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:50.704550  3069 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:50.705222 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 75772.8us
I20260709 13:13:50.705627  3058 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.562321  3054 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.710131  3054 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.710640  2857 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:50.711225 28576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1639) took 2609 ms (client timeout 1823 ms). Trace:
W20260709 13:13:50.711812 28576 rpcz_store.cc:269] 0709 13:13:48.101806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.104074 (+  2268us) service_pool.cc:224] Handling call
0709 13:13:50.710771 (+2606697us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54003ff054. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:50.710977 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145740672}
I20260709 13:13:50.712929 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:50.714624  2994 log.cc:927] Time spent T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 2.441s	user 0.003s	sys 0.001s
I20260709 13:13:50.716979 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 3060) took 3910 ms. Trace:
I20260709 13:13:50.718125 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1969) took 2860 ms. Trace:
I20260709 13:13:50.718556 28730 rpcz_store.cc:276] 0709 13:13:47.857268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.263292 (+406024us) service_pool.cc:224] Handling call
0709 13:13:48.263649 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.648374 (+384725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.717704 (+2069330us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54001b9754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:50.717959 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871893760}
I20260709 13:13:50.696339 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:50.687875  3062 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.736092 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:50.739379 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:50.740099 28574 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:50.721288  3039 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.673729  2971 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.744897 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.717489 28727 rpcz_store.cc:276] 0709 13:13:46.806337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.059677 (+253340us) service_pool.cc:224] Handling call
0709 13:13:47.060098 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:47.464583 (+404485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:47.464614 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:47.476888 (+ 12274us) log.cc:844] Serialized 26 byte log entry
0709 13:13:47.841444 (+364556us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:47.841822 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.842031 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:47.842120 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:48.426504 (+584384us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b1800043de0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d29522 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:50.713668 (+2287164us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:50.716430 (+  2762us) raft_consensus.cc:1685] finished
0709 13:13:50.716464 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:50.716737 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":880,"prepare.queue_time_us":720,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":6409,"raft.queue_time_us":92813,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":32224,"spinlock_wait_cycles":18358272,"thread_start_us":693418,"threads_started":2,"wal-append.queue_time_us":762689}
I20260709 13:13:50.748678 29255 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:50.751258 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.711107  2725 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:50.753057 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 56924.5us
I20260709 13:13:50.751480 28656 raft_consensus.cc:1240] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:50.753753  2825 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.742863  2823 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:50.747905  2767 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.774480 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.756469 28472 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:50.775094 28727 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:13:50.774909  3044 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.775712 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.776342 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.778225  2823 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:50.778992  3034 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.780078  3047 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:50.742287  3062 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.750792  3039 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.786557  2930 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.788868  2971 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.790203 28573 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:50.793092 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:50.816458 28647 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:50.807088 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:50.808086 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.793324 28574 raft_consensus.cc:2468] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:50.824808 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:50.825290  2887 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:13:50.825656 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:50.826124 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.826308 28724 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:50.826447  3055 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.827193 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.827461 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:50.827121 28472 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:50.828500 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.829159 29257 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:50.828449 28650 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:50.831358 28577 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:50.877281 28650 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:50.878175 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.879747 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:50.880378 28577 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:13:50.829284  2308 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.835587 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.829975  2930 raft_consensus.cc:2764] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
W20260709 13:13:50.898283 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 177424us
I20260709 13:13:50.837531  3062 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.831460 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:50.832975 28620 leader_election.cc:336] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.926s (SENT)
I20260709 13:13:50.814546 28575 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:50.830699 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:50.862453 28647 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
W20260709 13:13:50.913580 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 118845us
I20260709 13:13:50.913986 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:50.898758 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 69743.2us
I20260709 13:13:50.916218 28724 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:13:50.919870 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.922037 29224 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:50.925426 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:50.878221 28650 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.883325  2905 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.935704 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:50.937143 28721 raft_consensus.cc:2393] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:50.942788  3067 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:13:50.942929 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:50.943753 28727 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:50.944466  2877 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.945369  3047 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:50.946969  2877 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:50.948252 28650 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:50.949331 28580 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 19: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:50.949755 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:50.932416  2308 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.953547  2308 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:50.958171 28724 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:50.960147 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 127233us
W20260709 13:13:50.961158 28620 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.931s (SENT)
I20260709 13:13:50.961673 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:50.962602 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.963415 29260 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:50.965492 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:50.966231 28647 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:50.967422 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:50.968036 28647 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:50.969455 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:50.971109  3002 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:50.971935  3002 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:50.974170 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:50.974486  2823 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:50.975195  3047 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:50.828910 28472 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 17, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 17 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:50.976579  3047 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.977020 28472 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:13:50.957758  3061 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:50.983685 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 43689.9us
I20260709 13:13:50.987605  2887 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:50.989372  2887 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:50.989768  2887 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:50.989861 28727 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:13:50.990875  2887 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:50.992163  2887 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:50.993949 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.995254 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.995674 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.995995 29255 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:50.996052 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:50.997850 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.000208 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.000972 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:51.001171 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 60782.7us
I20260709 13:13:51.002537 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.001312 29260 raft_consensus.cc:2368] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:13:51.004565 28577 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:13:51.005373 28650 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:13:51.110529 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:51.470376 28723 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:13:51.154446 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.978825 28472 catalog_manager.cc:5697] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 15, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 15 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:51.195116 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 61165us
W20260709 13:13:51.476238 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.077879 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:51.112659 28695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.053334 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:51.490562 28577 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:51.037096 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:51.110447 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:51.015264 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:51.095592 28620 leader_election.cc:336] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 2.085s (SENT)
I20260709 13:13:51.487773 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:51.005946 28650 pending_rounds.cc:85] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 10
I20260709 13:13:51.038089 29223 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:51.493484 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:51.471101  3086 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:13:51.489635 28695 connection.cc:256] RPC call timeout handler was delayed by -1.5729269590001422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 13:13:51.470103  2458 raft_consensus.cc:2804] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:51.501048 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:51.501652 28656 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.008s	sys 0.019s
W20260709 13:13:51.509724 28656 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.009s	sys 0.019s
I20260709 13:13:51.493306 28650 pending_rounds.cc:107] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 19.11
W20260709 13:13:51.500357 28695 connection.cc:256] RPC call timeout handler was delayed by -1.4102215730001717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:13:51.510912 28695 connection.cc:256] RPC call timeout handler was delayed by -1.0238686000002417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:13:51.511667 28650 raft_consensus.cc:2889] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.203058  3044 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:51.486294  3054 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:13:51.492374  3047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.049s	sys 0.083s
I20260709 13:13:51.521713 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:51.522446 28575 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:51.211012  2995 consensus_queue.cc:1059] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.298s
I20260709 13:13:51.526945 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:51.528923 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:51.522913 28648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.026s
W20260709 13:13:51.508792  2939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.021s	sys 0.024s
I20260709 13:13:51.284497  2972 consensus_queue.cc:1048] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.425s
W20260709 13:13:51.519917  3047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.049s	sys 0.083s
W20260709 13:13:51.530853  2939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.021s	sys 0.024s
W20260709 13:13:51.530194 28648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.015s	sys 0.026s
I20260709 13:13:51.537801 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.621487 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:51.651283 28650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2920) took 3475 ms. Trace:
I20260709 13:13:51.538062 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:51.654767 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 68430.5us
I20260709 13:13:51.654124 29258 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:51.655697 29251 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:13:51.656212 29251 pending_rounds.cc:85] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 15
I20260709 13:13:51.656472 28577 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:51.656692 29251 pending_rounds.cc:107] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:13:51.657195 29251 raft_consensus.cc:2889] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:51.658139 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 135335us
I20260709 13:13:51.584421 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:51.661561 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 603567us
I20260709 13:13:51.654663 28650 rpcz_store.cc:276] 0709 13:13:48.176254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.470941 (+294687us) service_pool.cc:224] Handling call
0709 13:13:48.471192 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.828176 (+2356984us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540014b2a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27d8ddc0 00007f4a27e181c0 00007f4a27e19231 00007f4a27e15d8f 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c
0709 13:13:51.529880 (+701704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.651153 (+121273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4477960576}
I20260709 13:13:51.666955 28575 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:13:51.570358  2940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.015s	sys 0.061s
I20260709 13:13:51.576287  2972 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:51.558917  2905 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:51.560118  3044 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:51.676033 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:51.621538  3054 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:51.682438 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.683157 29258 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
W20260709 13:13:51.669489  2940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.015s	sys 0.067s
I20260709 13:13:51.694170 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:51.674990  2972 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.701073 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:51.714046 28573 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:51.704566  2972 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:51.723464  2973 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:51.733464 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 65648us
I20260709 13:13:51.735431 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:51.716954  2905 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:51.754555 28654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.048s	sys 0.078s
W20260709 13:13:51.762531 28654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.048s	sys 0.078s
I20260709 13:13:51.746665  3047 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:51.770304 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.770969 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.771790 29255 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:51.771998 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.773475 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:51.774068  2970 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:13:51.777860 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:51.782020 29257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 1965) took 1256 ms. Trace:
I20260709 13:13:51.784598  3060 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:51.782548 29257 rpcz_store.cc:276] 0709 13:13:50.525925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.582614 (+ 56689us) service_pool.cc:224] Handling call
0709 13:13:50.664474 (+ 81860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.877573 (+213099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.781697 (+904124us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400327b54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:51.781917 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344558464}
I20260709 13:13:51.785889  3054 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:51.786646 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.787583  3001 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:51.799520 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:51.831343 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.835018 29260 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:51.802809 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:51.842154  3010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.639s	user 0.044s	sys 0.045s
W20260709 13:13:51.842721  3010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.639s	user 0.044s	sys 0.045s
I20260709 13:13:51.845670 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.846809 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:51.850291 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 812235us
I20260709 13:13:51.850445 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.852754 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:51.854612 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 365949us
I20260709 13:13:51.855376 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:51.873528 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.874891 29252 raft_consensus.cc:2410] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:13:51.848740  3047 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:51.855779  3060 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:51.894658 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.897260 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.901484 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:51.902524 29255 raft_consensus.cc:2393] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 19: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
W20260709 13:13:51.890544  2887 consensus_meta.cc:287] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.898s	user 0.017s	sys 0.009s
I20260709 13:13:51.901058 28622 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:51.903330 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:51.907964 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 139005us
I20260709 13:13:51.906077  2995 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:51.913741 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 203452us
W20260709 13:13:51.915096 28620 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.911430  2940 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.903013  3047 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:51.907374  2458 raft_consensus.cc:697] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:51.929282  2919 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:51.929942  2919 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:51.930437  2919 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:51.915328  3010 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:13:51.937304 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 86175.8us
I20260709 13:13:51.918758  2995 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:51.943192 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:51.943665  2995 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:51.945245 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:51.949579  3095 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:13:51.961239  3094 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:13:51.976316 28655 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:51.964696  3047 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:51.936203  2970 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.981577 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:51.936398  2940 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:51.983971  2940 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:51.919870  3060 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:13:51.936592  3010 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.001281  3010 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.002257  2939 raft_consensus.cc:3055] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:52.002732  2939 raft_consensus.cc:740] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:52.003813  2939 consensus_queue.cc:260] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:51.989399 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:52.005311 28578 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:51.981592  2970 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.011466 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.011710  2970 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.012178 28726 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:52.012640 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.013410 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.014417 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.015344 28722 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:52.015895 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.012590 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.017200  2975 raft_consensus.cc:3055] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:52.018148  2975 raft_consensus.cc:740] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:52.018950  2975 consensus_queue.cc:260] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.019914  2975 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:52.017594 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50032 (request call id 3267) took 1808 ms. Trace:
I20260709 13:13:52.022186 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.021407 28579 rpcz_store.cc:276] 0709 13:13:50.209182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.368746 (+159564us) service_pool.cc:224] Handling call
0709 13:13:50.405931 (+ 37185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.549797 (+143866us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:13:50.589830 (+ 40033us) log.cc:844] Serialized 14 byte log entry
0709 13:13:50.690344 (+100514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:50.690418 (+    74us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:13:50.690487 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.016606 (+1326119us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b18004a4640. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24cf72a6 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419
0709 13:13:52.017353 (+   747us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000ee2d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:52.017414 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.017539 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":600,"prepare.queue_time_us":33622,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":757,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":308156032,"thread_start_us":45418,"threads_started":1,"wal-append.queue_time_us":107346,"wal-append.run_cpu_time_us":1252,"wal-append.run_wall_time_us":1001280}
I20260709 13:13:51.992605  3039 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:51.993389  2917 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:52.023891  2917 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:52.024996  2917 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:52.029754 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.030866 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.032068  2939 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:52.033190 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:52.034710 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 1.33981e+06us
W20260709 13:13:52.035872 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.020815 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.037717 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:52.039192 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.992058 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:51.993654  2873 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:52.039783  2873 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:51.994040  2725 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:52.041363 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:51.996309 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2643) took 1478 ms. Trace:
I20260709 13:13:52.042168 28730 rpcz_store.cc:276] 0709 13:13:50.517967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.738713 (+220746us) service_pool.cc:224] Handling call
0709 13:13:50.750569 (+ 11856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.880420 (+129851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.880449 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:50.880490 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:50.880539 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.996010 (+1115471us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b54001cb454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:51.996073 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.996242 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207037312}
I20260709 13:13:52.017709 28721 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:52.043723 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.045385 28652 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1519) took 3511 ms. Trace:
I20260709 13:13:52.045820 28652 rpcz_store.cc:276] 0709 13:13:48.533508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.559815 (+ 26307us) service_pool.cc:224] Handling call
0709 13:13:48.560157 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.212203 (+1652046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.045125 (+1832922us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540006e0d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:52.045332 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3635156736}
I20260709 13:13:52.046417 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.045281 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.047039 29256 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 23.
I20260709 13:13:52.047560 29257 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:52.048184  3010 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.049484  2700 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:52.050024 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.050784 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.051563 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.052342 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:52.070044 29255 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 18: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:52.052234 28573 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:51.960172  2995 consensus_queue.cc:1059] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.095s
I20260709 13:13:52.046909  2725 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.992986  2458 consensus_queue.cc:237] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.017153 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 1994) took 1476 ms. Trace:
I20260709 13:13:52.059211 28696 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.060477 28578 raft_consensus.cc:2468] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
W20260709 13:13:52.061101 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.066840 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.067695  3048 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.071199 29251 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:52.071791 28722 raft_consensus.cc:2410] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 17 because replica has last-logged OpId of term: 16 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 15.
W20260709 13:13:52.090252 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 53320.9us
I20260709 13:13:52.068977  3039 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:52.059855  3051 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:52.058233  2762 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.074815  2970 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:52.092783 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.095096 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.097580 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.094767  3047 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.099041  3047 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.098006 28652 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:52.084946 28728 rpcz_store.cc:276] 0709 13:13:50.540496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.836755 (+296259us) service_pool.cc:224] Handling call
0709 13:13:50.837130 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.929234 (+ 92104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.929268 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.954955 (+ 25687us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.760644 (+805689us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b180036f460. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:51.917726 (+157082us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:51.917773 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.917855 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.005362 (+ 87507us) raft_consensus.cc:1685] finished
0709 13:13:52.005674 (+   312us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.011307 (+  5633us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82912,"raft.queue_time_us":120650,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":17010,"spinlock_wait_cycles":54499712,"thread_start_us":156881,"threads_started":1,"wal-append.queue_time_us":1013212}
W20260709 13:13:52.108158 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 124429us
I20260709 13:13:52.110280 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:52.111958 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 215784us
I20260709 13:13:52.112712 28655 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:52.101429  3048 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:52.094929  3039 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:52.114349 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.097488  3051 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.115578 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.117384 28724 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:52.119421 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:52.129741 28726 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.106858  3060 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:52.146380 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.146512 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.147081 28727 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:52.148409 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.134021 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:52.134763 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 191636us
I20260709 13:13:52.094154  2725 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.150604 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.107569  3001 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:13:52.136786  3044 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:52.115656  2762 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.244994 28729 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:52.152524 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:52.182948 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.237442 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.120990  3039 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:52.129051  3048 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.132550  3051 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:52.179592 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.195430 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.253863 28652 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:13:52.208774 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:52.192322 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:52.252100 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 99681us
I20260709 13:13:52.252574 28655 raft_consensus.cc:2393] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:52.135710  3060 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:52.256249 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 76793.2us
I20260709 13:13:52.258792 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.262563 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:52.263118 28656 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:52.263307 29251 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.214306  3011 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:13:52.193812  3047 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.177912  2927 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:52.245384  3044 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.264711 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.262679 28654 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:52.253703  3048 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:52.271538 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:52.273931 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.281615 28727 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:52.260936  2308 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:52.153374  2972 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.283254  2308 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.283715 29258 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:52.284943  3054 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:52.262027  3060 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.288717 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.266711  3011 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.265170  3010 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.264158  2917 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:52.297432 28729 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 19: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:52.300280 28652 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:52.283718  2308 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:52.274641  2927 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.311424  2927 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.313598  2725 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:52.313807 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.315106 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.316211 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.317382 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.317881 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.317994 28727 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:13:52.319005 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.319129 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.319746 28729 raft_consensus.cc:2468] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:52.320035 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.274796  3044 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:52.320856 28727 raft_consensus.cc:2410] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:52.283118  3103 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:52.321482 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.284893  2972 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.325414 28729 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:52.335911 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.337397 28726 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:52.293511  3109 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:52.272331  2995 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:13:52.346022 28727 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:52.346653 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.346653 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.355263 28726 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:52.356710 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.300100  3011 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:52.272089  3112 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:13:52.356900 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.358183 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.360563 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.360929 28695 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.285607  3054 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.334839  3103 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:52.347826 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 76344.5us
W20260709 13:13:52.351724  3111 log.cc:927] Time spent T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:13:52.367151 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.365831 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.369524  3047 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.369895  2999 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:52.298261  2960 consensus_queue.cc:1059] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.187s
I20260709 13:13:52.362598  2905 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:52.373157  2288 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:52.350153  3109 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:52.374469 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 165777us
I20260709 13:13:52.385133 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.385721 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.379168 28652 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:52.346041  2725 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:52.379870 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.374722 28729 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:52.381345 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.374198  3103 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.368583  2927 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.406057  2288 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:52.407191  2288 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:52.407517  2288 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:52.362893  3096 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:52.393586 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.380396  2999 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:52.398216 29251 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:52.397789 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.396126  2308 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.401623 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.385810 28654 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:52.388631  3109 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.413633 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:52.414323 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:52.374577  3097 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:52.415536 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.416601 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:13:52.416838 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 95053.8us
I20260709 13:13:52.413916 28655 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:52.394032  3054 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.408387  2288 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.442791  2288 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:52.443611  2308 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.445238  2873 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.446735  2873 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:52.447945  2606 raft_consensus.cc:2764] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:13:52.448760 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:52.454339 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 93475.9us
I20260709 13:13:52.455742 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.414537  3010 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:13:52.450944  2919 consensus_meta.cc:287] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.007s
I20260709 13:13:52.381975  3047 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:52.476536 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.421747  2884 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.425279  2999 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:52.490723  3011 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.492223 28730 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
W20260709 13:13:52.480513 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 65082.2us
I20260709 13:13:52.416479  2927 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.494333 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.495040  2927 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.482698 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.495572 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.495970 28723 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:13:52.496376  2606 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:52.424652  3096 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.496933 28547 leader_election.cc:400] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:13:52.501359 28547 leader_election.cc:403] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:52.501999  2969 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:13:52.503106 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.503211 28723 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:52.483212  2960 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:52.503996  2969 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:52.483598 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.495605  2927 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:52.484246  2884 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.484897  2919 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.399398  2725 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.509758 28695 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.512840  2762 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.513494  2969 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:52.514818 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.525907 28572 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:13:52.515686 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.471585  2905 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:52.517805  2999 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.530949 29256 raft_consensus.cc:2393] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 19: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:52.531131  2969 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:52.532943  3096 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:52.533306  3054 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:52.535300  2919 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.535778  2927 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:52.536715  2960 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:52.511126  3010 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:52.563123 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.553540  3125 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:13:52.568603 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.540629  3044 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.554327  2288 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.569411  3054 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:52.569674 28576 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:52.580623  2940 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.581032 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:52.581341  2940 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.570137 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:52.583063  2823 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.583607 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:52.583662  2823 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.570137 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.584400 29251 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:52.584830 29258 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:52.570786 28575 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:52.586300  3047 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.572207 29224 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.587816  3039 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:52.588445  3113 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.324s	user 0.002s	sys 0.000s
I20260709 13:13:52.572618 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.589711  3101 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:52.593349  3126 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:52.594022  3126 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:52.594738  2823 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:52.595090  3126 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.595902 29258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:13:52.596765 29258 raft_consensus.cc:606] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:52.581142  3121 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:52.598544  3121 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:52.599512  3121 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.551919  2969 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:52.599520  3120 raft_consensus.cc:3055] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:52.603220  3120 raft_consensus.cc:740] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:52.604206  3120 consensus_queue.cc:260] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.549300  2905 raft_consensus.cc:2764] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:13:52.604867 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46396 (request call id 1986) took 1067 ms. Trace:
I20260709 13:13:52.606618  2725 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.607120  3099 raft_consensus.cc:3055] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:52.629701 29259 raft_consensus.cc:1240] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:52.594743  2606 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:52.520866  3051 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:52.574510 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 194884us
I20260709 13:13:52.610630 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.617115  3054 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.565207  3096 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:52.626853 29251 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 24.
I20260709 13:13:52.586156  2939 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:52.623247 29254 rpcz_store.cc:276] 0709 13:13:51.537330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.537470 (+   140us) service_pool.cc:224] Handling call
0709 13:13:52.604613 (+1067143us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400569354. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:52.604774 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971816704}
I20260709 13:13:52.584475  3103 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.583163  2652 raft_consensus.cc:3055] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:52.645898  2652 raft_consensus.cc:740] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:52.647054  3103 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.647686 28578 raft_consensus.cc:2368] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19.
I20260709 13:13:52.657341 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:52.658212 28581 raft_consensus.cc:606] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:52.634274  2288 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.661962  3044 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:52.664052  3120 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.669459  3103 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.607141  3060 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.671904  3051 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.672260  3060 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.606655  3011 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.673635 29256 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:52.673708  3096 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.676579  3096 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.613569  2940 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.641733 29251 raft_consensus.cc:1240] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:52.642285  2999 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:52.644608  2960 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:52.670015  3103 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.633263  3048 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.630023  3099 raft_consensus.cc:740] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:52.636945 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.673108 28727 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 19: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:52.636143 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 234629us
I20260709 13:13:52.690757 29251 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:13:52.692785 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:52.699214 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:52.708499 29253 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:52.709443 29259 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:52.578750  3125 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.728078 28726 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 18: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:52.734802  2969 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:52.737222  2288 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.738018 28574 raft_consensus.cc:1240] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:52.739362  2969 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.745915  3099 consensus_queue.cc:260] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:52.781812 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 217799us
W20260709 13:13:52.794812 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.772629  3039 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.799543 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.800282 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.800346 28725 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:52.811164 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.811331 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.813951 29257 raft_consensus.cc:1240] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:52.817212 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:52.818008 29253 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.820022 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.813428 28696 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.823081 28723 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:52.823415 28696 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.828756 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:52.829595 28725 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:52.831081 28725 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:13:52.832252  2884 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.834506  3103 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.837095  2652 consensus_queue.cc:260] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.838541  2652 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.838994  3109 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.841634  3134 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:52.842126  3134 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.842509  3134 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:52.841683  3125 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:52.861598 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.863023  2652 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:52.863579  2652 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.864063  2652 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:52.869467  3048 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:52.870301 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 46966.5us
I20260709 13:13:52.871268  2972 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:52.871735 28696 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.872696  2288 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:52.873088  2288 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:52.873595  3142 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:13:52.874174  3142 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 24 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:52.874056  2288 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.882121 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:52.883246 29253 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:52.884064 29257 raft_consensus.cc:2393] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 18: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:52.884369 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.885108 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.874907  3011 consensus_queue.cc:1059] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:13:52.890455  3011 consensus_queue.cc:1243] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:13:52.890975  3011 raft_consensus.cc:3055] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:52.891812 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:52.892241 28655 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:52.842512  3109 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.888767 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.881170  3125 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:52.889809  3126 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:52.905865  3129 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:52.894649 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.896483  2652 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:52.905686 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 206581us
I20260709 13:13:52.906661 28652 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:52.906983 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.895097  3110 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:13:52.907709 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.906075 28723 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:13:52.891309  3011 raft_consensus.cc:740] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:52.875198  3142 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.909336  3011 consensus_queue.cc:260] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.910553  3011 raft_consensus.cc:3060] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:52.910950 28722 raft_consensus.cc:1240] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:52.911330  2652 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:52.897720 28653 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:52.906157  3125 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.914215  3125 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:52.899099 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.899899 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.916417 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.916947 28656 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:52.900962  3010 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:52.901604 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:13:52.887735 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 412199us
I20260709 13:13:52.884981 29256 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:52.908332  2970 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:52.917518 28652 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:52.921500 29252 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:52.923993 28651 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:52.903194 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.924604 28647 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:52.926476 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:52.926817  3134 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:52.923532 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.928498 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.907956  2887 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:52.929335 28653 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:13:52.932497 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.906350  3129 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:52.936803 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.938373 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.938681 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.939527 29253 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:52.937754 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.945376 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:52.946996 28649 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:52.939574 28652 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
W20260709 13:13:52.948618 28620 leader_election.cc:336] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Timed out: RequestConsensusVote RPC to 127.26.202.3:40339 timed out after 1.623s (SENT)
I20260709 13:13:52.950052 28656 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:52.951660 28723 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:52.952207 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.956944 29257 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:52.956424 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.959371 28695 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:52.958932 29223 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:52.964504 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.964740 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.931632  3126 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:52.934381  2999 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:52.938784  2873 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:52.962395 28651 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:52.933056  2887 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:52.941216  3129 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:52.970994 28656 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:52.969600 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.973305 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:52.982635 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.022253 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.934937  3010 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:53.023456 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52531.9us
I20260709 13:13:53.026826 29224 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.947676  2884 consensus_queue.cc:1059] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:13:52.938273  3054 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:13:52.969291  3103 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:52.970207  3110 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:53.030939 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:52.969579  2999 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:53.054250 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.032589 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:52.969910  3144 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:52.973628  3048 raft_consensus.cc:2804] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:53.037129 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.055800 28652 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:53.055094 28579 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:53.020303  2969 consensus_queue.cc:1059] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:13:53.039252 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.035969 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:52.971406  3121 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:13:53.050240 28695 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.057859 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.087050 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.031206  3102 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:13:53.101197 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.101775 28651 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:53.102272 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:53.038964 29224 leader_election.cc:400] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19.
I20260709 13:13:53.048158 28655 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:53.087729 28573 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:53.103670 29224 leader_election.cc:403] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:53.073881 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.090150  2927 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:13:53.029438  3142 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:13:53.090032  3126 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:53.090930 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.073357  3110 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:53.093329 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.099937  3048 raft_consensus.cc:697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:53.095554 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.085991 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.114323 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.117311  2927 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:53.118340 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.118188  2927 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.119434 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.119628  2927 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:13:53.100519 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.114631 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.121403 28652 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.113415 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.122725 28581 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260709 13:13:53.115682 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.031428  3096 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:13:53.104337 28647 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:53.131390 28575 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:13:53.132148 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 101307us
I20260709 13:13:53.116794 28725 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:53.123133 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:53.132349 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.134068 28721 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.125679  3047 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:53.126549  3144 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:53.136013 28576 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:53.136955 28576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
W20260709 13:13:53.137742 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 87623.2us
I20260709 13:13:53.115899  3048 consensus_queue.cc:237] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.129369  3134 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:53.130143  3010 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:53.145270 28695 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.131597  2873 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:53.132046  2919 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.103299 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.153102 28723 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:53.134598 28655 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:53.137771 28576 raft_consensus.cc:606] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:53.154500 28576 raft_consensus.cc:614] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:53.154808 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.156332 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.131358 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:53.138336 28579 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:13:53.130528 28581 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:13:53.146693 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:53.148221 28656 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:13:53.162492  2725 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:53.151157 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.187451 28573 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:53.153973 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:13:53.149852 28572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 3264) took 2942 ms (client timeout 2246 ms). Trace:
I20260709 13:13:53.188572 28723 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
W20260709 13:13:53.188611 28572 rpcz_store.cc:269] 0709 13:13:50.207980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.261820 (+ 53840us) service_pool.cc:224] Handling call
0709 13:13:53.149663 (+2887843us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54000eced4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:53.149782 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5196768128}
I20260709 13:13:53.189725 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:53.190059  2288 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:53.194451 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:53.180964 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 142104us
I20260709 13:13:53.195511 28656 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
W20260709 13:13:53.196811 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65546.1us
I20260709 13:13:53.160610 28622 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:53.181888 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.181645 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:53.183374 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.057446  2999 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:53.202982 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:53.205688 28649 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:53.196986 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.218978 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:53.217474 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 70888.3us
W20260709 13:13:53.214313 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 53843us
I20260709 13:13:53.223230 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.136508  3144 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.220229 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:53.150928  3047 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:53.151780  2973 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19.
I20260709 13:13:53.242842 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.255065 28650 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:13:53.243021  2960 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:53.257674  2960 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.257764 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.258117  2960 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:53.258708 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.259397 28649 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:53.162928  2884 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.245563 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:53.260156 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.260699 28649 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.260383  2884 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.251021 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:53.261893 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65024.1us
I20260709 13:13:53.187124  2725 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:53.261731  2968 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:53.264429 28655 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:13:53.264685 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44569.5us
I20260709 13:13:53.265748 28650 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:53.268991 28651 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:53.270987 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.262755 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:53.272835 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.210109  3054 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:53.245783  3060 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:53.317792 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 54980.4us
I20260709 13:13:53.262873  2725 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:53.326292 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55486.5us
I20260709 13:13:53.327845 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.329689 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.331280 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.331532 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.187309  2919 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.333281 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.334089 28576 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 15: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:53.335014  2919 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:53.113773  3110 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.335649 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:53.336143 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 63413.9us
I20260709 13:13:53.336505 28576 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 20: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:53.337097 28620 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:53.338573 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.339424 28576 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:53.242722  3136 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:53.353189 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.269892  2968 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:53.274729  3051 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:53.278244  3054 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.262712  3125 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:53.365581 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 163376us
I20260709 13:13:53.369573 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.263480  3097 consensus_queue.cc:1059] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
W20260709 13:13:53.358912 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 113414us
I20260709 13:13:53.375178 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.375478 28576 raft_consensus.cc:1217] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Deduplicated request from leader. Original: 18.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:13:53.376657 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:53.378731 28572 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:53.380208 28576 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:13:53.364794  2968 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:53.363991  3054 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.387915 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.389974 28722 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:53.364180  3051 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.395156 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:53.365214  3164 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:53.374826  2725 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:53.397930 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.394976  3051 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.382233  3126 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:53.397915  3131 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:13:53.390643  3011 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:53.406524 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 69577.8us
I20260709 13:13:53.424674 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.427734  3023 raft_consensus.cc:3055] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:53.428236  3023 raft_consensus.cc:740] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:53.429141  3023 consensus_queue.cc:260] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.430533  3023 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:53.431038 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.431877  3163 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:53.432343  3163 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:53.432742  3163 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:53.437398 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.440884 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 2007) took 1133 ms. Trace:
I20260709 13:13:53.441109  3131 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:53.441797  3131 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.442231  3131 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.442307 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44608 (request call id 2016) took 1080 ms. Trace:
I20260709 13:13:53.443722 28729 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:53.444657 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:53.445505  3155 log.cc:927] Time spent T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:13:53.445853 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.442814 28726 rpcz_store.cc:276] 0709 13:13:52.361528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.379640 (+ 18112us) service_pool.cc:224] Handling call
0709 13:13:53.442089 (+1062449us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54000cf654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:53.442247 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778940288}
I20260709 13:13:53.448042 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.449260 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:53.406504 28650 raft_consensus.cc:2393] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:53.446996 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.453442 28647 raft_consensus.cc:2410] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:13:53.458244 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:53.473829 28649 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:53.475524 28652 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:53.448660 28576 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:53.472172 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.475440 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:53.481851 28725 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:53.490541 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.497651 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.499437 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.501366  3166 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:53.501060 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.506034 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.428789  2884 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:53.514851 28578 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:53.414749  3134 raft_consensus.cc:2764] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:13:53.521747 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.399807  3162 raft_consensus.cc:2764] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:13:53.520002 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:53.441391 28730 rpcz_store.cc:276] 0709 13:13:52.307269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.534653 (+227384us) service_pool.cc:224] Handling call
0709 13:13:52.912785 (+378132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.912988 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:13:52.913321 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.187004 (+273683us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.187526 (+   522us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.187736 (+   210us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:13:53.191817 (+  4081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.191901 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.381721 (+189820us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b18003c2f20. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:53.439864 (+ 58143us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b18003c2f20. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24cf72a6 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4
0709 13:13:53.440690 (+   826us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54001b9c50. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:53.440815 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":968,"prepare.queue_time_us":688,"raft.queue_time_us":471,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":1028259840,"thread_start_us":246123,"threads_started":1,"wal-append.queue_time_us":249228}
I20260709 13:13:53.481302  3051 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:53.525353 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.478309  3130 raft_consensus.cc:2764] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:13:53.408133  2725 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:53.532087 28574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:53.570552 28574 raft_consensus.cc:606] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:53.534375  3011 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:53.535569 28725 raft_consensus.cc:1275] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:53.569067 28647 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:53.520304  3166 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.406405  3126 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:53.575614  3126 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:53.576464  3051 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:53.537422  3134 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:53.503948  3121 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:53.478719  2873 raft_consensus.cc:2764] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:13:53.538393  3010 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:53.450814  3164 raft_consensus.cc:3055] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:13:53.538725  3160 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:13:53.540347 28573 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:13:53.541538  3158 log.cc:927] Time spent T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:13:53.543119  3103 raft_consensus.cc:3055] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:53.503278  3136 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:53.529731 29252 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:13:53.623093 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 198529us
I20260709 13:13:53.546780 29253 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:53.557559 28721 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:53.581202 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.506454  2969 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:13:53.536892  3163 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.579774  3134 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:53.506466  3167 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:13:53.638202 29257 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:53.639166 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:53.629511 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 180313us
I20260709 13:13:53.625272 28578 raft_consensus.cc:2393] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 19: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:53.586827  3164 raft_consensus.cc:740] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:53.636973 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.590411  2725 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:53.647657 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.648896  3164 consensus_queue.cc:260] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.650197  3164 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:53.650063  3163 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:53.652114  3163 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:53.652583  3163 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.653843  3125 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:53.655460  3163 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:53.656446 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:53.658363  3166 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:53.659240  3136 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.660418 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:53.661342 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:53.662062 29260 raft_consensus.cc:2393] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:53.665271  3163 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:53.593393  3103 raft_consensus.cc:740] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:53.639055  3134 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:53.682651 28723 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:53.684818 28721 raft_consensus.cc:1240] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:53.646898  2725 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:53.688409 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 213077us
I20260709 13:13:53.690693 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:53.691471 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.694958 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:53.700687  3180 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:53.702143 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:53.702915 28573 raft_consensus.cc:2368] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:53.703102 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.703855 29252 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:53.704244 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.706676 28621 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.711076 28621 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.713768 28545 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:53.720794 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:53.714653 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 224776us
I20260709 13:13:53.715013  3163 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:53.770305  3163 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:53.770845  3163 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:53.771309 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.772202  3023 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:53.773949 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.774844 28730 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:53.722226  3103 consensus_queue.cc:260] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.722795  3175 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:53.727504 29252 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:53.776705  3060 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:53.777477  3060 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:53.674712  3131 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:53.779987  3131 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:53.781119  3167 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:53.719210  3170 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:53.739871 29260 raft_consensus.cc:1240] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:13:53.722711 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.731855  2960 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:53.728889  2927 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260709 13:13:53.744144  3134 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.692016  2725 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.722424 28722 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:53.740489 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:53.761929 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:53.796833 28725 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:53.807181 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 84575.8us
I20260709 13:13:53.808292 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.815589 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.817155 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:53.818555 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.822405 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.785912  3165 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:53.795583  3023 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:53.797421  3011 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:53.831136 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 477980us
I20260709 13:13:53.795878  3167 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:53.822058  3130 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:13:53.837416 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 133250us
I20260709 13:13:53.806170  3060 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:13:53.828300  3165 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:13:53.835646  2999 consensus_meta.cc:287] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.006s
I20260709 13:13:53.752779  2887 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.820434  2970 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:53.832425  3023 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:53.842212  3130 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:53.836876  3183 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:53.877789 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.880090 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.881635 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.881911 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.863458  3051 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:53.872386  3130 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:53.887494 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.855494 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:53.864512  3023 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:53.895217 28722 raft_consensus.cc:2393] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 19: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:53.867668  3121 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:53.901310 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.901970 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.858716  2919 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
W20260709 13:13:53.899840 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 44474us
W20260709 13:13:53.903465 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 86445us
I20260709 13:13:53.909561 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.910907 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.912068 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.891897  2887 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:53.865593  2999 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:53.915215 28722 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:53.914850 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:53.917928 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.916594 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.903486  3136 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:53.924539 28620 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.925693 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.930253 28730 raft_consensus.cc:1240] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:13:53.931329 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 210637us
I20260709 13:13:53.933072 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.934259 28621 leader_election.cc:400] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:53.934537 28621 leader_election.cc:403] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:53.937327 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:53.937116 28656 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:53.938482 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.939356 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:53.940013 28651 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:53.905696  3182 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:53.943727 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.917536  3051 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:53.944482 28655 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:13:53.930073  3129 consensus_meta.cc:287] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.906s	user 0.012s	sys 0.002s
I20260709 13:13:53.905581  3166 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:13:53.934998  3136 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.923630  3183 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:53.940819  2973 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:53.935146  2927 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:53.938613  3048 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:53.944253  3110 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:54.003928 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:53.941651  3054 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:13:53.927917  3134 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:53.876159  3167 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:53.976020  3179 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:13:53.977103 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:53.917773  3165 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:53.981386 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.922643  2968 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:53.981828 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 47712.2us
I20260709 13:13:53.946417  3170 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:53.945315  3182 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.942103  2970 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:53.948640 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.959425  3175 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:53.982365  3164 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:13:54.023962 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 75427.3us
I20260709 13:13:53.991446  3120 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:13:53.940601  3174 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:54.019456 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:54.024837 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:53.982645  3136 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:54.025722 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48754.3us
I20260709 13:13:54.033444 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:54.034825 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:13:54.036051  3149 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 1.061s	user 0.000s	sys 0.017s
W20260709 13:13:54.037699  3185 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:13:54.038776 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 2019) took 1347 ms. Trace:
I20260709 13:13:53.965668  3129 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.033093 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:54.014514  3110 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:54.043944 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:54.039217 28727 rpcz_store.cc:276] 0709 13:13:52.691618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.829477 (+137859us) service_pool.cc:224] Handling call
0709 13:13:52.829837 (+   360us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:52.873630 (+ 43793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.873667 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:52.874367 (+   700us) log.cc:844] Serialized 78 byte log entry
0709 13:13:52.941953 (+ 67586us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:53.063131 (+121178us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.063524 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.063818 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.063886 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.099363 (+ 35477us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b180032e120. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:54.035431 (+936068us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:54.038509 (+  3078us) raft_consensus.cc:1685] finished
0709 13:13:54.038532 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.038709 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92646,"prepare.queue_time_us":500744,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":50709,"raft.run_cpu_time_us":512,"raft.run_wall_time_us":49548,"spinlock_wait_cycles":33002112,"thread_start_us":160982,"threads_started":2,"wal-append.queue_time_us":85188}
I20260709 13:13:54.045400 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:54.015498  3101 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:13:54.029443  3177 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:54.025470  3182 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:54.008821  2940 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:13:54.026276  3010 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:54.055709 28727 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:54.040676  2919 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:54.013489  3054 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.060029 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:54.055800  2973 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:54.064818  2288 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:54.080657 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:54.011519  3126 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.068609  3010 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:54.046196  3165 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:54.068747  3184 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:13:54.043560  3175 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:54.062178  3186 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:13:54.062744 28653 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:54.081027 28577 raft_consensus.cc:2368] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:54.057056  3044 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:54.097931 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:54.086861  3163 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.031407  3051 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.082813  2999 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:54.070782  3144 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:13:54.088071  2919 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:54.109144 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:54.111389 28726 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:54.112514 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:54.113961  3187 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:13:54.111266  3175 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:54.094995  3161 consensus_queue.cc:1059] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:13:54.143970 28726 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:54.170580 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 3113) took 1855 ms. Trace:
I20260709 13:13:54.172060  3106 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.100s
I20260709 13:13:54.119418  3101 consensus_queue.cc:1048] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:13:54.178121 28649 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:54.199223 28651 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:13:54.205873 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.171221 28729 rpcz_store.cc:276] 0709 13:13:52.315447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.603423 (+287976us) service_pool.cc:224] Handling call
0709 13:13:53.443515 (+840092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.444125 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.170240 (+726115us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54000cf650. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:54.170513 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931143552}
I20260709 13:13:54.231590 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:54.221208  2919 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:13:54.120551  3110 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.252976 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:54.375933 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 123066us
I20260709 13:13:54.377162 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 2028) took 1459 ms. Trace:
I20260709 13:13:54.377370 28581 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:54.199497  3129 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:54.199906  2968 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 13 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:54.393280  3174 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:54.396234  3103 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:54.397897 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 363114us
I20260709 13:13:54.399688 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:54.401194  3178 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:54.401463  3177 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:54.146886  3162 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.219s
I20260709 13:13:54.408077  3188 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.409878 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.414634  3163 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:54.415273 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:54.415932 28580 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:54.421964  3191 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.422586  3191 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.221211  3054 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:54.432098  3130 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.000s
I20260709 13:13:54.400826 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:54.377707 28728 rpcz_store.cc:276] 0709 13:13:52.917829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.917951 (+   122us) service_pool.cc:224] Handling call
0709 13:13:52.932539 (+ 14588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.936945 (+  4406us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:13:53.274677 (+337732us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b180001b9a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a2b80e3c7 00007f4a27e209a7 00007f4a27e300bf 00007f4a27e30038
0709 13:13:53.579925 (+305248us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.873985 (+294060us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.891538 (+ 17553us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.892745 (+  1207us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:53.892779 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.892840 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.357640 (+464800us) raft_consensus.cc:1685] finished
0709 13:13:54.376839 (+ 19199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.377074 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":212995,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":6834,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":34033,"spinlock_wait_cycles":2577664,"thread_start_us":536530,"threads_started":2,"wal-append.queue_time_us":343877}
I20260709 13:13:54.444243 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:54.440529  3194 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260709 13:13:54.432583  3130 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.424858  3191 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:54.462934 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.466210 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:54.470110 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:54.408696  3188 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.472286 28651 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:54.585299  3206 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.616015  3172 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:54.616524  3172 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:54.619094 28656 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1555) took 1467 ms. Trace:
I20260709 13:13:54.619509 28656 rpcz_store.cc:276] 0709 13:13:53.152025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.242917 (+ 90892us) service_pool.cc:224] Handling call
0709 13:13:53.243206 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.943780 (+700574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.618881 (+675101us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540027db54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:54.619032 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580549504}
W20260709 13:13:54.590301  3164 consensus_meta.cc:287] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
W20260709 13:13:54.541756  2725 consensus_meta.cc:287] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.000s
W20260709 13:13:54.599221  3136 consensus_meta.cc:287] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
W20260709 13:13:54.601832  3170 consensus_meta.cc:287] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.001s
I20260709 13:13:54.532151  3126 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:54.535669 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:54.456598  2927 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:54.456321  3121 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:54.467036  2887 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:54.527804  3175 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.646559  3175 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.648940  3175 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:54.651489 28728 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:54.652851 28728 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:54.657528  3128 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:54.657953  3128 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:54.658718  3128 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.665894  2960 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:54.667739  3099 raft_consensus.cc:3060] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:54.670506 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 3278) took 1339 ms. Trace:
I20260709 13:13:54.670943 28581 rpcz_store.cc:276] 0709 13:13:53.330781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.330940 (+   159us) service_pool.cc:224] Handling call
0709 13:13:54.670282 (+1339342us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001a9d54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:54.670430 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2403525376}
I20260709 13:13:54.672572 28578 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
W20260709 13:13:54.676635 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.680709 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:54.450517  3051 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:54.535998  3201 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:13:54.547432  3023 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.002s
I20260709 13:13:54.543821  2995 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.533664 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:54.704233 29251 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:54.601228  3109 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.621433 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.623991 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:54.707266 28656 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
W20260709 13:13:54.636858  3165 consensus_meta.cc:287] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:13:54.638413 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:54.709990 28722 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:54.709700  3109 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.637481  3121 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.711391  3121 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:54.712069  3109 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:54.706224  3023 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.713653 29252 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:54.613524  3206 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.632768  3170 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:54.641575  3172 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.630919  3136 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:54.643597  3182 consensus_meta.cc:287] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.003s
I20260709 13:13:54.643989  3209 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:54.645947 28648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 2951) took 1390 ms. Trace:
I20260709 13:13:54.727433 28648 rpcz_store.cc:276] 0709 13:13:53.255702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.257451 (+  1749us) service_pool.cc:224] Handling call
0709 13:13:54.645725 (+1388274us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b5400298e54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:54.645869 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1444455680}
I20260709 13:13:54.659941  3128 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:54.700378 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:54.732340 28728 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:54.630753  3164 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:54.541134  3188 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:54.713688 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:54.714568 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:54.718982 29254 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:13:54.718791 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:54.629402  2725 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.714949  3103 consensus_queue.cc:1059] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:13:54.756487  3206 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:54.731736  3165 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:13:54.758643  3136 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:54.759953  3023 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:54.764430 28725 raft_consensus.cc:2368] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:54.730855  3130 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:54.715226  2884 consensus_queue.cc:1059] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:13:54.738090  3188 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:54.765437  3188 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:54.736945 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:54.713832  2995 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.739248  2975 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:13:54.741642  3195 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.721s	user 0.006s	sys 0.000s
I20260709 13:13:54.746228  3120 raft_consensus.cc:993] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: : Instructing follower 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:13:54.706415  2927 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:13:54.749745  3131 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:54.752338 28649 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:54.765798  2884 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:54.698244  2887 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.737366  3172 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:54.738785  3126 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:54.774449 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:54.775044  3170 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.765856  3188 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:54.776072  2725 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:54.776522 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:54.809604 28648 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:13:54.779096 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2675) took 1681 ms. Trace:
I20260709 13:13:54.780416  2995 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:54.780650 28721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 2038) took 1248 ms. Trace:
I20260709 13:13:54.766397  3136 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:54.784344 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:54.784475 28728 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:54.706581  3054 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:13:54.785847 28575 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:54.786419 28573 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:54.791128 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:54.792248 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:54.817715 28579 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:54.758226  3165 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:54.797801 28620 leader_election.cc:400] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:54.733455  3182 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.799825 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:54.798152  3023 raft_consensus.cc:1081] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Signalling peer 0c0ecde0af494dc9b152dee191c6d3e6 to start an election
I20260709 13:13:54.801645  3001 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:54.801988  2970 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:54.789583  3164 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.736069  3209 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.834976  3120 raft_consensus.cc:3055] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:54.796268  3174 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:54.796314  2884 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:54.808905 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:54.810797 28721 rpcz_store.cc:276] 0709 13:13:53.531821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.626066 (+ 94245us) service_pool.cc:224] Handling call
0709 13:13:53.626446 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.685365 (+ 58919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.780401 (+1095036us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b54001275d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:54.780591 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133676928}
I20260709 13:13:54.810524 28723 rpcz_store.cc:276] 0709 13:13:53.097598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.194860 (+ 97262us) service_pool.cc:224] Handling call
0709 13:13:53.682450 (+487590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.686491 (+  4041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.778852 (+1092361us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54000d61d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:54.779030 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120144768}
I20260709 13:13:54.808576  3170 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.818838 28724 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:54.819878 28620 leader_election.cc:403] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:54.824426  2873 raft_consensus.cc:2764] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:13:54.850790 28656 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:54.824237  2927 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:54.844885  3174 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.861927  3199 consensus_queue.cc:1059] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:13:54.862675 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 2939) took 1959 ms. Trace:
I20260709 13:13:54.863051 28653 rpcz_store.cc:276] 0709 13:13:52.903066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.033940 (+130874us) service_pool.cc:224] Handling call
0709 13:13:53.054181 (+ 20241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.099689 (+1045508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.862447 (+762758us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400259754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:54.862609 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319053184}
I20260709 13:13:54.845528  2884 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:54.865599  2884 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:54.824290 28728 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:54.807432  3126 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:54.853716 29223 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:54.870481 28580 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:54.871448 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:54.871853 28579 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:54.826613  2887 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:54.827785 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:54.828280  3182 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:54.829587 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 3012) took 1380 ms. Trace:
I20260709 13:13:54.819677  3165 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:54.907824 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:54.812851  3136 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.831786  3054 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.835073  3001 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:54.844612 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.851874 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:54.852770 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 55174.4us
I20260709 13:13:54.918375 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:54.843690 28648 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:54.848094  3170 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:54.859066 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:54.873592 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:54.874435 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:54.927922 28647 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:54.872051 28580 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:54.898710  3172 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:54.908773 28579 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:54.841127  2652 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.907872 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 80169.9us
I20260709 13:13:54.881676 28572 rpcz_store.cc:276] 0709 13:13:53.449433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.450255 (+   822us) service_pool.cc:224] Handling call
0709 13:13:53.506095 (+ 55840us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:53.702535 (+196440us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:53.865121 (+162586us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.008229 (+143108us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.023098 (+ 14869us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:54.029996 (+  6898us) log.cc:844] Serialized 52 byte log entry
0709 13:13:54.030208 (+   212us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:54.030267 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.030366 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.394107 (+363741us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b180047d460. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24ca3c0a 00007f4a2e3e3219 00007f4a2bcea58f 00007f4a24d29571 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd
0709 13:13:54.653505 (+259398us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b180047d460. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:54.739686 (+ 86181us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b180047d460. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24cf72a6 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db
0709 13:13:54.741038 (+  1352us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:54.805104 (+ 64066us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b180047d460. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d29522 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:13:54.829378 (+ 24274us) raft_consensus.cc:1685] finished
0709 13:13:54.829398 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.829530 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36901,"prepare.queue_time_us":335547,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":1803,"raft.queue_time_us":72653,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":17888,"spinlock_wait_cycles":69562496,"thread_start_us":414299,"threads_started":3,"wal-append.queue_time_us":144037}
W20260709 13:13:54.914894 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.844620  2970 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:54.948843 28577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50032 (request call id 3277) took 1619 ms (client timeout 2004 ms). Trace:
I20260709 13:13:54.842859  3121 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:54.949348 28577 rpcz_store.cc:269] 0709 13:13:53.329274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.329394 (+   120us) service_pool.cc:224] Handling call
0709 13:13:54.948639 (+1619245us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54001aac54. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:54.948783 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726015232}
I20260709 13:13:54.950862 28576 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:13:54.951076  3121 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:54.943396 28726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33268 (request call id 2683) took 1009 ms. Trace:
I20260709 13:13:54.954782 28726 rpcz_store.cc:276] 0709 13:13:53.933870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.012331 (+ 78461us) service_pool.cc:224] Handling call
0709 13:13:54.943231 (+930900us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b54001cb454. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:54.943329 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185756928}
I20260709 13:13:54.939291 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:54.918114  2887 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:13:54.917774  3136 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:54.918398 28651 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:54.840613  3209 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:54.928388 28656 raft_consensus.cc:3060] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:54.961364  3126 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.862720  3174 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:54.966253 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:54.966924 29259 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:54.966320  2652 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.968350 28656 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:54.970763  3165 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.971552 29256 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:54.971802  3165 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:54.917593  3010 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:54.973814 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:54.974466 29252 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:13:54.974977  3099 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:54.975136  3172 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.975390  3099 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:54.975626  3172 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:54.975842  3099 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:54.977355 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:54.923979 29253 raft_consensus.cc:1240] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:54.841461  3120 raft_consensus.cc:740] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:54.863050  3199 raft_consensus.cc:3055] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:13:54.938113 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 64607.3us
I20260709 13:13:54.939857 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:54.940939 28655 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:54.987984 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:54.941526 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:54.941378 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:54.988901 29258 raft_consensus.cc:2368] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20.
I20260709 13:13:54.988965 28572 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 10.
I20260709 13:13:54.989590 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:54.942382 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:54.989174 28578 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 13:13:54.990751 28578 pending_rounds.cc:85] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 15
I20260709 13:13:54.991001 28578 pending_rounds.cc:107] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:13:54.990851 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:54.937927  3054 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:54.946187 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 2041) took 1164 ms. Trace:
I20260709 13:13:55.034793 28730 rpcz_store.cc:276] 0709 13:13:53.782103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.786878 (+  4775us) service_pool.cc:224] Handling call
0709 13:13:53.819970 (+ 33092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.931044 (+111074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.945935 (+1014891us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000a64d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:13:54.946129 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252975872}
I20260709 13:13:54.873711  3164 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.035542 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:55.035904 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:54.983743 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.036202 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:54.930809  2905 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:55.038264 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:55.039278 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:54.991290 28578 raft_consensus.cc:2889] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:54.988852  2606 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:54.991430 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:54.929585 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:54.992875 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:54.943384  3001 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.025852 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:54.988148 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
W20260709 13:13:55.049120 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61041.9us
I20260709 13:13:54.999668  3199 raft_consensus.cc:740] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:55.054847  3199 consensus_queue.cc:260] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.056046  3199 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:54.926551  3097 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:55.057904 28653 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:13:55.058045 28655 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:55.059108 28653 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:55.059438 28725 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:55.046207  3121 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.060972  3121 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.065363 28653 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:55.065752 28577 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:55.032619 28579 raft_consensus.cc:2468] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:55.032723 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:55.033608 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47576.9us
W20260709 13:13:55.066860 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 137409us
I20260709 13:13:54.991547 28649 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:54.927114  3044 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.990208 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.069801 28726 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:55.036815 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:54.927291  3130 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:55.032274  2975 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:54.943292 28654 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:54.939867 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:55.036723 28728 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:13:55.045104  2873 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.045877 28572 raft_consensus.cc:2368] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:54.975399  2652 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.047885 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.017300 29257 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 10: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:55.050997  3209 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:55.051036 28573 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:55.026499  3047 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:55.018934  3180 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:13:55.075413 28579 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 13:13:55.046507  2606 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:55.084789 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:55.085048 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:55.082026 28545 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:55.107316 28649 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:55.080679 28653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282"
dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:50990
I20260709 13:13:55.083313 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:55.103865 28572 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:13:55.110190 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:13:55.037720 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.107594 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.111558 28573 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:55.108263 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.108392 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.113116 28578 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:55.038645  3174 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:13:55.111716 28622 leader_election.cc:400] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20.
I20260709 13:13:55.115180 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.105316 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.084079  2884 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:55.120947 28573 raft_consensus.cc:1275] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:55.057936  3188 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.088994  2905 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:55.132318 28647 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 10.
I20260709 13:13:55.099896  3096 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:55.129274 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:55.102696  2940 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:55.112294  3010 raft_consensus.cc:2764] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:13:55.118853  3207 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:55.140121  2722 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:13:55.141083 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.099993  2887 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:13:55.089282  3039 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:13:55.115936  2975 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:55.157636  2606 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.133889  3112 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:55.121580  3023 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:55.228834 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.078687  3044 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.081153  3130 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.106230  3177 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:55.117189  3134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.006s	sys 0.021s
I20260709 13:13:55.146804  3172 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.089097  2873 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.102634  3047 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.212399 28729 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
W20260709 13:13:55.217938 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 112705us
I20260709 13:13:55.159827  3054 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.131577  3170 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:13:55.168916  3102 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:55.239655  2927 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:55.242466 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.244000 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:55.275060 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:55.122402  3120 consensus_queue.cc:260] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.233435  3010 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:55.231772  3112 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.284178  3112 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:55.164462  3096 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.286723  3096 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:55.245227  3134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.006s	sys 0.021s
I20260709 13:13:55.169879  3191 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:13:55.164795  2905 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.294343  2873 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.295444  3112 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.298115  3126 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:55.268013 28653 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.301059 28653 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:55.301213  3128 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.005s
I20260709 13:13:55.271099  3102 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.303812  3102 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.236117  3001 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:55.305353  3001 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.308166  3001 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.309238  2975 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.256480  2973 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:55.164373  3207 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:55.313321  2973 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:55.313947  3207 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.315297  3207 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:55.314608  2973 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.316335  2973 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:55.317420  3164 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.256780  3177 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.279582  2927 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.321473  2927 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:55.325316 28650 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 22.
I20260709 13:13:55.326053  3176 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:55.326277  3188 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:55.281044  3209 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:55.277844 28723 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:55.245754  2606 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:55.282857  3099 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.292623  2905 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.349287 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:55.351332 28695 leader_election.cc:400] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:55.351836 28695 leader_election.cc:403] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:13:55.359383 28576 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:55.373154 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:55.357407 28653 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:55.375432 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.379205 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:55.342144  3172 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.386407 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:55.387741 28652 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:55.354702  3188 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:55.403761  3099 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.392690  3112 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.394549  3136 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.397595  2940 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:55.399653  3047 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:55.400658  3130 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.377717  2905 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:13:55.378978  3207 consensus_queue.cc:1048] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:13:55.355281  3209 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:55.415498  2927 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.468225  3170 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.471220 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 208619us
I20260709 13:13:55.473258 28576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:55.480854 28576 raft_consensus.cc:606] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.478936 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:55.482123 28652 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:55.481351 28621 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:13:55.484169 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 289681us
I20260709 13:13:55.473860  2940 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:55.485702 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.487635 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:55.494602 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.493745 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.497344 29256 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:55.497982 29258 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:13:55.490496 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:55.500839 29253 raft_consensus.cc:2410] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:13:55.500527 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.486685  3178 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:55.508849 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.502686  2873 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:55.486924  3130 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:55.499624  3164 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:55.493386  3182 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.503290  2960 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:55.486048  3170 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.517477 29224 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:55.493886  3112 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:13:55.498121  3199 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:13:55.507669  3010 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:55.512243  3178 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:55.533046  2288 raft_consensus.cc:2804] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:55.521694  2652 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:13:55.534166  3023 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:55.545636 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:55.546314 28580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:13:55.546736 28654 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:55.547153 28580 raft_consensus.cc:606] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:55.547554 28580 raft_consensus.cc:614] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:55.547927 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:55.548204 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:55.528450  3238 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:55.548671 28651 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:55.551085  2288 raft_consensus.cc:697] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:55.552109  2288 consensus_queue.cc:237] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.552968  3170 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.554273  2652 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:55.553841  3023 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.554694  2652 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:55.555621  2652 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.557159  2970 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.557395  3010 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.562971 28651 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:55.528137  3182 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.550720  3238 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.567795 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.567986  3238 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:55.568145 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:55.568688 29251 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:55.532820  2960 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.573428 28655 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:55.542549  3172 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:13:55.574615 29224 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:55.532532  3102 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.569610  2970 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:55.579663  3178 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.583709  3182 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:55.578477 28647 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:13:55.579319 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:55.571972  3164 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.593356  3164 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.587255  2970 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.587406  2458 raft_consensus.cc:2804] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:55.595966  2458 raft_consensus.cc:697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:55.594753  3178 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:55.595208 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:55.596864  2458 consensus_queue.cc:237] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.607307 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:55.606667 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.610414 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:55.612120 29254 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:55.612622 28652 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:55.613834 29259 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 20: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:55.599974  3136 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:55.618337 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.620302 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:55.620294 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.604022  2927 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.627674  2960 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.617095  3206 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:13:55.633350  2970 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.636121 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.638541 28696 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:55.640208  3142 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:55.642482  3164 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.645117 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.652885 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.657503 29251 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:55.664743 29254 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:55.666304 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.666992 28724 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:13:55.667318 28727 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:55.620219  2940 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.691443  3097 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:55.692201  3097 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.692904  2940 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.694766 29252 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:55.700582 29251 pending_rounds.cc:85] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Aborting all ops after (but not including) 10
I20260709 13:13:55.701073 29251 pending_rounds.cc:107] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:13:55.701390 29251 raft_consensus.cc:2889] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:55.680876  3142 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.713320  3142 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.718712  3142 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:55.676981  3209 consensus_queue.cc:1059] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:13:55.729314 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:55.729997 28652 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.731249 28547 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:55.734627  3177 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.737505 28622 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:55.738631  2970 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:55.739058  2970 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.739431  2970 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:55.751657  3044 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:55.736189 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.753419 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.760545 28652 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
I20260709 13:13:55.699767  3238 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.721657  3102 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:55.770952 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:55.769753 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:55.773553 28722 raft_consensus.cc:3060] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:55.774367 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:55.774793 28724 raft_consensus.cc:3060] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:55.761147  3207 raft_consensus.cc:3055] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:55.769542  3142 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:13:55.769461  3209 consensus_queue.cc:1059] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:13:55.798362  3238 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.801261 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:55.805670 28722 raft_consensus.cc:2468] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:55.809401 28724 raft_consensus.cc:2468] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:55.813573 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.778625  3207 raft_consensus.cc:740] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:55.823030  3207 consensus_queue.cc:260] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.824270  3207 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:55.826557  2970 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.828794  2970 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.837836  3180 raft_consensus.cc:3055] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:55.838631  3180 raft_consensus.cc:740] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:55.839614  3180 consensus_queue.cc:260] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.840241 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.840906 28726 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:55.841384 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.842717 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.843968 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:55.844811 28721 raft_consensus.cc:2393] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:55.845412 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.848307 28722 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:55.849781 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.850629 28724 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 21: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:13:55.856859 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.858348 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:55.860172 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 359687us
I20260709 13:13:55.862680 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:55.864202 28695 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:55.866514 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.867089 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:55.867372 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:55.867878 28656 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:55.873337 28655 raft_consensus.cc:1240] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:55.874183 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.875174 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:55.876570 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:55.865875  3237 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.878293  3237 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.879057  2905 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:55.879496  3121 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.880071  2725 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:55.880614  3237 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.881500  3134 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:55.881902  3134 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:55.882319  3134 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:55.875671  3047 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:55.886608  3047 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:55.887584  3047 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.889541  2606 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:55.890111  2606 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:55.890949  2973 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:55.891471  2973 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:55.891070  2606 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.877677 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:55.877542 28721 raft_consensus.cc:1240] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21. Ops: []
W20260709 13:13:55.897095 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 165927us
I20260709 13:13:55.897975 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:55.900035  3177 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:55.900672  3177 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.901170  3177 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:55.902664 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.866202  3238 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.906282  3238 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.908004  3120 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:55.910934 28653 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.915658  3238 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:55.916150 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:55.916759 28576 raft_consensus.cc:3060] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:55.926369 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48771.4us
I20260709 13:13:55.927573 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.926328 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:55.928820 28578 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:55.869132  2970 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:55.898862  2973 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.936007 28546 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:55.936307  3165 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.937461  2887 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:55.937736  2927 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:55.936882 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 78640.2us
I20260709 13:13:55.941154 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:55.941388 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.954941 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.943055 28573 raft_consensus.cc:1240] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:13:55.957440 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.943485  2975 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:55.943825 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.942075 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:55.958038 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:55.947966 28576 raft_consensus.cc:2468] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:13:55.958371 28579 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:13:55.960134 28572 raft_consensus.cc:1240] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:13:55.952590 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.945061 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:55.955384 29252 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:55.942046 28577 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:13:55.958853 29258 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:55.928227 28575 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:55.963827 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.967967 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:55.970438 28578 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 11.
W20260709 13:13:55.953675  3260 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:55.974066 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:55.975883 28620 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:55.978840 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.978708  3103 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:55.981513  3178 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:55.982120  3054 raft_consensus.cc:2764] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:13:55.962496  3242 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:13:55.983457  3242 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:55.983621  3178 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:55.983843  3242 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:55.984197  3178 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.984660  3242 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:55.986521  3178 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:55.970868  3039 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:55.989936  3039 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:55.993739 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:55.994009 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:56.001770 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:56.002521 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:55.999380 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.003927 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.009507 28576 raft_consensus.cc:2393] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 20: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:55.999692 28620 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:55.999583 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.011437 28578 raft_consensus.cc:2368] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:56.015360 29258 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:56.002188 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:56.017387 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.017622 28721 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 21: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:55.969558  3209 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:56.018409 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:55.969769  2973 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:56.025920  2725 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:56.033661 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:56.033825 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:56.034374 28730 raft_consensus.cc:3060] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:55.952167  2970 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:55.997176  3188 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.042147 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.003206  3039 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:13:55.997545  3174 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:56.023309  3128 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:55.971853  3142 consensus_queue.cc:1059] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:13:56.072002  3174 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.072156  3128 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:56.072639  3174 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:56.072710  3142 raft_consensus.cc:3055] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:56.023613  3209 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.073267  3142 raft_consensus.cc:740] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:56.073434  3209 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:56.074203  3142 consensus_queue.cc:260] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.074828 28575 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:56.075444  3142 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:55.996230  2975 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:13:56.077659  3264 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:13:56.077863  2975 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.003530  2927 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:55.956039  3165 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.082800  3165 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.067296 28647 raft_consensus.cc:1275] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:56.005741  3207 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:56.085376  3207 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.087644  3207 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:56.000193  3010 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:56.091403 28577 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:13:56.093679  3180 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:56.093978 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.094645 28579 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:56.095472 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.002878  3237 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.097359 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.097656 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.098090 28573 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:56.098425 28574 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:13:56.100521 28547 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.100797 28721 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:13:56.101215 28721 pending_rounds.cc:85] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 9
I20260709 13:13:56.101449 28721 pending_rounds.cc:107] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:13:56.101688 28721 raft_consensus.cc:2889] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:56.098785 28622 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:56.107651 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:56.108311 28647 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 22.
I20260709 13:13:56.072721  3128 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:56.114616 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.112433 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.116461 28578 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 22: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:56.110443 28730 raft_consensus.cc:2468] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:56.104766  2927 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.118486 28620 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:56.117781 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:56.114698 28621 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.110828  2970 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.111825  3103 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:56.125954 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.138815 28621 leader_election.cc:400] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 16. Current term is 17.
I20260709 13:13:56.143142 28621 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.144796 28622 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.102702  3188 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.105036  2905 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:13:56.111820  3010 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:13:56.109699  3237 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.127470  3238 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:56.125909  3136 raft_consensus.cc:2804] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:56.171284  3241 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:56.146920  3176 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:56.144937  3129 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:56.127381  2927 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.174764  3242 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:56.119189  3134 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.147900  3164 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:56.119418  3177 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.160794  2970 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:56.198609 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.146219  3174 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.177706  3238 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:56.183434  3267 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 13:13:56.185793  3176 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:56.211970 28730 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:13:56.210331 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 92676.3us
I20260709 13:13:56.181931  3047 consensus_queue.cc:1048] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:13:56.187265  3136 raft_consensus.cc:697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:56.216622  2927 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.217708  3243 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:56.209190  3238 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:56.212859  3176 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:56.222889  3174 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.222782  3209 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:56.223493 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.225965  3128 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.229044 28722 raft_consensus.cc:2410] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:13:56.231202  3177 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:56.232070  3269 log.cc:927] Time spent T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:13:56.233704  3134 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.233827 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.234642 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:56.266831 28723 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:56.269804 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 126731us
I20260709 13:13:56.273314 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.273981 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.274708 28575 raft_consensus.cc:2368] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:56.275331 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:56.262058  2975 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.276275 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.275131 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:56.277132 28721 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:56.276925 28578 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:13:56.275728  3174 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:56.279520 28695 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:56.280306  3142 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:56.280694  3142 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.281056  3142 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:56.284543 28723 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
W20260709 13:13:56.285213 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 545198us
I20260709 13:13:56.287048  3174 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:56.287533  3174 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:56.287961  3174 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:56.292016  3097 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.291707  3238 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.299922  3128 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.301091  3209 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:56.302130  3263 log.cc:927] Time spent T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.198s	user 0.000s	sys 0.002s
I20260709 13:13:56.297322 28695 leader_election.cc:400] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:56.303377 28695 leader_election.cc:403] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:13:56.297725 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.304195 28575 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:56.285816 28545 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:56.295701 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.314189 28578 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:13:56.313149  3237 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.315289 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.315428 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.316290 28574 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 21: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:56.318755 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.321349 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:56.321645 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.323182 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:56.323525 28652 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:56.303833  3110 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.308882  3177 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:56.330152 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:56.331099  3272 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:13:56.331272 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.331372  3010 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:56.331842 28580 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:56.333439 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.336115  3010 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:56.319458  3175 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:56.343148 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.346969  3110 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.276115  3136 consensus_queue.cc:237] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.310508  3188 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.287547  2975 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.357839 28580 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:56.363222 28575 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:56.364435 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:56.377178 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:56.389760 29223 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:56.325398  3209 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.373600  3128 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.325901  3279 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:56.390987  3273 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:56.392618  3128 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.397168  2970 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.397230  3273 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:56.373674  3177 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:56.397794  2970 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.398802  3128 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.398403  3273 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.396674  3097 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:56.361055  3175 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:56.407917 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.374017  3010 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.392323  3209 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.400143  3238 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.393368  2969 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.393718  3241 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.392995  3276 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.419641 28656 raft_consensus.cc:1240] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:56.398994  3177 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:56.420619 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 133981us
I20260709 13:13:56.403826  3044 raft_consensus.cc:2804] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:56.410355  3110 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.436372 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.443949 29224 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.446440 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.447170 29256 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:13:56.421120  3097 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:56.448963 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:56.458948 29253 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:56.436852  2970 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.475678 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.477689 29258 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:13:56.478052 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.484490 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:56.419786  3010 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.442607  3044 raft_consensus.cc:697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:56.428174  2969 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.476153  3097 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.492843 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:56.497730 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.488690 29253 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:56.431488  3241 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.493965 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.495162 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.431310  3276 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.490619  2458 raft_consensus.cc:2804] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:56.477182  2927 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.499119 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.508800 29256 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:56.485366  3103 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.495055 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:13:56.499857  3278 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:13:56.505013 28653 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:56.507249 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:56.509797 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.510565 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:56.511637 28578 raft_consensus.cc:1275] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:56.565819 28574 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:56.514297  2969 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.516319  3044 consensus_queue.cc:237] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.517304 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.518213  3284 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.496014  3282 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:56.518523  3010 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.518915  2927 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:56.578219 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 72231.1us
I20260709 13:13:56.579121 28622 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:56.525383  2975 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.528017  3276 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.535614  3142 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.552983  2973 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:56.538028  3134 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:56.553332 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 58367.7us
I20260709 13:13:56.500340  3283 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 13:13:56.565891 29257 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:56.570063 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 62893.8us
I20260709 13:13:56.590776 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.592751 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.594002 28722 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:56.501065  3172 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:56.504526  3109 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:56.537591  3209 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.563398  3245 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:56.581522  2970 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:56.571828  3103 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.577879  3120 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:56.601878 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.574753  3282 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:56.576505  2458 raft_consensus.cc:697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:56.647522  3282 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:56.647149  3174 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:56.647863  3265 log.cc:927] Time spent T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.541s	user 0.004s	sys 0.000s
I20260709 13:13:56.648099  2458 consensus_queue.cc:237] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:56.650457 29222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.649689  3174 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.650453 28652 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:56.652859  3238 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.606835 29257 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:13:56.653482  3238 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.655961  3238 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.659149 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:56.659636  2652 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:56.659904 29257 raft_consensus.cc:2368] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:56.611702 28547 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:13:56.662339 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 50723.3us
I20260709 13:13:56.662499 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.663282 29257 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:56.485621  3242 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.579967  3284 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.601773  3134 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.612592  2887 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:56.588822  2973 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.667173  3242 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.668696  3134 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.669420 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.632314  3241 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.669921  2973 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.619848  3039 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:56.631135  2927 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.671486 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.646435 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.672997 28721 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:56.674041  3176 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.618606  2970 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.680577  3284 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:56.665285 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.691496 29257 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:56.666337 29258 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:56.669483  3242 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.585388  3276 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:56.696758 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.669991  3023 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:56.635589  3172 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:56.663380  3103 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.602659 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:56.676249  3142 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:56.678658 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.681335 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.712843 28722 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:56.681954  2970 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.589699 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:56.717401 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 127803us
I20260709 13:13:56.683267 28724 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 22.
I20260709 13:13:56.684753  3176 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:56.688797 28693 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:56.647190  3288 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:13:56.694260 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:56.703890 28696 leader_election.cc:400] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 15. Current term is 16.
I20260709 13:13:56.674674 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.718267 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:56.723126 29257 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:56.701388  3023 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.727252 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:56.729341  3142 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:56.737501  3023 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:56.710678  3276 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:56.743801 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.744091 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:56.746423 29252 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 20: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:56.721900  3241 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:56.750362 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.750880 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:56.753779 28656 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:56.740653  2969 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:56.757069 29257 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:56.760098  2969 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.763041  2969 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:56.774722  2969 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:56.775883 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.776587 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.777289 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.750288  3276 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.755636  3297 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:56.843327  3297 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.843834  3297 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:56.849419  2940 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:56.850183  2969 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:56.850961  2940 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:56.778314 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.749552  3241 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:56.858661 29253 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:56.837900  3142 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:56.842424  3136 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.791043  3282 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.877274 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.868628 28620 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.880512 29224 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.842105  3051 consensus_queue.cc:1059] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:13:56.796974 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.890301 28727 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:56.797138 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.798851 28575 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:56.801057 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:56.802783 28573 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:13:56.803129 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:56.804119 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:56.812151  3287 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.293s	user 0.003s	sys 0.000s
I20260709 13:13:56.812263 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.816354 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:56.817034 28545 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:56.838361 28725 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:13:56.823774 28696 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:56.895428 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 71754.8us
I20260709 13:13:56.839973 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.789181  3172 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.863534 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.852597  3241 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:13:56.790911 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:56.909883 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 97685.5us
I20260709 13:13:56.886260  2652 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:56.917385 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 100447us
I20260709 13:13:56.795929  3023 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.875437  3142 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:56.897046 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 57180.6us
I20260709 13:13:56.896170 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.888140 29258 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:56.931022 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:56.919703 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.931954 28651 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:56.932358 28574 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:56.932930 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:56.920413 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.933854 28578 raft_consensus.cc:2393] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 22: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:56.934196 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:56.935067 28651 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:13:56.921094 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:56.924331  3180 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:56.883198  3102 consensus_queue.cc:1048] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:13:56.878508  3136 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:56.925730 28727 raft_consensus.cc:1275] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:13:56.886574  3097 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:56.924670  3286 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:56.940631 28649 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:56.938871 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.942625 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:13:56.948734 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 52656.5us
I20260709 13:13:56.986739 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:56.986960 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:56.911523  2725 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:56.896600 28721 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 20: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:56.956501 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:56.987874 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:56.963418 28651 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:13:56.962466 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:56.964708 28580 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 21: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:56.970186 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:56.993459 28648 raft_consensus.cc:2376] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21. Re-sending same reply.
I20260709 13:13:56.913667  3010 raft_consensus.cc:2764] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:13:56.936564  2969 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:56.995220 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.994980 28574 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:56.987555 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:56.996572 28578 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:56.989347 28723 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:13:56.996939 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:56.992249 28654 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:56.999302 28573 raft_consensus.cc:2368] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:13:56.999698  2969 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:57.000234  2969 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:57.003813 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:56.952684  3242 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:13:56.994603 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:56.964798  3175 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:57.009970 28656 raft_consensus.cc:2393] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 13: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:57.011302 28655 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 22.
I20260709 13:13:57.011755 29256 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:57.020747 28655 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:13:56.952152  3103 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:13:57.031025 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:56.997880  3279 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:57.010871  3164 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:57.046592 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 49578.4us
I20260709 13:13:57.017349  2722 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:57.015163  3120 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:57.049701 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:57.007129  3039 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:13:57.025266  3097 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:57.026814  3165 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:57.025522  3177 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.060848 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:13:57.073547  3300 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:13:57.073432  3286 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:57.077984  3142 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:57.067050  2905 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:57.049479  2970 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:57.048629  3164 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:57.081517 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:57.060364  3097 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:57.050781  3238 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:13:57.079437  2970 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.085911  3188 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:57.079663  3165 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:57.079569  2725 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:57.086936  3164 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:57.135490 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:57.137037 29255 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:13:57.107218  3136 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.108927  3097 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:57.084152  3177 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.142621  3188 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 22 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:57.110930  2970 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:57.145502 29256 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:57.112949  3282 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:57.139403  3302 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:13:57.161041 28622 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:57.149475  2725 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.165586  3023 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.195474  3136 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:57.211879  2606 raft_consensus.cc:3055] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:57.212519  2606 raft_consensus.cc:740] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:57.215260  3297 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.219897  3177 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.203141  3165 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:57.225394  2969 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.197391  3102 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:57.200196  3284 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:57.235162  2969 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.236182  3188 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:57.198433  3275 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:13:57.227385  3136 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.252779  3241 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:57.257869 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 252448us
I20260709 13:13:57.256733 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
W20260709 13:13:57.246106  3280 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.800s	user 0.006s	sys 0.000s
W20260709 13:13:57.266413 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 239308us
I20260709 13:13:57.269217 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:57.271121 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:57.256094  3142 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.255529  3136 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:57.233930  3102 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.265494  2905 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:57.281863 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 240666us
I20260709 13:13:57.283053 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:57.283339 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:57.285995 29256 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:57.286053 28621 leader_election.cc:400] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:13:57.286942 28621 leader_election.cc:403] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:57.287873 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:57.284677  2905 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:57.278327  2652 consensus_queue.cc:1048] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:13:57.290544  2905 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:57.291473  3322 log.cc:927] Time spent T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:13:57.285036  3279 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:57.293259  3279 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.294641  3010 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:13:57.295745  3279 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.277122  3282 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:57.328860  3279 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:57.330268  3279 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.330941  3102 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:57.332203 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46376 (request call id 2175) took 1528 ms. Trace:
I20260709 13:13:57.328925  3010 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:57.283361  3297 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.332635 29259 rpcz_store.cc:276] 0709 13:13:55.804125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.804263 (+   138us) service_pool.cc:224] Handling call
0709 13:13:55.804837 (+   574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.288128 (+483291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.288155 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:56.288626 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:13:56.357414 (+ 68788us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:56.357476 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.357579 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.229331 (+871752us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:13:57.304450 (+ 75119us) raft_consensus.cc:1685] finished
0709 13:13:57.304475 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.332129 (+ 27654us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":482606,"raft.queue_time_us":483751,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":12505472,"thread_start_us":68384,"threads_started":1,"wal-append.queue_time_us":120889}
I20260709 13:13:57.348646 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:57.349516 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:57.350265 28654 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:57.281919  3142 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.366439  3164 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.367038  3242 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.367465  3242 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:57.369370 28652 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:57.372725 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:57.375226 28725 raft_consensus.cc:1275] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:13:57.376576 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:57.377694 28721 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:57.334673  3282 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.387946  3282 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:57.390491  3241 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.391163  2905 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.272362  2606 consensus_queue.cc:260] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:57.393848  2606 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:57.420708  3276 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.427963  3176 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.428550  3176 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:57.444376 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:57.448544 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:57.450376 28573 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:57.452607 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:57.456696 28581 raft_consensus.cc:2393] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 21: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:57.457963 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:57.458647 28577 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:57.461234 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:57.471206 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:57.477411 28580 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:13:57.480581 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.481472 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:57.482331 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:57.483137 28578 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:13:57.476941 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:57.369333  3164 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.490694 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:57.496436 28655 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:13:57.434864  3279 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.427997  3142 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.497370 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:57.492947 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:57.506563 28648 raft_consensus.cc:2368] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
I20260709 13:13:57.500602 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:57.500350 28721 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:57.506518 28578 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:13:57.517665 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:57.503836 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:13:57.582008 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 50328.9us
I20260709 13:13:57.463141  3276 consensus_queue.cc:1048] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 13:13:57.610862 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 327022us
I20260709 13:13:57.612324 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:57.517760  3243 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:57.497268  3128 consensus_queue.cc:1059] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.097s
I20260709 13:13:57.627065 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:57.504467  3275 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:13:57.589766  3142 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:57.632861 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:57.669471 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:57.668680 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:57.670049 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52310us
I20260709 13:13:57.673775 29252 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:13:57.677322 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:57.683310 28730 raft_consensus.cc:2393] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:13:57.577795  3199 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:13:57.682185 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:57.688450 28654 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:13:57.617223  3279 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.694321 29256 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:13:57.693181 28729 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:57.634697  3176 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:13:57.693166  3097 consensus_meta.cc:287] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 13:13:57.637668  3142 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:57.627039  3170 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.691618  3188 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:57.671450  3273 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.641567  2905 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.630752  3134 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:13:57.693288  2722 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:57.693586  3328 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.704885  3103 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.633452  3243 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.705421  3297 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:57.636811  2970 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:57.725194  3142 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:57.760303 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 78220us
I20260709 13:13:57.701653  3279 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.729223  3177 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.702808  3321 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:13:57.745404  3188 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.823315 28620 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:57.759732  3051 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.828383 28653 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19.
I20260709 13:13:57.830768 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:57.830932 28546 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:57.832258 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:57.832959 28654 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 21.
I20260709 13:13:57.725396  3097 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.821385  3165 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:57.838551 28695 leader_election.cc:400] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
I20260709 13:13:57.839206 28695 leader_election.cc:403] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:57.741647  3170 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.749284  3273 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.830014  3188 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:57.761461  3103 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:57.873174  3329 log.cc:927] Time spent T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:13:57.895583 29255 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:57.837818  3275 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:57.762960  3297 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:57.761549  3328 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.843487  2969 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:13:57.930403 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59619.5us
I20260709 13:13:57.908550  3279 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.908959  3176 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:57.838393  3051 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:57.909543  3327 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:13:57.910426  2905 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:13:57.916164  2970 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:57.830444  3177 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.952992 28727 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:57.931318 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:57.935774 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:57.954545 28577 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:57.908643  3097 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:57.849933  3165 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:57.957792 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:57.939405  3175 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.957723 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:57.959843 28652 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:13:57.963562 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:57.942523  3275 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:57.965112 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 329116us
I20260709 13:13:57.963297 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:57.968436  3103 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:57.972039 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:57.973366 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:57.973979 28652 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:13:57.949517  2969 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:57.960228  3312 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:57.975548 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:57.996909 28724 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:13:58.000185 28577 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:57.950773  3315 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:13:58.007670 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:58.016147 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.016901 28577 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 11.
I20260709 13:13:58.019420 28727 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:13:58.001442  3339 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:13:58.025750  3335 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:13:58.030786  3177 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:58.031301  3331 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:13:57.972025  3175 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.033175 28649 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:58.033543  3243 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.034287  3051 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.034942  3328 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.035032  3051 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:58.035833  3051 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.036341  3051 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:58.036955  3165 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:58.037410  3282 consensus_meta.cc:287] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.004s
I20260709 13:13:58.037811  3282 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.038817  3273 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.039461 29253 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 21: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:13:58.020318  3010 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:58.034775  3353 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:13:58.011267  3312 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.059749 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:58.063573 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.020980  3109 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:13:58.046661  3128 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.073740 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.075166 28727 raft_consensus.cc:2410] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 13:13:58.076946 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 103441us
I20260709 13:13:58.078855 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:58.060606  3312 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:58.059242  3010 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:58.087690 28726 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
W20260709 13:13:58.096189 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 120717us
I20260709 13:13:58.097702 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:58.098362 28656 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:13:58.076407  3097 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:58.099109 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:58.097263  3136 consensus_meta.cc:287] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.811s	user 0.013s	sys 0.000s
I20260709 13:13:58.067201  3243 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:13:58.098726  3242 consensus_meta.cc:287] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.731s	user 0.014s	sys 0.006s
I20260709 13:13:58.109542 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:58.113194  3136 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.119493  3242 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.120183  3136 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.081318  3128 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.122102 28648 raft_consensus.cc:2368] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 13. Current term is 14.
I20260709 13:13:58.100937  3097 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.133450  2884 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:58.133965  2884 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.134351  2884 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:58.069927  2969 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:58.138079  3318 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.893s	user 0.002s	sys 0.007s
I20260709 13:13:58.140394  3282 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:58.121455  3010 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.150267  3128 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.070176  3275 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.160105 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:58.169720 29257 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:58.169797 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.157399  3175 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.131192  3097 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:58.185832 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.195986 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.196993 29259 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:13:58.198567 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:58.199448 28649 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:13:58.203974 28725 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:58.208014  3047 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:58.218140 29253 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 13.
I20260709 13:13:58.214136  3047 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.184386  3142 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.249258  3372 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:58.252754 28649 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 23.
I20260709 13:13:58.254321 28546 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:58.260603 28730 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:58.226874  2884 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.246022  3284 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:58.270236  3284 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:58.259387  3286 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:58.273617  3286 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.274312  3051 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.276355  3286 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.278852  2884 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.279824 28574 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:58.267051  3047 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:58.269425  2905 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
I20260709 13:13:58.285315  3051 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.288797  3188 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.291172  3188 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.264583  3364 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:13:58.292244  3364 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 23 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:58.293239  3364 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.298942 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:58.299562 28656 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:58.306321 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:58.306809 28656 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:13:58.307000 28649 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:58.307787 28730 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:58.309216 28546 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:58.284482  3312 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.315249  3142 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:58.251008  3200 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:13:58.319084 28649 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 22.
I20260709 13:13:58.320959  3290 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:58.329597  3290 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.321153  3051 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:58.332479  3051 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:58.333606  3051 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.341949 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.309410  3097 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.336408  3242 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.350070 28652 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 12: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:58.353782  3241 raft_consensus.cc:3055] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:58.354332  3241 raft_consensus.cc:740] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:58.350385  3290 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:58.357411  3097 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.320457 28546 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:13:58.355363  3241 consensus_queue.cc:260] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.365747  3241 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:58.365957  3039 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.366986  3039 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.369650  3164 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.370174  3164 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.372304  3164 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.365899  3284 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.364722  3242 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:58.378616  3242 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 22 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:13:58.379508  3242 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.380944  3284 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.382858 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:58.387921  3209 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.388487  3209 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.392120 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:58.395567  3284 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.397042  3284 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.397324  3039 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.405781 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.491567 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:58.410429 28579 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:13:58.498476 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.501111 28575 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:13:58.433400 28656 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:13:58.503129 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:58.404592 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.507725 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.508997 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:58.509747 28578 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:58.510872 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.417250  3348 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.503997  3200 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:58.513396  3200 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:58.516611 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.491302  3209 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.519881 28581 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 23 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 22. Current term is 23. Ops: []
I20260709 13:13:58.520668  3369 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:58.521239  3369 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.523882 28578 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:58.525056 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.526252 28578 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:13:58.526641  3364 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:58.529994  3364 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.532403  3364 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.536209 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:58.400601  3243 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:58.475447 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 84226.4us
I20260709 13:13:58.539644 28695 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:58.539911  3241 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:58.540587  3241 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.540016  3097 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.539343  3243 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.541452  3097 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.542761  3241 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.496591 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:58.543828 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.545033 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.545855 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.546463 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:58.547268 28724 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:58.513350  3348 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.400184  3103 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.499338 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.555477 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.546830 28721 raft_consensus.cc:2410] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:13:58.506614 28575 raft_consensus.cc:2368] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19.
I20260709 13:13:58.512777  3284 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.558720 28650 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:13:58.559577 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:58.567883 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:58.575699 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:58.563117  3164 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.588219 28724 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:58.563620  2975 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:58.591063 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:58.560534  3238 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.558714  3241 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.563912  3103 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.578462  3047 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:58.698972 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 107983us
I20260709 13:13:58.703630 28695 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:58.574499  3188 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.591728  3209 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:58.569810  3177 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 13:13:58.590632  2458 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:58.692821  3142 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:58.578868  2905 consensus_queue.cc:1059] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.127s
W20260709 13:13:58.709813  3335 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:13:58.702509  3200 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.705183  3353 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:58.594414  3286 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.119s
I20260709 13:13:58.725863 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:58.720799  3142 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.691650  3164 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.715034  3097 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.710994  3134 raft_consensus.cc:2804] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:58.714833  2458 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.747360 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.751652 28724 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:58.715340  3381 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:58.701319  3241 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.699273  3238 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.715708  3209 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:58.707715  3047 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.711043  3188 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.749405  3142 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:58.764310  3134 raft_consensus.cc:697] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:58.774662  3164 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.775274  3243 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.776043  3348 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.778990  3312 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:58.779453  3047 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.783236 28652 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:13:58.803586  3339 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:13:58.785847  3188 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.790681  3324 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:58.784881 28653 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 3094) took 1324 ms (client timeout 1644 ms). Trace:
W20260709 13:13:58.815137 28653 rpcz_store.cc:269] 0709 13:13:57.460755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.460937 (+   182us) service_pool.cc:224] Handling call
0709 13:13:58.784543 (+1323606us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400259754. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:58.784796 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842067200}
I20260709 13:13:58.791271  2975 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.793484  3170 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:58.794413  3209 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:58.769389 29223 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:58.802145 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:58.819984 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:58.804397 28723 raft_consensus.cc:1275] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:13:58.755324  2458 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:58.783108  2995 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:58.821732 28723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 2104) took 1206 ms. Trace:
I20260709 13:13:58.813659 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:13:58.823731 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 54454.1us
I20260709 13:13:58.824110 29260 raft_consensus.cc:1240] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: []
W20260709 13:13:58.824434 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 119570us
I20260709 13:13:58.822575 28723 rpcz_store.cc:276] 0709 13:13:57.615120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.615276 (+   156us) service_pool.cc:224] Handling call
0709 13:13:58.799130 (+1183854us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b58001e0098. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:13:58.799435 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:58.821465 (+ 22030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.821673 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21797120}
I20260709 13:13:58.826315 28724 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:58.826182 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.829169 28695 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19.
I20260709 13:13:58.832123 28695 leader_election.cc:403] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:13:58.834434 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.827665 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:58.837890 29260 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:58.811908  3348 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:58.839182 29254 raft_consensus.cc:2410] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:13:58.839536 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:58.817916  2975 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:58.843242 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.845566 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:58.847200 28652 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:58.829388  3245 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:58.831300  3200 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:58.822041  3369 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:58.853084  3381 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:58.853286 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.853711  3379 consensus_queue.cc:1059] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:58.857509 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.880115 29256 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 24.
I20260709 13:13:58.858316 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:58.859248 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.859958 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.860599 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.817818  3243 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:13:58.840059  3188 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19.
I20260709 13:13:58.848465  3348 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.847868 28620 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:58.835392  3177 raft_consensus.cc:2764] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:13:58.873876  3103 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:58.896282 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 48472.2us
I20260709 13:13:58.889362 29259 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:58.822522  3324 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.879556  3381 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:58.835072  2995 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.898681 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:58.908468 28652 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 22: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:58.900058 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:58.902956 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.903164 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.906898 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.915066 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:58.916050 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.915112 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.884318  3134 consensus_queue.cc:237] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.920607 28650 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:58.920495 28572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 3053) took 1500 ms. Trace:
I20260709 13:13:58.926457 28695 leader_election.cc:400] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19.
I20260709 13:13:58.923442 28572 rpcz_store.cc:276] 0709 13:13:57.419642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.426165 (+  6523us) service_pool.cc:224] Handling call
0709 13:13:57.426603 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:57.426988 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:57.427020 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:57.427638 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:13:58.574138 (+1146500us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b180004d4a0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:13:58.903072 (+328934us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:58.903121 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.903199 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:58.920238 (+ 17039us) raft_consensus.cc:1685] finished
0709 13:13:58.920259 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:58.920440 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5271,"raft.queue_time_us":4132,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":15425,"spinlock_wait_cycles":38593408,"thread_start_us":320297,"threads_started":1,"wal-append.queue_time_us":1485902}
I20260709 13:13:58.909322  3381 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:58.905316  3164 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:58.928099 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:58.882613  3200 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:58.943359 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 123467us
I20260709 13:13:58.952100 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:58.953480 29259 raft_consensus.cc:2410] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:13:58.958290 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 137528us
I20260709 13:13:58.960793 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:58.961714 28654 raft_consensus.cc:2393] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 21: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:13:58.967084 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:58.967976 28576 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:13:58.982998  3200 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:58.955154  3164 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:58.984370  3164 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:58.996317 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:58.949407  3383 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:59.010211 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 82197.4us
I20260709 13:13:59.027494  2722 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:59.027958  2722 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:58.989876  3238 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.024756  3174 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.052807 28654 raft_consensus.cc:1240] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 20. Current term is 21. Ops: []
W20260709 13:13:59.072366 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.013170  3312 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:59.043990  2722 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.274155 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.013630  3383 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.278620 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.283174 28654 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:59.279301 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.138213  3312 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.286190  3312 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:59.289674  2995 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.290504  2995 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.291100  2995 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.302006  3312 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.305119  3312 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.137461  3174 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.308221  3174 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.307977  3381 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.310467  3369 raft_consensus.cc:3055] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:59.311036  3369 raft_consensus.cc:740] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:59.311946  3369 consensus_queue.cc:260] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.313305  3324 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.198468  2722 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.197031  3384 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.333834  3384 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.337517  3350 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.317277 29260 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 14.
I20260709 13:13:59.324860 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.327703 28654 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:59.330580  2458 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.347015 28653 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:59.315903  3383 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.350169 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.354646 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.356729 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:59.360033 28622 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:59.361507 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.362749 28655 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:59.367975 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:59.352330  3142 consensus_meta.cc:287] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.006s
I20260709 13:13:59.345685  2884 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.313341  2975 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.412945  3381 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:59.413980  2975 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.378490  3142 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.353688  3369 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:59.363157  3238 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:59.426517  3384 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.409029  2884 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.435357  2884 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.435746  3297 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:59.436983  2458 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:59.441244  2995 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.444329 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.445871 29253 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:13:59.445217  3170 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:59.454707 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.455381 28573 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:13:59.461891 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.462826 28573 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:59.355708  3350 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.467317 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.467900 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:59.451007  3142 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.472834 28577 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:13:59.473446  2884 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.475783  3170 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:13:59.475800  3172 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:59.478255  3381 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.479490  3383 consensus_queue.cc:1048] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:59.492290 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:13:59.494935 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.501224 28721 raft_consensus.cc:2368] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 19. Current term is 20.
I20260709 13:13:59.501664 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:13:59.495195 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:59.497429 28573 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:13:59.506170 29253 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:13:59.496176  2884 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:59.512406 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 152448us
I20260709 13:13:59.513499 28622 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:59.497429  3103 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:13:59.511106  2905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.008s	sys 0.016s
I20260709 13:13:59.517836 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:59.521783  3039 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.526015  3350 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.527446  2458 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:59.516283  3164 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:59.500532  3172 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.503489  3381 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:59.522737  2905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.009s	sys 0.016s
I20260709 13:13:59.532675 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.534132 28622 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:59.537719 28622 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:13:59.530306  3238 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:59.519419  3103 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:59.547036 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:59.536954  3405 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:59.549083  3394 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:59.550288  3405 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:59.547823  3389 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:59.551720  3389 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.557170  2884 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.557277  3408 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:59.559954 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.535956  2458 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.567113  2458 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:59.543872  3170 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.572093  3172 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:59.578670  3103 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:13:59.587257  3333 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 1.688s	user 0.005s	sys 0.007s
I20260709 13:13:59.535512  3039 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.610682  3039 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.612525 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:13:59.616859 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 79432.9us
I20260709 13:13:59.619522 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.620452 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.621228 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:59.621960 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.619665 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.622231 28655 raft_consensus.cc:2393] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:13:59.627476  3039 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.628057  3039 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:13:59.616499  3366 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 1.251s	user 0.009s	sys 0.012s
I20260709 13:13:59.608181  3164 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
W20260709 13:13:59.631260 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 84326.2us
I20260709 13:13:59.629164  3321 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.638042  3321 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.640259  3321 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.622558  3238 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.643713 29259 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:59.651983  3292 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:13:59.652395  3369 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:59.653829  3415 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:59.654356  3415 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:59.653776  3292 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:59.655434  3292 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:13:59.656096 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:59.655496  3415 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.656489  3292 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.657338  3415 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:59.657830  3292 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:59.661264 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:59.662863  3391 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:59.663450 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:59.664623  3391 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:59.665145  3391 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.665197 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:59.665831  3391 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:59.666471  3172 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:59.667069  3172 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.667598  3172 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:59.645313  3238 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.683545  3381 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.683907  3238 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:13:59.686327  3409 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 13:13:59.687345 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.689982 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.690205 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.691519 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.691988 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.692745 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.693439 28574 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:59.692126 28577 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:59.692747 28655 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:13:59.692860 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.694813  3039 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.696714 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.696897 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.698645 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:59.699996  3381 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:59.700560  3381 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.701331  3381 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:59.704905  3164 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.709646 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:59.710373 28721 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:13:59.711086 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:13:59.711320 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:59.712890 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:59.720860 29223 leader_election.cc:400] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 19. Current term is 20.
I20260709 13:13:59.734304 29223 leader_election.cc:403] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:13:59.736749 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:13:59.721598 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:59.720661  3023 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:59.722237  3103 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:13:59.745321  2884 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:59.748737 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:59.750612 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:59.721138  3039 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:13:59.766049 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.773945 29256 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:59.749332  3415 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:59.782308 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.782971 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:59.783288 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.785621 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.789462 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.761922  3317 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:59.717945  3172 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.756606  3350 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:13:59.799388 29225 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.795754 28650 raft_consensus.cc:1275] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:59.796007  3381 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.797551  3391 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.799155 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:59.791839 29256 raft_consensus.cc:3060] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:59.803231  3188 raft_consensus.cc:493] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.763353  2458 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:59.770820  3039 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:13:59.809123 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.820214 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:59.820859 29251 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:59.815485 29256 raft_consensus.cc:2468] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:59.816529 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.816771 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:13:59.822041 28577 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:13:59.823009 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.823616 28577 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:13:59.824440 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.817901 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:59.828660 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:13:59.832003 29251 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 21.
I20260709 13:13:59.833343  3283 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:59.833810  3283 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:59.834196  3283 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:59.835379  3381 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.771890  3103 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:13:59.840662  3291 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:59.808384  3410 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.841252  3172 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.805336  3317 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.841949  3317 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:59.841635  3291 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.819551  3134 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:59.842618  3291 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.843308  3134 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:59.841579  3410 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.846730  3410 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.847806  3291 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.848660  3207 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.808249  3142 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:59.849184  3207 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:59.849697  3142 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:59.851398  3207 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.852041  3142 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.852257 28696 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:59.809428  2722 consensus_queue.cc:1048] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:13:59.853077  3142 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:59.855219  3411 log.cc:927] Time spent T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
I20260709 13:13:59.855496  3283 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.827996  3039 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:13:59.857615  3392 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.579s	user 0.001s	sys 0.002s
I20260709 13:13:59.861143 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:59.861853 28650 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:59.864552 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.805828  3350 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:13:59.865283  3350 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:59.866840 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:59.867231 28695 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:59.869383  3384 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:59.869858  3384 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:13:59.870198  3384 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:59.871433  3286 raft_consensus.cc:3055] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:13:59.871842  3286 raft_consensus.cc:740] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:13:59.828380  3188 raft_consensus.cc:515] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.876518  2975 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:13:59.877103  2975 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:13:59.878675  3378 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.038s	user 0.000s	sys 0.001s
I20260709 13:13:59.879238  2975 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.882719  3317 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:13:59.885206  3317 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:13:59.885147  3023 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:59.889447 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:13:59.890288  3369 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:59.891189 28648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50992 (request call id 3100) took 2060 ms (client timeout 2012 ms). Trace:
I20260709 13:13:59.885582 28727 raft_consensus.cc:1240] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:59.887843 29260 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:13:59.891963 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.895460 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:13:59.891763 28648 rpcz_store.cc:269] 0709 13:13:57.830335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.830476 (+   141us) service_pool.cc:224] Handling call
0709 13:13:59.890975 (+2060499us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540001bdd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:59.891119 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668150016}
I20260709 13:13:59.896963 28650 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
W20260709 13:13:59.897492 28730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33274 (request call id 3164) took 1934 ms (client timeout 1760 ms). Trace:
W20260709 13:13:59.897904 28730 rpcz_store.cc:269] 0709 13:13:57.963221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.963335 (+   114us) service_pool.cc:224] Handling call
0709 13:13:59.860954 (+1897619us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54001e73d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:13:59.897420 (+ 36466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681810176}
I20260709 13:13:59.899281 28728 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:13:59.899273 28574 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12.
I20260709 13:13:59.901245  3389 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:13:59.902472 28652 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:13:59.904652 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.905857 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.905345 28573 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:13:59.910104 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:59.910825 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:59.911448 28573 raft_consensus.cc:3060] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:59.911527 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.912187 28653 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:13:59.912317 28575 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 21.
I20260709 13:13:59.913334 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.914094 28575 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:59.914878 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:13:59.915515 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:13:59.916750 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:59.918077 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.918345 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:13:59.918697 28648 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:13:59.918869 28577 raft_consensus.cc:3060] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:13:59.919715 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.921738 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.922925 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:13:59.926452 28696 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:13:59.938119 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:13:59.949254  3410 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:59.945565 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:59.952672 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:13:59.953809 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:13:59.957144 28573 raft_consensus.cc:2468] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 21.
I20260709 13:13:59.948807 28577 raft_consensus.cc:2468] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:13:59.959525 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.960228 28577 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:13:59.961115 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.961848 28577 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 14.
I20260709 13:13:59.921259  2884 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:13:59.990125 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 74680.7us
I20260709 13:13:59.982946 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:13:59.872627  3286 consensus_queue.cc:260] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:13:59.956398  3241 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:13:59.956585  3410 raft_consensus.cc:2764] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:14:00.007706  3238 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:00.014739  3238 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:00.006204  3317 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:00.017774  3317 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:00.018306  3317 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:00.019726  3390 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:00.020624  3390 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.009897  3047 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:00.021947  3047 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:00.022629  3047 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:00.002405  2884 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.029608 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 3060) took 1624 ms. Trace:
I20260709 13:14:00.030224 28581 rpcz_store.cc:276] 0709 13:13:58.405082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.405246 (+   164us) service_pool.cc:224] Handling call
0709 13:13:58.405606 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:58.520390 (+114784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.029084 (+1508694us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003fe154. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:14:00.029530 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262365568}
I20260709 13:14:00.031813  3283 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.035104  3134 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:00.036345  3342 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:00.037196  3342 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.040140 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:00.012451  3419 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:14:00.004335 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:13:59.937711  3164 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:13:59.951808  3207 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
W20260709 13:14:00.063634 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 58401.4us
W20260709 13:14:00.064580 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 60359.2us
I20260709 13:14:00.073473 29223 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:00.045282  3415 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 19. Current term is 20.
I20260709 13:14:00.059442  3286 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:00.055629  3342 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.065407 29224 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:00.080760  3172 consensus_queue.cc:1059] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:14:00.080530  3109 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:00.095135  3044 raft_consensus.cc:2804] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:00.103489  3044 raft_consensus.cc:697] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:14:00.104101  3365 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 1.866s	user 0.001s	sys 0.010s
I20260709 13:14:00.104887  3044 consensus_queue.cc:237] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.091965  3367 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:00.099058  3172 raft_consensus.cc:3055] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:00.100011  3109 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:00.145329  3421 log.cc:927] Time spent T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.352s	user 0.003s	sys 0.000s
I20260709 13:14:00.093111  3350 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.136654  3172 raft_consensus.cc:740] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:00.155845  3172 consensus_queue.cc:260] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.146472  3238 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.160126  3390 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.161175  3188 leader_election.cc:290] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.161998  3172 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:59.151871 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:00.212980 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:00.217185 28575 raft_consensus.cc:2393] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 20: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:14:00.222275 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1728) took 2252 ms. Trace:
I20260709 13:14:00.280030  3364 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:00.228619 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 274107us
I20260709 13:14:00.232249 28471 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:00.241981  2884 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.164429  3348 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.301290 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:00.301700 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:14:00.302819 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.303375 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:00.303422 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:00.304656 28576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 3077) took 1335 ms (client timeout 1650 ms). Trace:
I20260709 13:14:00.171748  3384 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:00.325138 28576 rpcz_store.cc:269] 0709 13:13:58.969289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.969409 (+   120us) service_pool.cc:224] Handling call
0709 13:14:00.302989 (+1333580us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:14:00.304470 (+  1481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197311872}
I20260709 13:14:00.148010  3391 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:00.332391  3384 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.139294  3109 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:00.261466  3390 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.265720 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 3171) took 1362 ms. Trace:
I20260709 13:14:00.277765 28580 rpcz_store.cc:276] 0709 13:13:57.969896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.970508 (+   612us) service_pool.cc:224] Handling call
0709 13:13:57.994256 (+ 23748us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:58.001743 (+  7487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.001795 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:58.010815 (+  9020us) log.cc:844] Serialized 52 byte log entry
0709 13:13:58.209808 (+198993us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:13:58.210134 (+   326us) log.cc:844] Serialized 14 byte log entry
0709 13:13:58.216046 (+  5912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:58.216153 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:00.103358 (+1887205us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:00.221336 (+117978us) raft_consensus.cc:1685] finished
0709 13:14:00.221561 (+   225us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.221994 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5563,"prepare.queue_time_us":178,"prepare.run_cpu_time_us":1673,"prepare.run_wall_time_us":6559,"raft.queue_time_us":55751,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":7751,"spinlock_wait_cycles":10682752,"thread_start_us":160002,"threads_started":1,"wal-append.queue_time_us":187720}
W20260709 13:14:00.225637 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 135461us
W20260709 13:14:00.279393 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 66974.2us
I20260709 13:14:00.295020 28696 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:00.165700  3350 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.308894 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:00.320917 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1739) took 1127 ms. Trace:
I20260709 13:14:00.309576 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:00.175294  3317 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.344748 28730 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:00.344741 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:00.337325 28728 rpcz_store.cc:276] 0709 13:13:58.902994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.903304 (+   310us) service_pool.cc:224] Handling call
0709 13:13:59.898905 (+995601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:59.899736 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.264977 (+365241us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54001e73d0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:14:00.265377 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2261901568}
I20260709 13:14:00.336426 29255 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:14:00.344220 28579 rpcz_store.cc:276] 0709 13:13:59.193348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.193533 (+   185us) service_pool.cc:224] Handling call
0709 13:14:00.307982 (+1114449us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cdeffc0 00007f4a2cdda929 00007f4a2cdda3d2 00007f4a26351bd4
0709 13:14:00.308444 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.308813 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:00.308842 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:00.308903 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:00.308939 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.308996 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.320682 (+ 11686us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196949376}
I20260709 13:14:00.403774 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:00.405447  3102 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:00.406023 29259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46396 (request call id 2044) took 1088 ms. Trace:
I20260709 13:14:00.406456 29259 rpcz_store.cc:276] 0709 13:13:59.317736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:59.317944 (+   208us) service_pool.cc:224] Handling call
0709 13:13:59.319052 (+  1108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:59.644252 (+325200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.405498 (+761246us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54005690d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:14:00.405799 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745583872}
W20260709 13:14:00.412029 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:00.414184 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 119620us
I20260709 13:14:00.415482 28696 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:00.399956 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 445414us
I20260709 13:14:00.421303  3238 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.421972 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:00.423738  3238 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:00.426776  3238 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.431348  2725 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:00.432648  3439 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:14:00.403800 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 59330.9us
W20260709 13:14:00.423008 28572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50024 (request call id 3074) took 1456 ms (client timeout 1803 ms). Trace:
I20260709 13:14:00.442616  3440 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:00.445161  3364 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:14:00.448860 28695 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:00.458187 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:00.458864 29258 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:00.450309  3432 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:00.459975  3431 raft_consensus.cc:2804] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:00.450044  3413 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:00.460947  3431 raft_consensus.cc:697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 21 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:00.462235 29260 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:00.461620  3413 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:00.462682  3431 consensus_queue.cc:237] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.464051 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50024 (request call id 3070) took 2047 ms. Trace:
I20260709 13:14:00.464561  3398 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:00.465689  3398 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:00.460049  3432 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:00.466171  3398 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:00.466377  3432 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:00.469630 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 54408.5us
I20260709 13:14:00.472259 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:00.444252  3440 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:00.475857  3364 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:00.477993 28725 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:00.479399 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:00.480043 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:00.481165  3312 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:00.464546 28578 rpcz_store.cc:276] 0709 13:13:58.486226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.532190 (+ 45964us) service_pool.cc:224] Handling call
0709 13:13:58.532492 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:58.542529 (+ 10037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:58.542561 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:58.543026 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:13:59.902841 (+1359815us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b18003c4f60. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:14:00.221940 (+319099us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:00.222070 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:00.463494 (+241424us) spinlock_profiling.cc:243] Waited 9.67 ms on lock 0x7b54000ec4d4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:14:00.463570 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:00.463646 (+    76us) raft_consensus.cc:1685] finished
0709 13:14:00.463664 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:00.463870 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12271,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4403,"spinlock_wait_cycles":31800960,"thread_start_us":318398,"threads_started":1,"wal-append.queue_time_us":1615093}
I20260709 13:14:00.481652  3312 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:00.433749  3439 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:00.437646 28572 rpcz_store.cc:269] 0709 13:13:58.966132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.966274 (+   142us) service_pool.cc:224] Handling call
0709 13:14:00.403309 (+1437035us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b5800002798. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf1a22 00007f4a2dc0ac09 00007f4a2cd64ee0 00007f4a2ce2e0ab 00007f4a2ce2e131 00007f4a2cddc0a0 00007f4a2cddb984 00007f4a263566d4 00007f4a26356662
0709 13:14:00.422945 (+ 19636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15683328}
I20260709 13:14:00.337671  3390 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:00.482352  3312 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:00.495811  3047 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.497565 29257 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: []
W20260709 13:14:00.529150 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 54295.7us
W20260709 13:14:00.530179 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 57467.5us
I20260709 13:14:00.511648 28653 raft_consensus.cc:1240] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:14:00.520766 29253 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:00.523428 29251 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:14:00.518996 29260 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:14:00.517139 29255 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:00.441088  3238 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:00.466171  3413 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.473248  3175 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:00.509595 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:00.562163 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:14:00.514062 28621 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.202.1:36115 timed out after 1.945s (SENT) [suppressed 33 similar messages]
I20260709 13:14:00.506803 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:00.572357 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:00.502573 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:00.510681  3317 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:00.524053  3039 consensus_meta.cc:287] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.667s	user 0.004s	sys 0.015s
I20260709 13:14:00.521736  3439 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.585948  3175 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:00.589145  3039 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.590514 28730 raft_consensus.cc:2468] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:14:00.592272 29223 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:00.589300 28721 raft_consensus.cc:1240] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:00.592422  3039 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 25 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.529592  3416 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:14:00.588974 28696 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:00.593539  2905 raft_consensus.cc:2764] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:14:00.598640  3440 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.606402 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:00.613709  3039 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:00.614579  3047 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.615302 28655 raft_consensus.cc:3060] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:00.589449  3412 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:00.619364  3412 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.625766  3286 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:00.627170  3286 raft_consensus.cc:2804] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:00.627876  3286 raft_consensus.cc:697] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 20 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:00.629617 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:00.630920 28647 raft_consensus.cc:2393] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:00.632709 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:00.633728 28725 raft_consensus.cc:2410] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:14:00.636296 28656 raft_consensus.cc:2410] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:14:00.504917 28471 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 14 to 17, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 17 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:00.583329  3413 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:14:00.582974  3238 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:00.653488 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 125651us
W20260709 13:14:00.655647 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 63523.2us
I20260709 13:14:00.670584 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:00.676090  3039 consensus_queue.cc:1059] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:14:00.676331  3023 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:14:00.677049  3390 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.677819 28546 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:00.679004  3039 raft_consensus.cc:3055] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:00.679481  3039 raft_consensus.cc:740] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:00.685781 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:00.663982  3175 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.679490 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:00.644459  3440 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
W20260709 13:14:00.710897 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 197048us
I20260709 13:14:00.704283 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:14:00.715859 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 213719us
I20260709 13:14:00.722985 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:00.727663 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:00.733879 28576 raft_consensus.cc:1240] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:00.742096  3412 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.743247  3357 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.744097  3357 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.745334  3424 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:00.747387  3357 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.755566 28655 raft_consensus.cc:2468] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:14:00.701345  3097 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:14:00.672842  3286 consensus_queue.cc:237] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.760582 28728 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:00.708042  3175 consensus_queue.cc:1059] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:14:00.759217 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:00.758607  3433 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:00.713559  3413 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:14:00.759855  3398 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:00.772882 28722 raft_consensus.cc:1240] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:00.759024  3440 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:00.780403 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 101033us
I20260709 13:14:00.780670  3325 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.781359  3440 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:00.783815  3440 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.781718  3405 raft_consensus.cc:2804] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:00.785135 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:00.785676 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:14:00.790947  3447 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:14:00.772912  3164 consensus_queue.cc:1059] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
W20260709 13:14:00.772966  3445 log.cc:927] Time spent T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:14:00.791353 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:00.788465 28647 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:14:00.777153 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:00.783815 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:00.796674  3321 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:00.799988 28577 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:14:00.801741 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:00.806174 28725 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:14:00.810102 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:00.810889 29253 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:00.811065 29256 raft_consensus.cc:1275] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:14:00.812212  2973 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.812857  2973 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.813688 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:00.814610 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:00.813719 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:00.815209  2973 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:00.815467 29257 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:14:00.808140 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:00.797430  3321 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.817910 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:00.818570 29251 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:14:00.818614 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:00.819609  2972 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.807446 28574 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:00.794394  3039 consensus_queue.cc:260] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.821060  3039 raft_consensus.cc:3060] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:00.821475  3174 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:00.822256 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:00.798038  3412 raft_consensus.cc:3055] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:00.824221  3412 raft_consensus.cc:740] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:00.808336  3405 raft_consensus.cc:697] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:00.825814  3412 consensus_queue.cc:260] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.827162  3405 consensus_queue.cc:237] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.827907  3412 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:00.825806 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:00.790982  3416 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:00.831820  3416 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:00.832005 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:00.831328  3023 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:00.816227 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 95405.3us
I20260709 13:14:00.816890 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:00.820390  2972 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:00.859419 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 75753.7us
I20260709 13:14:00.819373  3321 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:00.861752 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 62771.4us
I20260709 13:14:00.773799  3432 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.831470  3398 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:00.859858  3174 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:00.856980  3390 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:00.897511 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:00.864262  3357 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:00.904055 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:00.894270 28728 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:00.906756 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:00.856763  3097 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:14:00.794173  3325 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.833276  3416 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.900826  3174 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.918604 28578 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:14:00.914508 28724 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:14:00.919528 28724 pending_rounds.cc:85] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 15
W20260709 13:14:00.914897 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 96417.3us
I20260709 13:14:00.919436 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:00.921691 28621 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:00.925084 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:14:00.925966 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 94134.1us
I20260709 13:14:00.926280 29258 raft_consensus.cc:1240] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:14:00.929401 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.932756 28728 raft_consensus.cc:1240] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:00.919070 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:00.937575 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:00.919855 28724 pending_rounds.cc:107] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:14:00.939708 28724 raft_consensus.cc:2889] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:00.939443 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:00.943688 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.918700  3174 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:00.954186  3241 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:00.954727  3241 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:00.955631  3241 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:00.957934 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 118404us
I20260709 13:14:00.958329  3432 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:00.958012  3097 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:00.958861 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:00.959093  3097 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:00.959589  3097 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:00.920241  3238 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:00.912652  3109 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:00.956171 28649 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:14:00.966368 29253 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
W20260709 13:14:00.970431 29223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.937577  3461 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:00.979322 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 77795.1us
W20260709 13:14:00.981616 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 62786.1us
I20260709 13:14:00.971467  3241 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:00.966676  3413 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:00.973131  3432 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:14:01.000504 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 130774us
I20260709 13:14:01.001525 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:00.986611  3175 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:01.007649 29252 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 21. Current term is 22. Ops: []
W20260709 13:14:01.002624  3451 log.cc:927] Time spent T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.124s	user 0.001s	sys 0.006s
I20260709 13:14:00.996430  3413 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:01.007592  3044 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:01.013478  3433 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:01.013659  3044 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:01.013962  3433 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:01.014115  3044 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:01.016106 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:01.017333 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:01.005272  3175 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:01.026353  3175 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:01.009616  2972 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:01.019658  3413 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:01.040366 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:01.043362 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:01.049299 29257 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:14:01.033336  3325 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:01.047719 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:01.053210 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:01.044636  3432 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.057206 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:01.060786 28727 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 22: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:01.056090  3431 consensus_queue.cc:1048] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
W20260709 13:14:01.063242 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 59577.4us
I20260709 13:14:01.065171 28621 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:01.073242  3164 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:01.074353  3097 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.075274  3170 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:01.076064  3432 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:01.077313 28724 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:01.079806  3431 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:14:01.084898  3463 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:14:01.087905 28472 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 279) took 32563 ms (client timeout 15000 ms). Trace:
I20260709 13:14:01.085130  3439 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:01.089183  3439 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:01.090272  3429 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:01.090623 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:01.090240  3439 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.091958  3439 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:01.092177 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:14:01.072844  3378 log.cc:927] Time spent T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.246s	user 0.000s	sys 0.002s
I20260709 13:14:01.080616  3431 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.088531 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:01.099444 28579 raft_consensus.cc:1275] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:14:01.108385 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:01.109814 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:01.088558  3440 raft_consensus.cc:3055] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:01.113730 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:01.111800 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:01.114868 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:01.124743  3350 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:14:01.129063 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 80101.5us
I20260709 13:14:01.129616 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:01.131914 28649 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:14:01.131433 28581 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 25 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 24. Current term is 25. Ops: []
W20260709 13:14:01.126441 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 89237us
I20260709 13:14:01.112051  3440 raft_consensus.cc:740] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:01.131402 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:01.134105 28545 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:01.141829 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:01.142822 28577 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:14:01.144527 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:01.122326  3461 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:01.152148 28580 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:14:01.154922  3348 consensus_queue.cc:1059] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:14:01.155846  3459 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:14:01.156088 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:01.156605 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:14:01.157053  3462 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:14:01.158295 28574 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:01.156826 28648 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 12.
I20260709 13:14:01.160470 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:01.161911 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:01.157882  3440 consensus_queue.cc:260] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.168920  3440 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:01.185056 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:01.191800 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c48009ac1c494fac1b2eb14ee5e90e" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:01.175961 28471 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 12 to 14, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 14 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:01.191219 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:01.134584  3044 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:01.197889 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 109520us
I20260709 13:14:01.194449  3461 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
W20260709 13:14:01.211017 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 83285.9us
I20260709 13:14:01.195197  3429 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:01.199170  3348 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:01.218109  3047 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:01.218438  3348 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.205565  3097 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.217116 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:01.231102 28574 raft_consensus.cc:2468] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 22.
I20260709 13:14:01.243664 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:01.237820  3432 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:01.244805 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:01.219295  3384 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:14:01.253643 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:01.258193 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.262094 28727 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:14:01.263512  3431 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.264495  3241 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:01.265923 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
W20260709 13:14:01.268791  3458 log.cc:927] Time spent T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.243s	user 0.004s	sys 0.000s
I20260709 13:14:01.273865  2972 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:01.243291 28471 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:01.268944  3174 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:01.278024 28471 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:01.267565 28621 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:01.279474 28648 raft_consensus.cc:2368] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20.
I20260709 13:14:01.247742  3097 consensus_queue.cc:1059] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:14:01.286583  3238 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:01.287027  3238 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:01.287382  3238 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:01.288918  2905 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:01.289482  2905 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:01.289919  2905 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:01.262149  3460 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.294396  3460 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.295506  3047 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:01.295739 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:01.295974  3047 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:01.296717  3460 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:01.297274 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 53662.9us
I20260709 13:14:01.311550  3424 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:01.314116  3348 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.314965  3390 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:01.316211  3416 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:01.305663  3405 consensus_queue.cc:1059] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:14:01.296931  3047 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.318120  3405 raft_consensus.cc:3055] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:01.318506  3405 raft_consensus.cc:740] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:01.319201  2905 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.319432  3405 consensus_queue.cc:260] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.322568  3424 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:01.323252  3379 consensus_queue.cc:1059] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:01.324364 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:01.322897  3109 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:01.325269  3317 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:01.321663  2905 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.325901  3317 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:01.326546  3317 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:01.327171  3286 raft_consensus.cc:3055] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:01.327538  3047 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:01.327684  3286 raft_consensus.cc:740] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:01.329089  3424 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:01.328852  3286 consensus_queue.cc:260] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.330307 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:01.331482 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:01.333081 29259 raft_consensus.cc:1240] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:01.325205  3357 raft_consensus.cc:3055] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:01.335089  3357 raft_consensus.cc:740] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:01.336050  3357 consensus_queue.cc:260] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.337693  3044 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:01.338649  3286 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:01.329630  3424 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.339004  3317 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.341361  3424 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:01.343504  3312 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: Time spent flushing consensus metadata: real 0.780s	user 0.005s	sys 0.006s
I20260709 13:14:01.345890  3174 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:01.346937 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:14:01.088526 28472 rpcz_store.cc:269] 0709 13:13:28.474448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.474859 (+   411us) service_pool.cc:224] Handling call
0709 13:13:28.956122 (+481263us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5400230690. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf20b2 00007f4a2dc6ba89 00007f4a2dc03da6 00007f4a2dbd5088 00007f4a2dcd337e 00007f4a2c1942a4 00007f4a2c194232 00007f4a2c194161 00007f4a2c1940dc
0709 13:14:01.024857 (+32068735us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:52.538719 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:52.539701 (+   982us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:52.539760 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:13:52.539812 (+    52us) tablet.cc:662] Decoding operations
0709 13:13:52.645092 (+105280us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:52.645201 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:52.645247 (+    46us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:13:52.822495 (+177248us) tablet.cc:701] Row locks acquired
0709 13:13:52.822549 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:13:52.822732 (+   183us) write_op.cc:270] Start()
0709 13:13:52.822885 (+   153us) write_op.cc:276] Timestamp: P: 1783602832822677 usec, L: 0
0709 13:13:52.822912 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:13:52.858051 (+ 35139us) log.cc:844] Serialized 10406 byte log entry
0709 13:13:53.381430 (+523379us) op_driver.cc:464] REPLICATION: finished
0709 13:13:53.905440 (+524010us) write_op.cc:301] APPLY: starting
0709 13:13:53.913073 (+  7633us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:54.665985 (+752912us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:54.666128 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:54.963708 (+297580us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:54.964124 (+   416us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:13:54.964189 (+    65us) write_op.cc:312] APPLY: finished
0709 13:13:54.964744 (+   555us) log.cc:844] Serialized 236 byte log entry
0709 13:13:55.092254 (+127510us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:55.092541 (+   287us) write_op.cc:454] Released schema lock
0709 13:13:55.092630 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:55.098204 (+  5574us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:55.098251 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16876,"reported_tablets":44,"spinlock_wait_cycles":28791552,"child_traces":[["op",{"apply.queue_time_us":481886,"apply.run_cpu_time_us":57033,"apply.run_wall_time_us":1212519,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116933,"num_ops":27,"prepare.queue_time_us":219198,"prepare.run_cpu_time_us":39287,"prepare.run_wall_time_us":465552,"raft.queue_time_us":241473,"raft.run_cpu_time_us":17404,"raft.run_wall_time_us":320251,"replication_time_us":558333,"thread_start_us":748832,"threads_started":5,"wal-append.queue_time_us":542628,"wal-append.run_cpu_time_us":69240,"wal-append.run_wall_time_us":2254882}]]}
I20260709 13:14:01.347891  3109 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:01.348289 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:01.349061  2972 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:01.349607  2972 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.350097  2972 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:01.355499 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 98096.2us
I20260709 13:14:01.356154 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:01.320886  3405 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:01.371181 29257 raft_consensus.cc:2393] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 20: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:01.374002 28656 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:14:01.344637  3317 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:01.388772 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:01.389393 28727 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:01.390422 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:01.390607 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:01.344152  3312 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:01.393326 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 176338us
I20260709 13:14:01.392307 29224 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:01.398882 28580 raft_consensus.cc:1275] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:14:01.399302 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:01.370703  3321 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:01.401834 28729 raft_consensus.cc:1240] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 16. Current term is 17. Ops: []
W20260709 13:14:01.387531  3465 log.cc:927] Time spent T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:14:01.402748 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:01.407032 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:01.411094 28723 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:01.415182 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:01.415934 28726 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:01.416584  3164 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:01.417240  3164 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.418107 29257 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 21.
I20260709 13:14:01.419175  3350 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:01.419592  3164 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.420218  3164 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:01.421098 28722 raft_consensus.cc:1240] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:01.382766  3170 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:14:01.397993  3241 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:01.429425  3241 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.431735  3241 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.443435 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:01.444831 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:01.357199  3433 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.441908  2973 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:01.452176 28726 raft_consensus.cc:2468] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:14:01.420748  3164 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:01.458900 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:14:01.462404 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49848.9us
I20260709 13:14:01.465183 29251 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:01.458459 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:01.428694  3413 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.470531 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:01.472963 28574 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:01.455364  3023 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:01.479241 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:01.456286  3357 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:01.451439  3461 raft_consensus.cc:3055] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:14:01.488922 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 96707.5us
I20260709 13:14:01.491199 29224 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:14:01.496173 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 82196us
I20260709 13:14:01.497182 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:01.460640  3170 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:01.487512  3039 consensus_meta.cc:287] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.001s
I20260709 13:14:01.512135 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:01.477424  3097 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.514642 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:01.488276  3461 raft_consensus.cc:740] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:01.528788 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:01.475472  3175 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.503294  3348 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:01.543066  3097 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.511982  3321 raft_consensus.cc:2804] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:01.509824  3350 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:01.518160  3429 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:14:01.551129 28723 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:14:01.541029  3023 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:01.562948  3023 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.563367  3023 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:01.564244  3044 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:01.541893  3039 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:01.558907 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:01.560637 28651 raft_consensus.cc:1240] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:01.541781  3348 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:01.514192  3170 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:01.534680  2973 consensus_queue.cc:1048] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:14:01.580622  3238 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:01.589586  3238 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:01.599383 28578 raft_consensus.cc:1275] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:14:01.616972 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 102400us
I20260709 13:14:01.574977  3044 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:01.577896  3348 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:01.507876 28471 catalog_manager.cc:5697] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:01.556589  3350 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.614990  3312 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.614926  3432 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:01.580200  3039 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.698431 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:01.725844 28471 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:01.729485 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:01.730257 28656 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:14:01.730341 28471 catalog_manager.cc:5697] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 4 to 15. New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:01.733300 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:01.736179  3350 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.738932  3473 consensus_queue.cc:1059] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:01.739755  3175 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.576189  3461 consensus_queue.cc:260] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.743124 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:01.698149  3321 raft_consensus.cc:697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:01.743883 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:01.754364 28722 raft_consensus.cc:2393] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 22: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:01.757264 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:01.757423 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:01.758169 28721 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:14:01.759402 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:01.760262 28723 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:14:01.761294 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46905.8us
I20260709 13:14:01.766928 28726 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 23.
I20260709 13:14:01.638269  3109 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.090s
I20260709 13:14:01.719170  3433 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.768004 29223 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:01.770159 28727 raft_consensus.cc:2468] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 22.
I20260709 13:14:01.770478 29253 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:14:01.740855  3350 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:01.762717  3047 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:01.775051  3321 consensus_queue.cc:237] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.784521  3475 consensus_queue.cc:1059] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:14:01.779254  3044 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.762854  3413 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.789742  3109 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:01.790266  3109 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:01.791193  3109 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.792554  3109 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:01.776592  3350 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:01.793447  3350 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:01.807957 29254 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
W20260709 13:14:01.829934 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 50352.5us
W20260709 13:14:01.834522  3482 log.cc:927] Time spent T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 13:14:01.834671 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 66727.9us
I20260709 13:14:01.782089 28471 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:01.837402  3495 raft_consensus.cc:2804] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:01.838313  3495 raft_consensus.cc:697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:01.842094  3416 consensus_queue.cc:1059] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:01.843905 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:14:01.844848 28572 raft_consensus.cc:606] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:14:01.844985  3379 raft_consensus.cc:3055] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:01.845716  3379 raft_consensus.cc:740] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:01.846876  3379 consensus_queue.cc:260] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.819285  3439 raft_consensus.cc:3055] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:01.852234  3439 raft_consensus.cc:740] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:01.845329 28572 raft_consensus.cc:614] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:01.854899  3379 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:01.843855  3416 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:14:01.863066 29223 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:01.865957  3039 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.811364  3164 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:01.881126 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44129.6us
I20260709 13:14:01.876624  3023 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:01.909233  3023 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:01.890933  3348 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.912334  3348 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.914556  3317 consensus_queue.cc:1059] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:01.919842  3325 raft_consensus.cc:3055] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:01.920413  3325 raft_consensus.cc:740] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:01.925710  3325 consensus_queue.cc:260] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.927983  3097 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:01.935560  2973 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.936254  2973 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.939193  2973 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:01.840020 28471 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 8 to 9, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 9 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:01.942319 28471 catalog_manager.cc:5697] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:01.943733  3432 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:14:01.945371  2972 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.001s
I20260709 13:14:01.945950  2972 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.947681 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:01.965378 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:01.901870  3487 raft_consensus.cc:2804] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:14:01.973873 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 67378.9us
W20260709 13:14:01.975104 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.839756  3495 consensus_queue.cc:237] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:01.978509 28572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:14:01.979620 28572 raft_consensus.cc:606] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:01.979936 28572 raft_consensus.cc:614] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:01.983131 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 80737.4us
I20260709 13:14:01.944209 28471 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 11 to 14, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 14 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:01.975679  3398 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:02.004585  3498 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:02.004748  3357 raft_consensus.cc:3055] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:02.010134 29255 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 21.
W20260709 13:14:02.022866 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 81909.3us
I20260709 13:14:02.036451 28695 leader_election.cc:304] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:01.999454  3164 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:02.040033  3097 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:02.035817  3039 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.047479 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:02.070853 28581 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:02.047791 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.047948 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.048318 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.048408 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.025904  3357 raft_consensus.cc:740] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:02.053325 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:02.047555 28579 raft_consensus.cc:1240] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:14:02.053532  3498 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.054984 28695 leader_election.cc:400] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20.
I20260709 13:14:02.044191  3469 raft_consensus.cc:2749] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:02.008661  3398 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:02.063031  3474 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.068092  2972 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:02.064796 28575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788a727f92304a5a9926b2f15933af88"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:14:02.072206 28580 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:14:02.068397  3439 consensus_queue.cc:260] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.071753 28578 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:14:02.074946 28695 leader_election.cc:403] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:14:02.073182 28577 raft_consensus.cc:2376] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 12. Re-sending same reply.
I20260709 13:14:02.076731 28575 raft_consensus.cc:606] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:02.078899 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.077361 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:14:02.084204 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46180.8us
I20260709 13:14:02.083055 28575 raft_consensus.cc:614] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:02.081054 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 102432us
I20260709 13:14:02.086242  3286 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:02.083958  3474 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.085999  3023 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:02.093425  3023 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.093911  3474 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.072755  3097 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.095670  3023 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.077140  3398 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:02.096978  3097 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.102892  3498 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.072971  3164 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.105703  3164 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.107208  3170 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:02.118346 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:02.119254 28580 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:02.121734 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:02.135293 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46376 (request call id 2218) took 1192 ms. Trace:
I20260709 13:14:02.135900 29254 rpcz_store.cc:276] 0709 13:14:00.923202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.932202 (+  9000us) service_pool.cc:224] Handling call
0709 13:14:02.115478 (+1183276us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54006e0fd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e1a2fa 00007f4a2cddbb17 00007f4a263566d4 00007f4a26356662 00007f4a26356591 00007f4a2635650c 00007f4a263557c2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:14:02.115641 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477750784}
I20260709 13:14:02.133719 28653 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:14:02.142750 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:02.143528 28649 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:14:02.147380 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 193349us
I20260709 13:14:02.146690 28578 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 21. Current term is 22. Ops: [20.14-21.15]
I20260709 13:14:02.076016  3039 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.150101 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.092460  3357 consensus_queue.cc:260] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.115010  3487 raft_consensus.cc:697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:02.166442 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.134590  3469 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:02.169991 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:02.170233  3496 log.cc:927] Time spent T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:14:02.170814 28722 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
W20260709 13:14:02.178930 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.182018  3416 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.182476  3379 consensus_queue.cc:1048] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:02.184623 29224 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:02.190143 28730 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:02.190752 28726 raft_consensus.cc:1240] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:02.191210 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.191782 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.192487 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.193463 28721 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:14:02.193876  3508 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:02.194376  3508 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.194617 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.194717  3508 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:02.195254 28722 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:14:02.193357 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.198829  3405 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.201208  3405 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.203467  3405 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:02.203209  3350 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.205266 28576 raft_consensus.cc:1240] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:02.205356 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.206727 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.206812  3350 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:02.207311 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.208127 28572 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:14:02.214166 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:02.218319 28577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:14:02.196158  3461 raft_consensus.cc:3060] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:02.219197 28577 raft_consensus.cc:606] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:14:02.231653 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.232681 28730 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:02.233429 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:02.182556  3416 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.243218 28581 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:02.199172  3469 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.252506 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.229377  3321 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:02.260152 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:02.260651 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.212641 28649 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:14:02.264488 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:02.271983 28581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7"
dest_uuid: "178f22d83287460fb8c0db0ba2799895"
mode: GRACEFUL
new_leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:14:02.272789 28581 raft_consensus.cc:606] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:02.273396 28581 raft_consensus.cc:614] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:02.275262 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:02.256472  3321 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.278650 28580 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 13.
I20260709 13:14:02.276249 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.276886 28648 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:14:02.301941 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.279280  3321 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:02.250391  3487 consensus_queue.cc:237] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.276054  3506 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:02.305968 29254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454"
dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
mode: GRACEFUL
new_leader_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:14:02.310537 29254 raft_consensus.cc:606] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Received request to transfer leadership to TS ed517a03edd141a798f07798667c1c04
I20260709 13:14:02.310927 29254 raft_consensus.cc:614] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:02.316226  3286 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20.
I20260709 13:14:02.317909  3469 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:02.318341 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.320787 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.329373 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.328081 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.336159 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:02.328505 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.340653 28721 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:02.328868 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.342144 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:02.342607 28726 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:02.336663 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:02.331363 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.355345 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.356458  3175 consensus_queue.cc:1059] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:02.337316 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:02.320541  3506 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:02.345613 28724 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:14:02.329334 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:02.344020 28621 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:02.334640 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:02.363368 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.365747 28722 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:14:02.366904  3416 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:02.366962  3506 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.324147  3039 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.368247  3424 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:02.368649  3424 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:02.369029  3424 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:02.363889 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:02.372136  3429 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:02.372654  3429 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:02.373085  3429 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:02.373373 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.374234 28576 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:14:02.367549 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.378551 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.381110 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.382136 28723 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 22: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:02.382939 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.383963 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.365214 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:02.384742 28723 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:14:02.381201  3325 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:02.385396 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.385692 28572 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:02.386972 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.394148 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:02.387712 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:02.389916 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:02.387431 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.391184 29254 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: []
W20260709 13:14:02.390304  3516 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:14:02.394587 28696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.396286 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 52349.1us
I20260709 13:14:02.397364 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.399638 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.396522 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:02.396749 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:02.399139 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:02.399972 28578 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:02.404386 28728 raft_consensus.cc:2393] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 20: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:02.427615 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.419308 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:02.428752 29253 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:02.431061 28696 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:02.401434  3461 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:02.457234 28696 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:02.461156  3526 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:02.463559 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:02.465387  3526 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 21 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:02.465998  3530 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:02.466773  3526 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.463836  3529 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:02.469496  3529 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:02.471102  3529 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.477797 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.478623 29253 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:02.428010  3350 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:02.423851  3047 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:02.420908  3175 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:14:02.488458 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 124930us
I20260709 13:14:02.479485 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:02.397238  3398 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.455986  3461 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:02.480027  3429 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:02.485298 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 82319.4us
I20260709 13:14:02.494680 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:02.487129  3513 log.cc:927] Time spent T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.179s	user 0.000s	sys 0.005s
I20260709 13:14:02.489323 29253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.437556  3357 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:02.492345  3175 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:02.501163  3175 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:02.506866 28621 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:02.473799  3413 raft_consensus.cc:2764] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:14:02.432463  3312 consensus_queue.cc:1048] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:14:02.505177  3461 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:02.514233  3170 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:02.508690 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.525940 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:02.527222  3170 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:02.527697 28621 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:02.498723  3429 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.530743  3350 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:02.420594  3508 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:02.537271 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 73814us
I20260709 13:14:02.532541 28729 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:02.427647  3321 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.490849  3439 raft_consensus.cc:3060] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:02.554962  3047 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:14:02.556070  3097 consensus_queue.cc:1059] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:02.556655  3047 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:14:02.557307  3047 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:02.515044  3476 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:02.558528  3047 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.548102 28722 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:02.545722 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:14:02.562005 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46045.3us
I20260709 13:14:02.562489  3321 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:02.548233  3164 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:02.563637  3164 raft_consensus.cc:697] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:02.564509  3398 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:02.482179  3416 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:14:02.565965  3175 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.567619 29252 raft_consensus.cc:1240] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:14:02.568192  3175 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:02.560473  3047 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:02.571406  3474 raft_consensus.cc:3055] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:02.571872  3474 raft_consensus.cc:740] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:02.572115  3508 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:02.506291  3490 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:02.575099 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.575740 28721 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:02.553901 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:02.555172  3512 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:14:02.553040 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:02.585147  3398 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:02.585904  3097 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:02.586378  3097 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.586750  3097 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:02.587275 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.587924 29256 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 22.
I20260709 13:14:02.588788 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.589239 29259 raft_consensus.cc:2368] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:14:02.590122 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:02.564571  3164 consensus_queue.cc:237] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.590775 29256 raft_consensus.cc:2368] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:14:02.592350 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:14:02.594261 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 137113us
I20260709 13:14:02.594601 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.597054 29260 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:02.601728 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:02.602396 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.603155 28581 raft_consensus.cc:2393] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 20: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:14:02.605639 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:02.611003 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:02.617885 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.618955 29252 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:02.619940 28547 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:02.622303 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:02.623189 28576 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:02.624106 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:02.631222 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:02.626701 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.636116 29251 raft_consensus.cc:2393] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:02.637563 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:02.635327 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:02.638518 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:02.639225 28656 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 21: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:02.638972 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.645797 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:02.650990 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:02.651126 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:02.617354  3429 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:02.572762  3474 consensus_queue.cc:260] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.673897 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.683454 28729 raft_consensus.cc:2393] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 17: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:02.653156 28648 raft_consensus.cc:2393] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 21: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:14:02.686057 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 80491.6us
I20260709 13:14:02.635397  3350 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:02.686514 28650 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:14:02.689144 28655 raft_consensus.cc:1275] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:14:02.652664  3398 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.683544  3348 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:02.633034  3424 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.649839  3413 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:14:02.691658  3433 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:14:02.719514 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.717180 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:14:02.734403 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 114541us
I20260709 13:14:02.735320 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:02.744457 28576 raft_consensus.cc:2468] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
W20260709 13:14:02.681103  3170 consensus_queue.cc:1175] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ed517a03edd141a798f07798667c1c04" responder_term: 19 status { last_received { term: 19 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 19 index: 10 } }
I20260709 13:14:02.752095  3174 raft_consensus.cc:3055] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:02.752844  3174 raft_consensus.cc:740] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:02.754072  3174 consensus_queue.cc:260] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.755916  3174 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:02.708549  3484 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:14:02.760479 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 138967us
I20260709 13:14:02.693976  3350 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.761917 28621 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:14:02.766319 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 119264us
I20260709 13:14:02.767783 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:02.708052  3398 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.759654  3484 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:02.765540  3433 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:14:02.806550 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 71312.5us
I20260709 13:14:02.813943 28547 leader_election.cc:400] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:14:02.806275  3484 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:02.804272  3539 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:02.871331 28721 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:14:02.874624 29255 raft_consensus.cc:2468] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
W20260709 13:14:02.876441 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 108736us
W20260709 13:14:02.878577 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.878592 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:02.899134  3550 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:02.899850  3550 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.905755  3424 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.910140  3398 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.912377 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:02.913368  3490 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.871906  3539 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.913899  3490 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.919945  3490 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:02.919945  3539 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:02.921133 28725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33268 (request call id 2767) took 1178 ms. Trace:
I20260709 13:14:02.900792  3535 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:02.923799 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 108897us
I20260709 13:14:02.928149 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:02.945338 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:02.921629 28725 rpcz_store.cc:276] 0709 13:14:01.743004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.752252 (+  9248us) service_pool.cc:224] Handling call
0709 13:14:01.767502 (+ 15250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:01.781000 (+ 13498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.781062 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:01.783672 (+  2610us) log.cc:844] Serialized 26 byte log entry
0709 13:14:01.961748 (+178076us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18001f6ba0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:14:02.229437 (+267689us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:14:02.229487 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.229580 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:02.474126 (+244546us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:02.500432 (+ 26306us) raft_consensus.cc:1685] finished
0709 13:14:02.500455 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.920907 (+420452us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b54001b9250. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e158ad 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6 00007f4a2615026f
0709 13:14:02.921055 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8690,"raft.queue_time_us":13692,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":149,"spinlock_wait_cycles":38855552,"thread_start_us":267478,"threads_started":1,"wal-append.queue_time_us":486836}
I20260709 13:14:02.953364 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:02.957123  3536 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:14:02.958952  3536 raft_consensus.cc:2804] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:02.959729  3536 raft_consensus.cc:697] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:02.961728  3535 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:02.962301 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:02.962345  3535 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:02.921384  3484 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:02.962863  3548 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:14:02.967135 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 204459us
I20260709 13:14:02.967314  3536 consensus_queue.cc:237] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:02.972054 28729 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
W20260709 13:14:02.973707 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 95202us
I20260709 13:14:02.931437  3433 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:02.982692 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:02.998391 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.003103  3537 raft_consensus.cc:993] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: : Instructing follower ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:14:03.009941 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:03.009341 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:03.008164  3548 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.011467  3439 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:02.997810  3350 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:02.972172  3461 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.030105 28729 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:14:03.019840  3483 raft_consensus.cc:1081] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Signalling peer ed517a03edd141a798f07798667c1c04 to start an election
I20260709 13:14:03.022440  3554 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:03.014465  3170 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:03.025352  3519 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.702s	user 0.004s	sys 0.000s
I20260709 13:14:03.016142  3097 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.031550 28723 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:14:03.033303 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:03.023283  3555 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:03.032289 29223 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:03.049211 28620 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:03.055444 28721 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:14:03.020589  3476 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:03.020188  3439 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:03.059665 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.060861 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:03.065788 29251 raft_consensus.cc:2393] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:03.063522 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:03.071780 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.028234  3548 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.094480 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:02.995834  3535 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.118006  3552 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:03.088694  3546 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:03.088254  3550 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.118801  3097 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.120715  3479 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:03.121201  3479 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.121544  3479 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:03.048193  3350 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:14:03.125257  3484 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.125473  3461 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.127429  3483 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:03.064654  3508 raft_consensus.cc:2804] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:03.066898  3439 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:03.061089  3558 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:03.135561 29251 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:14:03.137835 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:03.053156  3554 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.166699 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:03.168505 28655 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:14:03.167596 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:03.171923 28648 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:03.163828 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:14:03.173586 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 101910us
I20260709 13:14:03.174513 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.098063  3560 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:03.105507  3413 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:03.046288  3499 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:03.179757 28650 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:14:03.072369 29259 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:03.182911 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:03.184795 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:03.188807 28651 raft_consensus.cc:3060] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:14:03.134786  3558 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:03.136785  3551 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:03.109848  3511 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:14:03.165323  3508 raft_consensus.cc:697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:03.224970 28650 raft_consensus.cc:1275] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:14:03.225561 28650 pending_rounds.cc:85] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 14
I20260709 13:14:03.225862 28650 pending_rounds.cc:107] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:14:03.226158 28650 raft_consensus.cc:2889] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:03.232044 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 137622us
I20260709 13:14:03.179518  3413 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:03.235154 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 50424.8us
I20260709 13:14:03.236434 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:03.237824 28580 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:03.097198  3433 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.239616 28649 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:14:03.134469  3546 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.190735  3536 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:03.245370 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.241348 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:03.246354 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.253206 28647 raft_consensus.cc:1275] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:14:03.222293  3558 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:03.254932 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:03.263170 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:03.259577 28547 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.289721 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.134327  3483 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:03.357426 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.240026  3413 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:03.295063 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 49839.2us
I20260709 13:14:03.296816 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:03.353390 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:14:03.367527 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 108047us
I20260709 13:14:03.354305 28580 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:03.297931 28579 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:03.188979  3499 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:03.363996 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 91392.3us
I20260709 13:14:03.248370  3461 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:03.259274 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:03.235642  3348 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:14:03.377345 28723 raft_consensus.cc:2393] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 22: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:14:03.373605 28619 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.254081  3286 consensus_queue.cc:1059] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:14:03.379006 28580 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:03.184469  3560 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.381875  3490 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.383176  3424 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.392238 28580 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:14:03.398478 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 158779us
I20260709 13:14:03.400352 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.260078  3551 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.134s
I20260709 13:14:03.287732  3398 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:03.287853  3312 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:03.297611  3174 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:03.291436  3039 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:03.305517 28727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a"
dest_uuid: "ed517a03edd141a798f07798667c1c04"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:14:03.473616 28727 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.474133 28727 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:03.390535 28621 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
W20260709 13:14:03.477641 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 87222.4us
I20260709 13:14:03.238363  3557 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:03.385128  3023 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:03.413401 28578 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:14:03.374154  3536 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:03.380295  3461 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:03.465386 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:03.379144  3568 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:03.410876  3562 log.cc:927] Time spent T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:14:03.494148  3174 raft_consensus.cc:2804] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:03.487653  3039 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.552948  3174 raft_consensus.cc:697] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:03.553911  3174 consensus_queue.cc:237] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.554462  3039 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.473152  3312 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.487811  3557 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:03.557328  3557 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:03.558744  3312 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.560071 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.560714 29258 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 15.
I20260709 13:14:03.473140  3398 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.470304  3556 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:03.563109  3398 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:03.490790  3023 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:14:03.509074 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 108738us
W20260709 13:14:03.509182 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 122921us
I20260709 13:14:03.509968 28651 raft_consensus.cc:2468] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:14:03.414390  3424 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.517518  3560 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.521520  3554 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.522791  3546 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.411633  3490 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.478596  3551 consensus_queue.cc:1243] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:14:03.521534  3561 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:14:03.494086 28727 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.472299  3508 consensus_queue.cc:237] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.574447 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.569101 28622 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.582123 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:03.582139 28574 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:03.564743  3461 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:03.584395 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:03.591997 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:03.572197 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:03.605593 28656 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:03.608850 28727 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:03.615149 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 50014.1us
I20260709 13:14:03.615341 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:03.616061 28577 raft_consensus.cc:3055] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:03.623008 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:03.616474 28577 raft_consensus.cc:740] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:03.626353 28648 raft_consensus.cc:2468] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
W20260709 13:14:03.628940 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 60000.6us
I20260709 13:14:03.630369 28622 leader_election.cc:400] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:14:03.630774 28622 leader_election.cc:403] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:03.631933 28622 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:03.636271  3536 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:03.637233  3536 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:14:03.590566  3548 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.642294 28648 raft_consensus.cc:1240] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:03.641088 28656 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:03.643718 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.644544 29257 raft_consensus.cc:2393] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 19: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:14:03.638129 28577 consensus_queue.cc:260] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.613036  3569 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.646720 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.649710 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:03.639355  3555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.005s	sys 0.000s
I20260709 13:14:03.652765 28722 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:03.651331 29257 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:14:03.654789 28728 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:03.656536 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:03.658339 29252 raft_consensus.cc:3060] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:03.659772 28656 raft_consensus.cc:1240] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:03.660554 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.661439 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:03.661363 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:03.671581 28654 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:14:03.677784  3527 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:03.678404  3527 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.680543  3527 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.682013  3490 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:03.685068 29252 raft_consensus.cc:2468] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:03.687963  3413 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.689801 28651 raft_consensus.cc:1240] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 19. Current term is 20. Ops: []
W20260709 13:14:03.663106  3555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.005s	sys 0.000s
I20260709 13:14:03.700971 28695 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:03.702242 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:03.699079 28696 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:03.669158  3536 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.708340 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:03.716828 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.655648  3569 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.672886  3175 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:03.718464 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:03.719049 28650 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:03.613314  3023 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.664798  3584 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.658691  3439 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.721783 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:03.695542  3555 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:03.705375  3560 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.707775  3286 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:03.706084  3312 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:03.708165  3499 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.752094 29259 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 22.
I20260709 13:14:03.727098  3175 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.757313  3559 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.757841  3528 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:03.774770 29252 raft_consensus.cc:1217] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Deduplicated request from leader. Original: 17.14->[18.15-18.15]   Dedup: 18.15->[]
I20260709 13:14:03.775691 29252 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:14:03.758303  3575 raft_consensus.cc:2804] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:03.762194 28651 raft_consensus.cc:2393] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 22: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
W20260709 13:14:03.735462  3479 consensus_meta.cc:287] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
W20260709 13:14:03.767131 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49266.2us
I20260709 13:14:03.736603  3398 raft_consensus.cc:493] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.723453  3536 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.770171  3175 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:03.773152  3548 raft_consensus.cc:493] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.782519 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:03.800302 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:14:03.779130 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 115136us
I20260709 13:14:03.795187 28579 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:14:03.802532  3508 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:03.802902  3357 consensus_queue.cc:1048] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:03.734606  3584 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.753804  3560 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.762775  3557 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.837392  3538 raft_consensus.cc:3055] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:03.838002  3538 raft_consensus.cc:740] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:03.811630 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:03.813652  3528 consensus_queue.cc:1048] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:14:03.807013  3312 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:03.816419 28546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.013s	sys 0.021s
I20260709 13:14:03.820350  3474 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:03.834028  3286 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:03.833154  3023 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:03.771862  3164 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:14:03.789758  3424 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.770730  3559 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.858450  3570 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:14:03.790412  3575 raft_consensus.cc:697] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:03.860739  3575 consensus_queue.cc:237] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:03.843605 28546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.014s	sys 0.022s
I20260709 13:14:03.864449  3432 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:03.792338  3398 raft_consensus.cc:515] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.866264 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:03.867208  3398 leader_election.cc:290] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:03.867444  3574 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.228s	user 0.003s	sys 0.000s
I20260709 13:14:03.870920  3350 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:03.871392  3350 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:03.871809  3350 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:03.877947  3569 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.879781  3556 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:03.825193  3470 raft_consensus.cc:3055] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:14:03.846253 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 216307us
I20260709 13:14:03.880740  3470 raft_consensus.cc:740] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:03.881858  3584 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.882359  3483 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.883874  3536 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.810626  3174 consensus_queue.cc:1059] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:14:03.885138 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:03.885334  3174 consensus_queue.cc:1243] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:14:03.885706  3584 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:03.886256  3584 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.887341 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.884661 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:03.889035 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.889673  3584 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.881758  3470 consensus_queue.cc:260] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.892122  3470 raft_consensus.cc:3060] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:03.890583  3559 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.895490  3439 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.896598  3413 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.787371  3479 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:03.904225 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.904731 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.904770 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:03.905769 29254 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:03.904548  3429 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:03.910567  3557 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.912422  3560 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.916838  3479 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.811880  3548 raft_consensus.cc:515] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.919658  3548 leader_election.cc:290] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:03.919731  3550 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:03.920032 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.925868 28547 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:03.930523 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.932205 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.932452 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.932962 29259 raft_consensus.cc:2393] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:03.932988 29260 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 24.
I20260709 13:14:03.934250 29257 raft_consensus.cc:2368] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
W20260709 13:14:03.935011  3574 log.cc:927] Time spent T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:14:03.935263 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:03.935686 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:03.922012  3558 consensus_meta.cc:287] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.001s
I20260709 13:14:03.945427  3558 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.946692 28653 raft_consensus.cc:1240] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:03.947889  3558 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:03.963433  3483 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:03.963534  3538 consensus_queue.cc:260] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.854979  3555 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.964205  3483 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 22 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:03.966645  3538 raft_consensus.cc:3060] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:03.967281  3483 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.973658  3568 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:03.977732 29254 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 22.
I20260709 13:14:03.920397  3550 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:03.979218 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:03.980538 28622 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:03.986801 28547 leader_election.cc:400] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
I20260709 13:14:03.987283 28547 leader_election.cc:403] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:03.921208  3535 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:03.974486  3461 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:03.998238  3424 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:14:03.996045  3568 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:14:03.996451  3535 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:14:04.019726 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.000003  3474 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:14:04.020382 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.021620 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 210180us
I20260709 13:14:04.025286 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.031455 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:04.033632 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:04.019871  3568 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.034680 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.035486 28580 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:14:04.036675 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.023707  3535 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:04.019322  3548 raft_consensus.cc:493] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:04.022776  3560 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:04.045262 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 241681us
I20260709 13:14:04.028164  3312 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:04.043538 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:04.042673 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:04.045122 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.048169 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.048436 28721 raft_consensus.cc:2393] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:04.048799 28729 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 25.
I20260709 13:14:04.029728  3474 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:04.042932 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.038825  3568 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:14:04.048777 29224 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:04.054332  3479 raft_consensus.cc:2804] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:04.054873  3479 raft_consensus.cc:697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:04.055047  3461 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.045197  3543 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:04.055761  3350 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.056514  3543 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:04.057361 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.058215  3350 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.058705 28576 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 15.
I20260709 13:14:04.051976  3560 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.058913  3474 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.051563  3597 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:04.060508 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.038434  3527 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:14:04.056921  3543 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.060982  3560 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.069195  3044 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.069763  3044 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.070536 29252 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:04.070735 28653 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 3063) took 1003 ms. Trace:
I20260709 13:14:04.071089 28653 rpcz_store.cc:276] 0709 13:14:03.067493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.067835 (+   342us) service_pool.cc:224] Handling call
0709 13:14:03.068271 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:03.947208 (+878937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.070479 (+123271us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400259254. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:14:04.070657 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019506432}
I20260709 13:14:04.072059  3044 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.073115  3595 consensus_queue.cc:1059] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:14:04.073632  3580 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.440s	user 0.003s	sys 0.000s
I20260709 13:14:04.073884 28577 raft_consensus.cc:3060] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:04.074417  3595 raft_consensus.cc:3055] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:04.074815  3595 raft_consensus.cc:740] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:04.075631  3595 consensus_queue.cc:260] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.050752  3548 raft_consensus.cc:515] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.061147 28726 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:14:04.078894 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:04.079331  3548 leader_election.cc:290] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.061782 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.081646 28730 raft_consensus.cc:3060] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:04.081678  3527 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:04.084537  3527 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:04.061483 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.086269 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:04.087373 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:04.088799 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 45954.7us
I20260709 13:14:04.065251 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:04.090034 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.090551 29255 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:04.091744 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.094331 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.095211 28729 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:14:04.096978 29257 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:14:04.102839 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.104055 28653 raft_consensus.cc:1240] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
W20260709 13:14:04.064512  3576 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.430s	user 0.001s	sys 0.003s
I20260709 13:14:04.113229 28724 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:04.114575  3528 consensus_queue.cc:1059] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:04.050415  3490 consensus_queue.cc:1048] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 13:14:04.096899  3413 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:04.099735  3538 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:04.073915  3550 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.109303  3598 consensus_queue.cc:1059] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:04.062527  3584 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:04.107465 28730 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:14:04.117810 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.130465 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.132051 28578 raft_consensus.cc:1240] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:04.136065 28580 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:14:04.110726  3595 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:04.137081 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 47957.7us
I20260709 13:14:04.110026  3350 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:04.102273  3558 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:04.136380 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.147313 28650 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:04.143512 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de05bba072764f32aeb479edb07a9d4b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.062150  3175 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.055821  3479 consensus_queue.cc:237] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.162737  3175 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.144044 28652 raft_consensus.cc:1275] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:14:04.144215 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.114259  3597 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:04.150189 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.172856 28653 raft_consensus.cc:2393] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:04.168339  3543 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.146394 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:04.151638  3581 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:14:04.174326 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:04.174930 29257 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:04.176733 28648 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 20: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:04.158128 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.177404 28649 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:14:04.110116  3461 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:14:04.183926 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:04.187068 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.188005 28580 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:14:04.192112 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.196306 28572 raft_consensus.cc:1240] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:04.150887  3558 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.194914  3325 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:14:04.134369  3470 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:14:04.202430 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.203038 28576 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:14:04.198151 29223 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:04.182245  3557 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.251696 28649 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:14:04.185518  3357 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:14:04.260208 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 55344.8us
I20260709 13:14:04.113219  3527 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.275740 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:04.281620  3381 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260709 13:14:04.274326  3557 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.286021 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.287190 28654 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:04.287506  3557 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.288554 28653 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:04.288913  3539 consensus_queue.cc:1059] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:04.289994 28655 raft_consensus.cc:1240] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:04.290053  3539 consensus_queue.cc:1059] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:04.291236  3483 raft_consensus.cc:3060] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:04.199617  3321 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:04.293243  3321 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.293673  3321 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.293884 28572 raft_consensus.cc:1275] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:14:04.295091 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:04.296795 28578 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:04.297331  3555 raft_consensus.cc:3055] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:04.297652 28581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1793) took 1240 ms. Trace:
I20260709 13:14:04.297713  3555 raft_consensus.cc:740] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:04.298687  3555 consensus_queue.cc:260] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.298131 28581 rpcz_store.cc:276] 0709 13:14:03.057580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.057735 (+   155us) service_pool.cc:224] Handling call
0709 13:14:03.058117 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:03.087823 (+ 29706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:03.087868 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:03.088561 (+   693us) log.cc:844] Serialized 52 byte log entry
0709 13:14:03.583854 (+495293us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:14:03.583892 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.583957 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.063910 (+479953us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:04.277127 (+213217us) raft_consensus.cc:1685] finished
0709 13:14:04.277161 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.297413 (+ 20252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58190,"raft.queue_time_us":35557,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":17177,"spinlock_wait_cycles":18593536,"thread_start_us":494889,"threads_started":1,"wal-append.queue_time_us":545465}
I20260709 13:14:04.278069  3357 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.300020  3555 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.300200  3357 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.291254  3539 raft_consensus.cc:3055] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:04.301522  3539 raft_consensus.cc:740] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:04.301797 28577 raft_consensus.cc:2468] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 22.
I20260709 13:14:04.302222  3529 raft_consensus.cc:3055] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:04.302431  3539 consensus_queue.cc:260] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.303371  3432 raft_consensus.cc:3055] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:04.303772  3432 raft_consensus.cc:740] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:04.304061  3539 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:04.306176  3601 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:14:04.304620  3432 consensus_queue.cc:260] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.277812  3508 raft_consensus.cc:2804] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:04.307983  3568 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.310521  3568 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 26 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.312196 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:04.307312  3432 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.302583  3529 raft_consensus.cc:740] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:04.148844  3584 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.171414  3350 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.312976 28648 raft_consensus.cc:2368] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
I20260709 13:14:04.314901 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:04.358738 29255 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 24 FOLLOWER]: Advancing to term 26
W20260709 13:14:04.358946 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.315435 28574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.360221 28574 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:14:04.315511 29252 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:14:04.329437 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:04.322338 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:04.327109 28546 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.330552 29257 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:14:04.364398 28622 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:04.343065 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.254913  3597 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:04.366993 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:04.320741  3321 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.345468  3557 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.372243 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:04.204706  3558 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:04.365576 28577 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 13.
I20260709 13:14:04.343137  3529 consensus_queue.cc:260] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.347375  3543 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.369511 28579 raft_consensus.cc:3060] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:04.377781 29258 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:04.317293  3596 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.382094 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:04.364748  3577 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:04.393688 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:04.388283 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:14:04.387506 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 204159us
I20260709 13:14:04.367005  3508 raft_consensus.cc:697] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:04.369184  3548 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.414896  3548 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:04.421298  3600 log.cc:927] Time spent T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:14:04.426368  3321 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.376255  3476 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:14:04.409309  3424 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
I20260709 13:14:04.429919  3508 consensus_queue.cc:237] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.368145  3175 consensus_queue.cc:1048] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:14:04.377422  3597 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.394198  3596 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:04.433797 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.435393  3597 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:04.435479  3596 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.367736  3483 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:04.376612  3560 raft_consensus.cc:2804] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:04.411381 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.414135  3509 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.437906 29255 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 26.
I20260709 13:14:04.432345  3357 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.444615 28546 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.401752  3174 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:04.453804 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.458292 28730 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:14:04.459962 28581 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:04.378786  3557 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.411674  3429 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.464991 28579 raft_consensus.cc:2468] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:14:04.437139  3529 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:04.473146 29255 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:04.477771 28546 leader_election.cc:400] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
I20260709 13:14:04.478219 28546 leader_election.cc:403] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:14:04.478164 28730 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 26.
I20260709 13:14:04.426374  3350 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.444234  3312 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:04.398970  3537 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:14:04.488194 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.488983 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.454746  3543 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:04.490353 28650 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:04.455675  3174 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:04.492324 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.491869 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 216370us
I20260709 13:14:04.461520  3560 raft_consensus.cc:697] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:04.510701 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.489261  3527 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:04.487787  3350 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 15. Current term is 16.
I20260709 13:14:04.512945 28576 raft_consensus.cc:2468] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:14:04.514413 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 254670us
W20260709 13:14:04.515087 28545 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.481171  3550 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:14:04.502887  3174 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.457247  3509 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.480899  3483 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:14:04.525625 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:04.509042  3548 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.529563 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.471338  3596 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:14:04.532578 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:04.536419  3044 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.540768  3584 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.545342  3357 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.499931  3535 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.522110  3476 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:14:04.562419  3605 log.cc:927] Time spent T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:14:04.571569 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.596478 28730 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:04.598278 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 65831.7us
I20260709 13:14:04.571734 28579 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:04.503736  3398 consensus_queue.cc:1059] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:14:04.582669 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.586680 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.601351 28722 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.601653 28724 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:14:04.589756 29257 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:14:04.549731  3413 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:04.594957 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.604140 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 208339us
I20260709 13:14:04.607591 28730 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:14:04.617043 28648 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:14:04.593391  3476 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.605541  3579 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:04.589917  3044 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.645951 28621 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:04.633858  3476 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:04.655037 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.655746 28579 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:04.594771  3560 consensus_queue.cc:237] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:04.662724  3608 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:14:04.670022  3509 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.672259  3577 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:04.675081 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:04.676616  3175 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:04.677026  3175 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.677371  3175 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:04.685781  3593 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:04.687762 29224 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:04.650802  3548 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:04.688938 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:04.689205  3548 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.689582  3548 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:04.689608  3555 raft_consensus.cc:3055] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:04.690166  3555 raft_consensus.cc:740] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:04.691399  3584 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:04.691813  3584 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:04.692227  3584 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.693157  3381 raft_consensus.cc:2764] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:14:04.693799 29255 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:04.695037 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:04.695643 28653 raft_consensus.cc:3060] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.688906 29223 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:04.698859  3614 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:04.699291  3614 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:04.699671  3614 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:04.701331 29223 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:04.701422 28656 raft_consensus.cc:1240] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:04.703157 28651 raft_consensus.cc:1240] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:14:04.691008  3555 consensus_queue.cc:260] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.704044 28722 raft_consensus.cc:2468] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:14:04.708675 29259 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:14:04.718978 28622 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.725610 29252 raft_consensus.cc:1275] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:04.702395 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:04.731418  3350 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:14:04.705868  3595 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.747347  3416 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:14:04.747887 28725 raft_consensus.cc:1275] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:14:04.748023 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 131506us
I20260709 13:14:04.749867 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.750358 29223 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:04.750808 28723 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:14:04.751490  3509 raft_consensus.cc:2804] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:04.751691 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.752028  3509 raft_consensus.cc:697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:04.754069 28695 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:04.729589  3557 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:04.733525  3381 raft_consensus.cc:2804] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:04.734503  3552 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:14:04.757867 28572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:04.772218 28572 raft_consensus.cc:2410] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:14:04.772763 28730 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:04.764334  3598 consensus_queue.cc:1059] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:04.783375 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:04.744354  3474 consensus_queue.cc:1048] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:14:04.770364  3044 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:04.775353 28653 raft_consensus.cc:2468] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:14:04.786461 28726 raft_consensus.cc:1217] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Deduplicated request from leader. Original: 17.14->[18.15-18.15]   Dedup: 18.15->[]
I20260709 13:14:04.731644  3579 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:14:04.798884 28726 raft_consensus.cc:1240] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:14:04.787457 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.794313  3614 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.729598  3593 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:14:04.796181 28722 raft_consensus.cc:1275] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:04.753041  3461 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:04.738703  3581 consensus_queue.cc:1048] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:14:04.804597 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.820183 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.822901  3381 raft_consensus.cc:697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:04.824505  3461 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.822960 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.738534  3553 consensus_queue.cc:1059] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:14:04.829701  3539 consensus_queue.cc:1059] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:04.758745  3483 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:14:04.838280  3509 consensus_queue.cc:237] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.898313 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.839198  3470 raft_consensus.cc:3055] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:04.745595  3550 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:14:04.904874 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:04.906733 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.757658  3595 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.819023  3429 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:04.907281 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445e2209eb343cf9d87aa63ba0becbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.761854  3479 consensus_queue.cc:1048] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.139s
I20260709 13:14:04.906736 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.917448 28723 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:14:04.911902 28725 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:04.915652 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:04.898123  3474 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.897701  3312 raft_consensus.cc:2804] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:04.919332 28653 raft_consensus.cc:1240] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 LEADER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:14:04.920403 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:04.905465  3539 consensus_queue.cc:1243] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:14:04.919917 28726 raft_consensus.cc:3055] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:04.923530 28726 raft_consensus.cc:740] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:04.922178 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:04.922811 28695 leader_election.cc:304] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:04.924381 28729 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
W20260709 13:14:04.914734  3558 consensus_meta.cc:287] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.004s
I20260709 13:14:04.925725 28723 raft_consensus.cc:1275] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:04.924280 28726 consensus_queue.cc:260] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.962133 28726 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:04.927790  3560 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:04.926693  3474 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.930748  3476 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:04.942970  3595 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.950609  3461 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.952683  3312 raft_consensus.cc:697] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 22 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:14:04.954716  3622 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:14:04.958010  3548 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.908717  3470 raft_consensus.cc:740] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:04.996850  3548 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.001516  3614 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.001655  3470 consensus_queue.cc:260] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.002936  3470 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:04.989147  3381 consensus_queue.cc:237] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.013489 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:05.013610  3555 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:04.967007  3558 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.016623  3558 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:05.017119 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.017253 28647 raft_consensus.cc:1240] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:14:05.018710  3175 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.022539 28650 raft_consensus.cc:2368] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
W20260709 13:14:04.988516 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 244521us
I20260709 13:14:04.926179  3432 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.996848  3476 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:04.997546  3461 consensus_queue.cc:1048] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:14:04.982304  3612 raft_consensus.cc:2749] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:04.998613  3312 consensus_queue.cc:237] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:04.999807 28655 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Rejecting Update request from peer d64d870625d6461b89b1fb75cd2e26e0 for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 13:14:05.018908 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
W20260709 13:14:05.029385 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 107759us
I20260709 13:14:05.033370 28726 raft_consensus.cc:1275] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:14:05.033813 28726 pending_rounds.cc:85] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Aborting all ops after (but not including) 16
I20260709 13:14:05.034056 28726 pending_rounds.cc:107] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:14:05.034278 28726 raft_consensus.cc:2889] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:04.985985 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63222.9us
I20260709 13:14:05.035069 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:05.033514 28575 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:14:05.040894 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.041988  3476 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:05.043429 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.045890 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.046113 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:05.046751 28656 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:14:05.046868 28726 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:05.047554 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:05.048270 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:05.020927  3175 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.052675 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:14:05.039783  3286 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:14:05.055163 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:05.055326 28620 leader_election.cc:304] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.055804 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:05.057425 28653 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:14:05.037547  3538 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:05.056339 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.058180 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:05.065727 28723 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:14:05.072197 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:05.051479  3560 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:05.074580 28726 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:05.046447  3552 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 26 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:05.036918  3432 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.070492  3538 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.090039  3587 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:05.108881  3552 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.090981 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:05.113236 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.056162  3593 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:14:05.094038  3602 log.cc:927] Time spent T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.419s	user 0.003s	sys 0.001s
I20260709 13:14:05.094509 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.095924  3558 consensus_queue.cc:1048] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:05.073973  3476 raft_consensus.cc:2749] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:05.097718  3433 raft_consensus.cc:3055] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:05.102963 28620 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:05.117942 28723 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:05.123126 28573 raft_consensus.cc:2393] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 20: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:14:05.149767  3640 raft_consensus.cc:2804] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:05.150411  3640 raft_consensus.cc:697] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:05.123173  3461 consensus_queue.cc:1048] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:14:05.111933  3432 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:05.151273  3640 consensus_queue.cc:237] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.153287 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a02df07d6643edb55e844cfc7fbe3e" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.125905  3613 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:05.126473  3587 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:05.120077  3433 raft_consensus.cc:740] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:05.161552 28723 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:05.162830  3381 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.181704 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:05.127027  3584 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.186542 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:05.170984  3587 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:05.188668  3474 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:05.196377  3587 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:05.211165  3174 consensus_meta.cc:287] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.002s
I20260709 13:14:05.216432  3584 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.199216  3433 consensus_queue.cc:260] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.219589  3174 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.220420  3433 raft_consensus.cc:3060] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:05.221845  3174 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.226768  3416 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:05.227355  3416 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.229712  3416 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:05.231690  3626 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.278s	user 0.003s	sys 0.000s
I20260709 13:14:05.237658 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:05.239194 28649 raft_consensus.cc:2393] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 17: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:05.240002  3584 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:05.240779  3584 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.241307 29224 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.183081  3381 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.243537  3381 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.244134  3584 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.245142  3613 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:05.204754  3538 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.247828 28647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49584 (request call id 1683) took 1132 ms. Trace:
I20260709 13:14:05.255728 29258 raft_consensus.cc:1240] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:05.257308 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.257746  3174 raft_consensus.cc:493] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:05.268348 28647 rpcz_store.cc:276] 0709 13:14:04.115301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.116483 (+  1182us) service_pool.cc:224] Handling call
0709 13:14:04.124421 (+  7938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.017631 (+893210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.247500 (+229869us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540025a654. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:14:05.247744 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052723456}
I20260709 13:14:05.285463  3461 consensus_queue.cc:1059] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:14:05.291095  3461 raft_consensus.cc:3055] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:05.291559  3461 raft_consensus.cc:740] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:05.292593  3461 consensus_queue.cc:260] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.294085  3461 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:05.295483 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 592049us
I20260709 13:14:05.300252 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.301640 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.302320 28581 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:14:05.296799 28545 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.305557  3429 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:05.307622  3587 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.310487 28724 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:05.310618  3587 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:05.314097 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:05.314872 28724 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 15: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:05.317924 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:05.320084 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.303187 28578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:05.325788 28725 raft_consensus.cc:1240] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:05.326874 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
W20260709 13:14:05.326905  3633 log.cc:927] Time spent T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 13:14:05.327497 28576 raft_consensus.cc:3060] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:05.285717  3174 raft_consensus.cc:515] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.331197  3174 leader_election.cc:290] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:05.332383 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:05.333630 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:05.335206 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:05.336099 28573 raft_consensus.cc:3060] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:05.347765 28576 raft_consensus.cc:2468] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:05.348678 28576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:05.354157 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:05.356127 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:05.356387 28577 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:14:05.357595  3651 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:05.359874 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:05.358165 28696 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:14:05.340202  3646 log.cc:927] Time spent T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:05.368355 28573 raft_consensus.cc:2468] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:05.355476  3552 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:14:05.370908  3538 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:05.371656  3398 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:05.372159  3398 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.372476  3398 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:05.373276  3579 consensus_queue.cc:1059] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:14:05.376669 28621 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.380393  3398 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.383426  3398 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:05.358722  3381 consensus_queue.cc:1059] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:14:05.387903  3535 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:05.389407  3577 raft_consensus.cc:3055] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:05.389822  3577 raft_consensus.cc:740] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:05.390709  3577 consensus_queue.cc:260] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.391956  3577 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:05.407238 29258 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:05.406951 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:05.428467 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:05.392946 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:05.443313 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.444591 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.441460 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.434983 28621 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:05.448371 28724 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:14:05.450227 28578 raft_consensus.cc:1275] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:05.453995 28575 raft_consensus.cc:3055] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:05.454495 28575 raft_consensus.cc:740] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:05.453997 28621 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:05.456812 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:05.458760 28581 raft_consensus.cc:1275] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:14:05.459159 28581 pending_rounds.cc:85] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 15
I20260709 13:14:05.459371 28581 pending_rounds.cc:107] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:14:05.459354 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:05.459797 28581 raft_consensus.cc:2889] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:05.406581  3581 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:05.465549 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.466272 28724 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:14:05.465312 28575 consensus_queue.cc:260] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.467971 28575 raft_consensus.cc:3060] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:05.469942  3461 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:14:05.471033 28621 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:05.473042  3640 raft_consensus.cc:2804] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:05.473590  3640 raft_consensus.cc:697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:05.474500  3640 consensus_queue.cc:237] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.477422 28575 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:14:05.477918 28575 pending_rounds.cc:85] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Aborting all ops after (but not including) 14
I20260709 13:14:05.478219 28575 pending_rounds.cc:107] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:14:05.478506 28575 raft_consensus.cc:2889] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:05.452536  3509 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:05.482641 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:05.483701 29254 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:05.483505 29252 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:14:05.414280  2972 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:14:05.463755  3548 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:05.481218  3552 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.480448  3433 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:05.485898  3509 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.516191 29254 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:14:05.502321  3548 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:05.517328  3325 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:05.517634  3461 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.517234  3587 consensus_queue.cc:1048] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:14:05.502792  3433 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:05.505203  3552 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.509805  3509 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:05.489490  3398 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:14:05.529428 28696 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:05.531746 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:05.479204  3581 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.530099 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.536695 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:05.541074 29255 raft_consensus.cc:1275] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:05.540728  3548 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.549369 29223 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.508801  3381 consensus_queue.cc:1048] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:14:05.550915  3312 raft_consensus.cc:2804] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:05.557879  3321 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:05.559983  3023 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:14:05.562139  3581 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:05.538923  3461 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.564646  3461 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:05.567988 28620 leader_election.cc:304] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.569175 28695 leader_election.cc:400] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
I20260709 13:14:05.569515 28695 leader_election.cc:403] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:05.520241  3584 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:14:05.538651  3433 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:05.578510 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:14:05.586187 28547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.601369 28694 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.616289 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 47336us
I20260709 13:14:05.551873  3572 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:05.619887 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.620493 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:05.620764 28730 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:14:05.623101 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0817000b219d44bc891d4c9a50a56999" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.626796 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.627692 28722 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:05.552721  3582 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:05.539283  3325 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:05.636629 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 58268.3us
I20260709 13:14:05.638695 28620 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.633322 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895"
I20260709 13:14:05.645258 28581 raft_consensus.cc:3060] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:05.646857 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:05.633812  3659 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:14:05.634716  3552 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:05.615352 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 64687.1us
I20260709 13:14:05.630824 28727 raft_consensus.cc:2393] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 18: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:05.640015 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:05.630455  3528 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 for earlier term 20. Current term is 21.
I20260709 13:14:05.614813  3175 raft_consensus.cc:2749] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:05.644454 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.664513 28575 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:14:05.588150  3398 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:05.671041  3624 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.746s	user 0.005s	sys 0.000s
I20260709 13:14:05.672256 28575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "178f22d83287460fb8c0db0ba2799895" is_pre_election: true
I20260709 13:14:05.551627  3557 consensus_queue.cc:1048] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:14:05.656363  3174 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:05.675866  3398 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:05.678328  3398 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:05.552835  3044 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:14:05.680153  3044 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:05.680580  3044 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:05.612918  3312 raft_consensus.cc:697] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:05.639904 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.684754 28722 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:14:05.647840 28725 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:14:05.639191  3286 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.667523 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:05.672402 28580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1809) took 1166 ms. Trace:
I20260709 13:14:05.687350 28580 rpcz_store.cc:276] 0709 13:14:04.506045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.506925 (+   880us) service_pool.cc:224] Handling call
0709 13:14:04.507269 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:04.526282 (+ 19013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.526328 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:04.534801 (+  8473us) log.cc:844] Serialized 26 byte log entry
0709 13:14:04.740978 (+206177us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:14:04.741045 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.001789 (+260744us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54000eddd4. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a27d7f571 00007f4a27e16e01 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2 00007f4a2615148c 00007f4a261508c6
0709 13:14:05.001841 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:05.670460 (+668619us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:05.672173 (+  1713us) raft_consensus.cc:1685] finished
0709 13:14:05.672200 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.672344 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50214,"raft.queue_time_us":6051,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":18548,"spinlock_wait_cycles":52427904,"thread_start_us":118973,"threads_started":1,"wal-append.queue_time_us":248452}
I20260709 13:14:05.642338  3538 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:05.685175 28581 raft_consensus.cc:2468] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 18.
I20260709 13:14:05.660457 28695 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:05.699275 28651 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 22.
I20260709 13:14:05.681542  3044 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.709869  3044 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Advancing to term 14
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:14:05.711377 27432 tablet_server.cc:179] TabletServer@127.26.202.1:0 shutting down...
W20260709 13:14:05.744351 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 195060us
W20260709 13:14:05.744665 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 47794.2us
I20260709 13:14:05.745328 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:05.745930 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:05.748209 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:05.754298 28620 leader_election.cc:304] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.755281 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:05.694780  3286 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.759282  3640 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:05.764096 28620 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:05.777750 28620 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:05.770006  3461 raft_consensus.cc:2749] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:05.784833  3461 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:05.785342  3461 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.785689  3461 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:05.786471  3286 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:05.788560  3286 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:05.762020  2972 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:14:05.783079 28621 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 13:14:05.789350  2972 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:05.789546  3174 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:05.789866  2972 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:05.790043  3174 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.790493  3174 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:05.760052  3499 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.798122 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:05.771936  3640 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.804378 28727 raft_consensus.cc:1275] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:14:05.806823 28730 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:14:05.788967  3286 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:05.824352  3662 log.cc:927] Time spent T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:14:05.818691  3286 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:05.806463  3640 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:05.837543 28574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1807) took 1334 ms. Trace:
I20260709 13:14:05.838045 28574 rpcz_store.cc:276] 0709 13:14:04.503410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.503577 (+   167us) service_pool.cc:224] Handling call
0709 13:14:04.503941 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:04.515391 (+ 11450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.515432 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:04.524575 (+  9143us) log.cc:844] Serialized 52 byte log entry
0709 13:14:05.423380 (+898805us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b18003b1ca0. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d0be07 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d28c02 00007f4a279b020b 00007f4a279b5d23 00007f4a279b60d1 00007f4a27dd1a0f
0709 13:14:05.502897 (+ 79517us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:05.502940 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.503009 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:05.828027 (+325018us) raft_consensus.cc:1685] finished
0709 13:14:05.828043 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.837437 (+  9394us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4617,"raft.queue_time_us":9694,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4728,"spinlock_wait_cycles":12051712,"thread_start_us":79298,"threads_started":1,"wal-append.queue_time_us":1151370}
I20260709 13:14:05.850032 28545 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:05.853607 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:05.867786 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:05.867472 29258 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:14:05.879587 28696 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:05.882573 29255 raft_consensus.cc:1240] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:05.804682  3499 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:05.884409 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 133750us
I20260709 13:14:05.764063  3312 consensus_queue.cc:237] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.895860 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:05.898820 28725 raft_consensus.cc:1275] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:05.871083  3498 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:14:05.903455 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 120396us
I20260709 13:14:05.909404 29258 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 26 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:14:05.911006 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:05.845217  3508 consensus_queue.cc:1048] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:14:05.853557  3584 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:14:05.927404 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:05.928160 29254 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:05.907266  3498 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.938966  3668 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:05.949337 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:05.883975  3461 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:05.908221  3398 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:05.966848 28652 raft_consensus.cc:1275] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:14:05.929833  3555 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:05.954373  3498 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:05.954934  3668 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.945897  3552 consensus_queue.cc:1059] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:14:06.012976  3668 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:05.983829  3398 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.018978  3429 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:06.047797  3667 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:06.053907  3667 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.049275  3429 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.070372  3461 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.077374 29255 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: []
W20260709 13:14:06.078775 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 97074.8us
I20260709 13:14:06.081769 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:06.082538 28655 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:14:06.084460 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:06.087265 28655 raft_consensus.cc:2393] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 14: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:06.083879 28546 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:06.073101  2972 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.056532  3640 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.074767  3673 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:06.132133 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 84731.9us
I20260709 13:14:06.073921  3667 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:06.091356  3528 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:06.088642  3429 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.112687  3350 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:06.142079 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:06.122152  3499 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.150537  3669 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.151260  3669 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.113907  3682 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:14:06.144332  3350 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.140285  3672 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:06.146021  3429 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.121403  3433 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.128273  3673 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.199898 29255 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
W20260709 13:14:06.200861 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 64767.5us
I20260709 13:14:06.139087  3174 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.150043  3552 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:14:06.163827  3350 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:06.201867  3509 consensus_meta.cc:287] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.001s
I20260709 13:14:06.215987 28651 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 21: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:06.164430  3672 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.167917  3429 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.225342 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:06.228971 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:06.218037  3640 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.232693  2972 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.242121 28655 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:06.248085 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:06.216251  3509 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.230329  3572 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:06.261624  3672 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:06.256832  3695 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:06.273618  3174 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Requested vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.273367  3695 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.262880  3681 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:06.266316  3433 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.276979  3681 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.278486  3429 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.278784  3695 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:06.279168  3681 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:06.281862 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:06.287009  3498 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.279625  3669 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.291013 28648 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:14:06.295006 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:06.295288 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:06.298477 28647 raft_consensus.cc:2393] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 18: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:06.296922 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:06.299743 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:06.294931 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:06.300289 28729 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:06.300750 29258 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:06.298610 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:06.301748 28653 raft_consensus.cc:2393] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 17: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:06.300541 28546 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:06.305438 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:06.306141 29252 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:06.306298 28654 raft_consensus.cc:1275] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:14:06.323791 29224 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.326293 28722 raft_consensus.cc:1275] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:14:06.327406 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:06.329634 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:06.332289 28729 raft_consensus.cc:2468] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:14:06.329026 28721 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:14:06.323794 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:06.335016 28654 raft_consensus.cc:2368] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:14:06.333765 28620 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:06.316308  3558 consensus_queue.cc:1048] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:14:06.339922  3538 consensus_queue.cc:1048] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:06.279654  3286 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.348145 29258 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:14:06.350741 29252 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:06.328529  3429 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:06.351089 28622 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:06.352696 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:06.347625  3572 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.350270  3687 raft_consensus.cc:2804] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:06.365309 28622 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:06.367630  3538 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:06.354987  3321 consensus_queue.cc:1048] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:14:06.329622  3669 consensus_queue.cc:1048] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:14:06.354224  3429 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:06.383711 28695 leader_election.cc:336] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:06.385424 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:06.387013  3681 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:06.379792  3538 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:06.388351  3476 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:06.365665  3584 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:06.390376  3538 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.391868  3476 raft_consensus.cc:697] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:06.392338  3687 raft_consensus.cc:697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:06.391992  3286 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.350659  3668 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.400235  3668 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.407214  3651 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:06.412371 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:06.412933 28722 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 21: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:06.413035 28654 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:06.393808  3429 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:06.419847  3398 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:06.378924  3572 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.423707 28654 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 23.
I20260709 13:14:06.393285  3687 consensus_queue.cc:237] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.425760 28546 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:06.407963  3651 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.414115  3668 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:06.392920  3476 consensus_queue.cc:237] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.430315  3696 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:06.424383  3350 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.441344  3696 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 23 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:06.481062  3696 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.490773  3572 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.583866 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:06.584565 28730 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 26.
I20260709 13:14:06.439347  3498 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:06.614315 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 137615us
I20260709 13:14:06.435344  3668 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.585222  3325 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:06.582904  3669 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.583349  3499 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.588944  3381 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:06.616449  3429 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:06.648340  3679 log.cc:927] Time spent T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.598s	user 0.000s	sys 0.010s
I20260709 13:14:06.649739 28728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 3230) took 1031 ms. Trace:
I20260709 13:14:06.650154 28728 rpcz_store.cc:276] 0709 13:14:05.618240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.618920 (+   680us) service_pool.cc:224] Handling call
0709 13:14:05.641914 (+ 22994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.801769 (+159855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:05.801798 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.802302 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.907664 (+105362us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:05.907709 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.909446 (+  1737us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.647702 (+738256us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:06.649449 (+  1747us) raft_consensus.cc:1685] finished
0709 13:14:06.649469 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.649678 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23788,"raft.queue_time_us":36550,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":55751552,"thread_start_us":200980,"threads_started":2,"wal-append.queue_time_us":206937}
I20260709 13:14:06.637427  3381 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.630796  3498 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:06.658408  3498 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.660604  3498 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.635483  3499 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.663691  3499 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.665886  3636 raft_consensus.cc:3055] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:06.666384  3636 raft_consensus.cc:740] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:06.667152 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:06.667245  3636 consensus_queue.cc:260] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.668660 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:06.669445 29254 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:06.670370 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:06.671221 29257 raft_consensus.cc:2393] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 21: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:06.673146  3636 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:06.636725  3708 raft_consensus.cc:493] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.676146  3708 raft_consensus.cc:515] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.680495 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:06.668035 29259 raft_consensus.cc:1240] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Rejecting Update request from peer ed517a03edd141a798f07798667c1c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:06.682512  3708 leader_election.cc:290] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.632598  3669 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.686091  3667 consensus_queue.cc:1059] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:06.686864  3381 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.657685  3651 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.688984  3669 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:06.702898 29259 raft_consensus.cc:1275] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:14:06.689559 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:06.689587 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:06.707724 28730 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:14:06.710134  3693 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.711027  3671 consensus_queue.cc:1048] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:06.691120 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:06.710964  3693 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.715219 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:06.716029 28725 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:14:06.717517 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:06.717955  3693 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.719599 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:06.720543 28730 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:14:06.765702 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:06.766855 28730 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:06.724080  3668 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.695415  3350 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:06.726051  3701 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:14:06.702417 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:06.731202 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:06.739207  3636 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:06.747027  3686 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.747900  3651 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.758526  3509 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.762054  3429 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.791989  3636 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.769043 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
W20260709 13:14:06.769663 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 383579us
I20260709 13:14:06.824041 29224 leader_election.cc:400] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:14:06.824482 29224 leader_election.cc:403] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:14:06.826376 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:06.827203 28726 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:14:06.846575  3636 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:06.770642 28729 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:06.777665 29257 raft_consensus.cc:2393] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 15: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:06.778227 28728 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 16.
I20260709 13:14:06.803231  3535 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:06.799907  3651 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.771212  3470 raft_consensus.cc:3055] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:06.787559  3579 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.795116  3350 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:06.805308  3674 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.765s	user 0.020s	sys 0.016s
I20260709 13:14:06.856642 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:06.793545  3686 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.872299  3691 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d64d870625d6461b89b1fb75cd2e26e0 for earlier term 17. Current term is 18.
I20260709 13:14:06.877784 28647 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
I20260709 13:14:06.878369 28726 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:06.880138 28725 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 23.
I20260709 13:14:06.886639  3686 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.890825 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:06.892408  3508 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:06.893460 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:06.892843  3508 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.870450  3470 raft_consensus.cc:740] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:06.908701  3470 consensus_queue.cc:260] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.909580  3651 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:06.910274  3470 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:06.870030  3535 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.913937  3508 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:06.879132  3579 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:06.926064 29257 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:14:06.880203  3350 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:06.929632 28579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1832) took 1249 ms. Trace:
I20260709 13:14:06.930254 28579 rpcz_store.cc:276] 0709 13:14:05.680231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.680373 (+   142us) service_pool.cc:224] Handling call
0709 13:14:05.680724 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.681405 (+   681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:05.681449 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.787338 (+105889us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b2c000014c8. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2670fa11 00007f4a2671f372 00007f4a27e51a01 00007f4a27e1643a 00007f4a27e1583e 00007f4a2cdda419 00007f4a26351bd4 00007f4a26351b62 00007f4a26351a91 00007f4a26351a0c 00007f4a26350cc2
0709 13:14:05.787821 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.876893 (+ 89072us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:05.876936 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.877036 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:06.804333 (+927297us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:06.929301 (+124968us) raft_consensus.cc:1685] finished
0709 13:14:06.929336 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:06.929552 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":703,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5105,"spinlock_wait_cycles":17747584,"thread_start_us":88253,"threads_started":1,"wal-append.queue_time_us":221113}
I20260709 13:14:06.933439  3555 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:06.951864 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:06.960470 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:06.961184 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:06.961769 29257 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 18: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:06.973119 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:06.984437 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:06.934983  3651 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:14:06.959939  3691 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:14:06.942586  3686 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:06.968134  3708 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:06.967628  3706 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:06.976166  3696 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:06.992493  3636 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:06.965709  3555 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.008316  3668 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.006058  3696 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.016117  3709 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.001030  3476 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:07.005071  3636 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.006609  3673 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:06.998994  3686 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:07.076467 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 181280us
I20260709 13:14:07.078434 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.003538  3708 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.004722  3706 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.048714  3636 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:07.098456 28695 consensus_peers.cc:597] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.100402  3552 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.136858  3552 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:07.138419  3677 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 1.000s	user 0.010s	sys 0.000s
I20260709 13:14:07.138540 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.139446 28725 raft_consensus.cc:2393] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in this term.
I20260709 13:14:07.101487  3639 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:07.140174  3639 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.143422  3639 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.103513  3582 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.143868 28727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44608 (request call id 2257) took 1333 ms. Trace:
W20260709 13:14:07.100999  3676 log.cc:927] Time spent T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 1.029s	user 0.011s	sys 0.005s
I20260709 13:14:07.144246  3582 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.145326 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.146613 28724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33274 (request call id 3229) took 1528 ms. Trace:
I20260709 13:14:07.146996 28724 rpcz_store.cc:276] 0709 13:14:05.617876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.618544 (+   668us) service_pool.cc:224] Handling call
0709 13:14:05.644456 (+ 25912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.815580 (+171124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:05.815623 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.816168 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.896228 (+ 80060us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:14:05.896276 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.896353 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.017864 (+1121511us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:07.146332 (+128468us) raft_consensus.cc:1685] finished
0709 13:14:07.146355 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.146554 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21372,"raft.queue_time_us":34061,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":58,"spinlock_wait_cycles":15752960,"thread_start_us":228696,"threads_started":2,"wal-append.queue_time_us":221169}
I20260709 13:14:07.149194  3696 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.150321  3706 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.139317  3552 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.102392  3433 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.151605  3433 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.012089  3668 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.147022  3582 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:07.096697  3539 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:07.153988  3433 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.154502  3539 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.144369 28727 rpcz_store.cc:276] 0709 13:14:05.810408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.810645 (+   237us) service_pool.cc:224] Handling call
0709 13:14:05.811107 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.811485 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:05.811527 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.818917 (+  7390us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.945823 (+126906us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:05.945855 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.945911 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.137860 (+1191949us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:07.143556 (+  5696us) raft_consensus.cc:1685] finished
0709 13:14:07.143581 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.143806 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101878,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":15904,"spinlock_wait_cycles":45344000,"thread_start_us":121580,"threads_started":1,"wal-append.queue_time_us":250218}
I20260709 13:14:07.155755  3691 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:07.156284  3691 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:14:07.156713  3708 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.156692  3539 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:07.159373  3684 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 1.102s	user 0.000s	sys 0.010s
I20260709 13:14:07.160688 29251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46388 (request call id 2088) took 1233 ms. Trace:
W20260709 13:14:07.161092  3685 log.cc:927] Time spent T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:07.162766  3555 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:07.136184 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 749337us
W20260709 13:14:07.131773 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 131976us
W20260709 13:14:07.169626  3710 log.cc:927] Time spent T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:14:07.170933  3579 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.172163  3350 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.174175  3686 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.175767 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:07.178942  3712 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 13:14:07.181597  3548 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:07.182261  3548 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.031334  3476 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.185379  3548 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.181598 28470 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 20, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 20 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.186105 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.191808  3668 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:07.150924  3664 log.cc:927] Time spent T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 1.079s	user 0.003s	sys 0.016s
I20260709 13:14:07.161095 29251 rpcz_store.cc:276] 0709 13:14:05.927388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:05.927601 (+   213us) service_pool.cc:224] Handling call
0709 13:14:05.928026 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:05.929459 (+  1433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:05.929502 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:05.934010 (+  4508us) log.cc:844] Serialized 26 byte log entry
0709 13:14:05.993219 (+ 59209us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:05.993264 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.993342 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:07.158704 (+1165362us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a279b186e 00007f4a279b0bb6 00007f4a279b07d8 00007f4a279ba221 00007f4a279ba1d9 00007f4a279ba169
0709 13:14:07.160384 (+  1680us) raft_consensus.cc:1685] finished
0709 13:14:07.160412 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:07.160625 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":906,"raft.queue_time_us":2613,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":18942,"spinlock_wait_cycles":36573440,"thread_start_us":53722,"threads_started":1,"wal-append.queue_time_us":106282}
I20260709 13:14:07.198779 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.132678  3535 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:07.200779 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 240325us
W20260709 13:14:07.234853 28621 consensus_peers.cc:597] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.202836 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.243718 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.243017 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.254057 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:07.254070 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 87158.1us
I20260709 13:14:07.258289 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.256946 28651 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 20.
I20260709 13:14:07.201562  3476 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.272130 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.286880 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:07.288851  3717 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.289443  3717 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.291517  3717 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.291983  3717 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.293948  3721 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.294579  3721 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.297827  3709 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:07.298448  3350 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:07.298979  3350 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.302594 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.302769 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.303735  3691 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.305591 29252 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 27 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 26. Current term is 27. Ops: []
I20260709 13:14:07.305914  3691 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 27 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.308142 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:07.308279 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.308759 28723 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:14:07.287231  3727 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.296785  3721 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.311992 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.292438  3717 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.313194  3535 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:14:07.313436 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.323508 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.314188  3350 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.316283 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:07.309927 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.320350 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.320694 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.321557 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.328483 28653 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:14:07.353636 28655 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:14:07.357728 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:07.326530 28723 raft_consensus.cc:2468] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 27.
I20260709 13:14:07.364557  3717 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.355420  3416 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:07.365492  3416 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.365880  3416 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:07.367034  3717 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:07.367357  3693 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.367843  3693 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.368124 29223 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:07.355294  3694 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:07.369969  3693 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.369608  3694 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.369951 28545 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:14:07.330049  3716 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:14:07.372717 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.372828 28545 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:07.373361 28727 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:14:07.374660  3694 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.376211  3694 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:07.376495 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:07.380772 29251 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:14:07.380990 28545 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:07.387594 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.388590 28722 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:14:07.391961 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.392216 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.388559 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.393601 28727 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:14:07.393952 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.395605 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:07.400013 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.400844 28727 raft_consensus.cc:2468] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
I20260709 13:14:07.371006  3688 raft_consensus.cc:2804] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:14:07.408208 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:07.358812  3398 raft_consensus.cc:493] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.367863  3717 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:07.415364 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.416867 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:07.418339 28724 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 27 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 26. Current term is 27. Ops: []
I20260709 13:14:07.421360 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:07.418964 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.424728 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:07.322808  3727 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.394939  3686 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:07.396891  3726 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:07.189468 28470 catalog_manager.cc:5697] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 18, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 18 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:14:07.434257 28621 consensus_peers.cc:597] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.414737  3555 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:07.414924  3666 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:07.419777  3499 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:07.429340  3704 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:07.486326 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:07.482659 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 238332us
I20260709 13:14:07.433933  3539 raft_consensus.cc:2804] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:07.433693  3639 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:07.498693  3705 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:07.501940 28471 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 392) took 38925 ms (client timeout 15000 ms). Trace:
I20260709 13:14:07.471568  3433 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.463320  3552 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:07.425122  3398 raft_consensus.cc:515] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:07.504750 28621 consensus_peers.cc:597] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.420637  3579 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:14:07.406173  3508 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.470986  2972 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:07.503072  3539 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:07.488765  3666 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.492172  3673 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.429829  3651 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 13:14:07.433712  3688 raft_consensus.cc:697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 27 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:07.491438  3498 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:14:07.515596 28621 consensus_peers.cc:597] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.499567  3704 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.485577  3686 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.505586  3694 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.505344  3726 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:07.486260  3707 consensus_queue.cc:1059] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:14:07.522785  3666 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.565631  3726 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.535128  3673 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.521098  3539 raft_consensus.cc:3060] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:07.595258  3709 raft_consensus.cc:3055] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:14:07.595702  3709 raft_consensus.cc:740] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:07.596474  3709 consensus_queue.cc:260] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.598551  3709 raft_consensus.cc:3060] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:14:07.575898 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:07.605736  3729 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:14:07.521839  3717 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.576406 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:07.609283 28652 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.537886  3704 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.612331 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.580448 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.576709 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:07.515034  3433 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.570070  3694 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.579821 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.614118 28650 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.614594 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.520807  2972 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.625763 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.518074  3552 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.621687 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:07.629949 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 126149us
W20260709 13:14:07.635071 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 139455us
I20260709 13:14:07.637809 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.514853  3705 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.636270 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:14:07.618706  3677 log.cc:927] Time spent T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:14:07.560443  3686 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.540520  3498 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.657184 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.661507  2972 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.662593  3552 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.663115  3398 leader_election.cc:290] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.663791  3398 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:07.664273  3398 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.664598  3398 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:07.665630  3433 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.666129  3694 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.666325  3736 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:07.668476  3727 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.669626  3508 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.653623  3688 consensus_queue.cc:237] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:07.680644  3703 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:14:07.686343  3686 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.688136  3498 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.655611  3416 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.682227 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.683007 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.683579  3704 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.685324 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.691125 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.724462 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:07.725435 28655 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 17.
I20260709 13:14:07.726640 28652 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:07.540055 28470 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 16, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 16 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.729403 28470 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 18 to 19, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:07.734736  3705 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.742249  3416 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:07.750008 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 63979.6us
I20260709 13:14:07.731844 28470 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.751006 28650 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:14:07.751791  3686 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.750922 28546 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:07.775424 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:07.776084 28655 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:07.779763 28621 consensus_peers.cc:597] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:07.780650 28621 consensus_peers.cc:597] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:07.781845 28621 leader_election.cc:336] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:07.784332 28621 consensus_peers.cc:597] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:07.784981 28621 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:07.785418 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.765765  3498 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.750329  3587 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.776994 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:07.790975 28546 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:07.791409 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:07.792150 28651 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:07.796072 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:07.796752 28728 raft_consensus.cc:3060] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:14:07.749945  3470 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:07.752516  3704 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.802448 28546 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
W20260709 13:14:07.785832 28621 consensus_peers.cc:597] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.786722  3651 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.815311 28655 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:14:07.812232  3539 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:07.814288 28621 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:07.826368 28621 leader_election.cc:336] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:07.812947 28546 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:07.790055  3721 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:07.804939  3636 consensus_meta.cc:287] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.002s
I20260709 13:14:07.800786  3694 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:07.834833 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:07.836640 28546 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:07.805300  3717 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:07.839260 28651 raft_consensus.cc:2468] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:14:07.840445 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:07.778026  3686 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:07.850164 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 289224us
I20260709 13:14:07.813865  3552 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:07.857257 28621 consensus_peers.cc:597] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.858507 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:07.860589 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 54609.3us
I20260709 13:14:07.800427  3587 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.800180  3498 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.831188  2972 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:07.844578  3704 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:07.888064 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.889246 29255 raft_consensus.cc:2368] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:14:07.877967 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.844952  3568 raft_consensus.cc:3060] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.862737  3577 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.880103 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.899480 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.811764  3470 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.873529 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:07.851648  3696 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:07.894799 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.895257 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.895936 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:07.904930 28730 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 18.
I20260709 13:14:07.899717 28547 leader_election.cc:400] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:14:07.880810 28546 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:07.901738 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:07.870769  3727 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:07.906443 28721 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.827219  3651 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.905898 28547 leader_election.cc:403] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:07.845350  3636 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:07.912290 28546 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:07.913280 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:07.919000 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 282772us
I20260709 13:14:07.919757 28722 raft_consensus.cc:1240] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 27 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 13:14:07.919819 28695 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:07.918761 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 57016.4us
I20260709 13:14:07.923724  3694 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:07.913902  3577 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:07.936270  3747 log.cc:927] Time spent T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:07.937193  3577 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:07.937743  3539 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:07.939081  3498 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.948792  3686 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.950994  3587 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:07.892671  3744 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:07.952225  3744 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:07.956606  3651 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.958359  3636 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:07.901690 28470 catalog_manager.cc:5697] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 20, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 20 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.960686 28470 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
W20260709 13:14:07.965833 28621 leader_election.cc:336] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:07.966296 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 54112us
W20260709 13:14:07.966665 28621 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:07.967280 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: 
I20260709 13:14:07.967295 28621 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:07.969799 28621 leader_election.cc:336] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:07.961683  3751 log.cc:927] Time spent T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:14:07.979776 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 49610.5us
I20260709 13:14:07.977830 28721 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:07.978277 28728 raft_consensus.cc:2468] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:14:07.891227  2972 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:08.034871 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 169837us
I20260709 13:14:07.996958 28546 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:08.070397 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:07.922435  3704 raft_consensus.cc:3060] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:14:08.038697 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:08.067090 28621 leader_election.cc:336] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.075101 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:08.075891 29252 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 16: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:08.078364 29224 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:07.978935  3694 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:07.977542  3538 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:08.076195  3640 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:08.089475 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 92619.2us
I20260709 13:14:08.072762  3748 raft_consensus.cc:2764] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:14:08.082840 29224 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:08.025251  3673 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:08.090683 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 170471us
I20260709 13:14:08.006336  3686 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:14:08.089412 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 169668us
I20260709 13:14:08.090925 28546 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.027484  3470 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:08.100051 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:08.097393 28545 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.098026 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.098343 29259 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 14.
I20260709 13:14:08.101217 28651 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 14.
I20260709 13:14:08.023229  3398 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.090868  3582 raft_consensus.cc:2804] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:07.974958  3666 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.105533 28545 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.108542 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.109347 28728 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
I20260709 13:14:08.111078 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.111575 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.106513 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:08.114818 28730 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:08.114741 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.115074 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.115352 28721 raft_consensus.cc:1240] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Rejecting Update request from peer 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:08.112941 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:08.116374 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.117875 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.091912  3636 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:08.123068 28721 raft_consensus.cc:1275] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:14:08.119827 28725 raft_consensus.cc:2393] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 in current term 20: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:08.120114 28726 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 16: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
W20260709 13:14:08.120168 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.105237  3686 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.118077 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299a315de86c44c0a3613934339689e4" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.105404  3572 raft_consensus.cc:2804] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:08.124432 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b051a542445141ae99fc26201430f3ae" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:08.124759 29224 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.119374 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:08.131285 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.130730 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4380fb261ad646d49d956c3ba5036856" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.106315  3023 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:08.107362  3582 raft_consensus.cc:697] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
W20260709 13:14:08.135270 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.139818 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:08.108711  3498 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:08.147756  3498 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:08.148723  3498 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.152931 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.154628 28545 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:08.155697  3709 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:08.155966  3707 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:08.156498  3707 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:08.157212  3636 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:08.157779  3636 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:08.157474  3707 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.157913 28545 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.159075  3636 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.159621  3023 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:08.159864 28545 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.160620  3433 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:07.508306 28471 rpcz_store.cc:269] 0709 13:13:28.576292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.579757 (+  3465us) service_pool.cc:224] Handling call
0709 13:13:28.744623 (+164866us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5400230690. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24cf1b71 00007f4a24cf20b2 00007f4a2dc6ba89 00007f4a2dc03da6 00007f4a2dbd5088 00007f4a2dcd337e 00007f4a2c1942a4 00007f4a2c194232 00007f4a2c194161 00007f4a2c1940dc
0709 13:14:07.501809 (+38757186us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:02.577727 (+     0us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b4400022b4c. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a24bb1db1 00007f4a24c4fc85 00007f4a24c506a2 00007f4a279c21db 00007f4a279bdaaf 00007f4a24d0c0ac 00007f4a2db66ab9 00007f4a24d2869b 00007f4a24d2693f 00007f4a24d26455 00007f4a2b84b16c
0709 13:14:02.853905 (+276178us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:02.929855 (+ 75950us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:02.955089 (+ 25234us) write_op.cc:435] Acquired schema lock
0709 13:14:02.955121 (+    32us) tablet.cc:662] Decoding operations
0709 13:14:02.956509 (+  1388us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:02.956624 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:02.956655 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:14:03.003982 (+ 47327us) tablet.cc:701] Row locks acquired
0709 13:14:03.004069 (+    87us) write_op.cc:260] PREPARE: finished
0709 13:14:03.004372 (+   303us) write_op.cc:270] Start()
0709 13:14:03.004725 (+   353us) write_op.cc:276] Timestamp: P: 1783602843004284 usec, L: 0
0709 13:14:03.004753 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:14:03.005827 (+  1074us) log.cc:844] Serialized 4754 byte log entry
0709 13:14:03.644294 (+638467us) op_driver.cc:464] REPLICATION: finished
0709 13:14:03.758959 (+114665us) write_op.cc:301] APPLY: starting
0709 13:14:03.759074 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:03.849449 (+ 90375us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:03.849521 (+    72us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:04.109776 (+260255us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:04.110114 (+   338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:14:04.110163 (+    49us) write_op.cc:312] APPLY: finished
0709 13:14:04.152472 (+ 42309us) log.cc:844] Serialized 113 byte log entry
0709 13:14:04.152684 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:04.152831 (+   147us) write_op.cc:454] Released schema lock
0709 13:14:04.152907 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:04.153387 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:04.153419 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1006797,"reported_tablets":45,"spinlock_wait_cycles":45764992,"child_traces":[["op",{"apply.queue_time_us":114365,"apply.run_cpu_time_us":20576,"apply.run_wall_time_us":394409,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":459864,"prepare.run_cpu_time_us":46797,"prepare.run_wall_time_us":378221,"raft.queue_time_us":143795,"raft.run_cpu_time_us":25775,"raft.run_wall_time_us":72070,"replication_time_us":639354,"spinlock_wait_cycles":11193216,"thread_start_us":691311,"threads_started":4,"wal-append.queue_time_us":255712,"wal-append.run_cpu_time_us":22429,"wal-append.run_wall_time_us":1867571}]]}
I20260709 13:14:08.140638 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.141423 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.142295 28622 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:08.169387 28648 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 17.
I20260709 13:14:08.143872 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:08.121393  3666 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:08.145586 28729 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:08.147042 28755 heartbeater.cc:646] Failed to heartbeat to 127.26.202.62:36613 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.202.62:36613 timed out after 15.000s (SENT)
I20260709 13:14:08.146988  3727 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:08.173293 29224 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:08.174425 29224 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.092695  3640 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.185295 28620 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.117076  3673 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:08.183235 28730 raft_consensus.cc:1275] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:14:08.138561  3686 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:08.190742 28620 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.020605 28470 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.169622  3174 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:08.170360  3572 raft_consensus.cc:697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:08.209796 28651 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:14:08.211297  3398 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:08.194005  3476 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:08.199512  3706 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:08.222296 28729 raft_consensus.cc:2468] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:14:08.234337 29223 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:08.236527  3416 raft_consensus.cc:2804] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:08.237226  3416 raft_consensus.cc:697] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:08.238346  3416 consensus_queue.cc:237] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.205984  3538 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:08.193536  3651 consensus_queue.cc:1059] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:14:08.200698  3673 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.218134  3476 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:08.271478 28730 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:08.273675  3694 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:14:08.275995  3752 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.352s	user 0.004s	sys 0.000s
I20260709 13:14:08.276554  3568 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:08.256369  3582 consensus_queue.cc:237] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.278644  3552 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.279331  3552 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.291249  3433 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:08.294252  2972 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:08.298154  3640 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:08.301606  3750 log.cc:927] Time spent T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.384s	user 0.002s	sys 0.000s
I20260709 13:14:08.261633  3476 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:08.264922  3687 raft_consensus.cc:3055] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:14:08.320024  3719 log.cc:927] Time spent T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.194s	user 0.004s	sys 0.000s
I20260709 13:14:08.336766  3687 raft_consensus.cc:740] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:08.253687  3572 consensus_queue.cc:237] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.361058  3704 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:14:08.378311  3636 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:08.396984 28695 consensus_peers.cc:597] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:08.397817 28695 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.398353 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:14:08.383627 29224 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.386404 28726 raft_consensus.cc:1240] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:08.302362 28470 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:08.405212 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 220930us
W20260709 13:14:08.409534 29224 leader_election.cc:336] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:08.410584 29224 leader_election.cc:336] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.410945 29224 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:14:08.412043 29224 leader_election.cc:336] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.413457 29224 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.415230 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:08.421444 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:08.422748 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:08.423435 29224 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.424247  3587 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:08.424923  3577 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:08.401181  3636 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.430727 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:08.432876 29224 leader_election.cc:336] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.433938 29257 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 20.
W20260709 13:14:08.434759 29224 leader_election.cc:336] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:08.435981 29224 leader_election.cc:336] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.430716  3704 consensus_queue.cc:1059] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:14:08.405112  3398 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:08.436030 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:08.419852  3552 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:08.476096 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 285410us
I20260709 13:14:08.429473  3673 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:08.428982  3636 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:08.450284  3433 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:14:08.501504 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 95148.1us
I20260709 13:14:08.499259  3736 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.497385  3433 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.429975  3687 consensus_queue.cc:260] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.487861  3558 consensus_queue.cc:1048] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:14:08.507786 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.507148  3433 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:14:08.516312 28695 leader_election.cc:336] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.509977  3736 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.517772 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:08.520279 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:14:08.522246 28695 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.522794 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:14:08.523756 28695 leader_election.cc:336] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.524233 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:08.526325  3398 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:08.526705 28695 leader_election.cc:336] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.527149 28695 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:08.517269  3687 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:08.522296  3740 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:08.510835  3476 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.529372  3673 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:08.523334  2972 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:08.528996  3398 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:14:08.542796  2972 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.549417 28620 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.549944 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.551762  3736 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:08.552888 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:08.554729  3745 log.cc:927] Time spent T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.629s	user 0.004s	sys 0.000s
I20260709 13:14:08.556372  3686 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.560381  3694 raft_consensus.cc:3055] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:08.560894  3694 raft_consensus.cc:740] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:08.506132 28470 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:08.561817  3694 consensus_queue.cc:260] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.562247 28470 catalog_manager.cc:5697] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 15, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 15 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.563287  3694 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:08.564175 28695 leader_election.cc:304] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:08.566851  3755 raft_consensus.cc:2749] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:08.567869  3744 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:08.568079 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:08.569044  2972 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:08.571686 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 256998us
I20260709 13:14:08.569063 28695 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:08.573918 28620 leader_election.cc:304] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.579232  3755 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:08.582158 28621 leader_election.cc:336] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.584199 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:08.564199 28470 catalog_manager.cc:5697] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 13 to 16, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 16 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:08.588307 29224 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.575037  3686 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:08.577626  3715 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:08.590355 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:14:08.584774 28695 leader_election.cc:336] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:08.590885 29224 leader_election.cc:336] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.593755 29224 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.593714 28695 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:08.595026 28695 leader_election.cc:336] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.595433 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:08.592682  3705 raft_consensus.cc:2749] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:08.599578 29224 leader_election.cc:336] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.581883  3744 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:08.602807 28620 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
W20260709 13:14:08.604858 29224 leader_election.cc:336] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:08.608028 29224 leader_election.cc:336] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.603789  3753 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:08.602459  3673 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:08.598344  3749 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:08.624277  3433 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.627002  2972 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.621155  3715 raft_consensus.cc:3060] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:08.633961  2972 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:08.634346 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:08.635663 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:08.636314 28655 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:08.625625 28470 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 17 to 18, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 18 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.607214  3744 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.605407  3761 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:08.648247 28655 raft_consensus.cc:2468] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 15.
W20260709 13:14:08.655278 29224 leader_election.cc:336] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.658288 28470 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 14, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 14 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:08.666599 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
W20260709 13:14:08.667910 29224 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.671429 29259 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:08.644789  3744 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:08.689602 28470 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:08.692664  3775 log.cc:927] Time spent T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:14:08.694563  3740 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:08.639977  3706 consensus_queue.cc:1048] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
W20260709 13:14:08.696576 29224 leader_election.cc:336] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:08.702533 28621 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.709811 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:08.711189 29259 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:14:08.714609 28721 raft_consensus.cc:1275] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 27 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:14:08.715306 28547 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:08.669108  3433 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:08.717612 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:08.723605 29257 raft_consensus.cc:2368] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:14:08.726229 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:08.692060 28470 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 16, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 16 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:08.734934 28622 leader_election.cc:400] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:14:08.735270 28622 leader_election.cc:403] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:08.740478 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:08.742959  3461 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:14:08.749686  3416 consensus_queue.cc:1048] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.010s
W20260709 13:14:08.752771 28695 consensus_peers.cc:597] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:08.753564 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 157165us
W20260709 13:14:08.754343 28695 leader_election.cc:336] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:08.755632 28695 leader_election.cc:336] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.756049 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:08.739869  3572 raft_consensus.cc:2764] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:14:08.758993 28695 consensus_peers.cc:597] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:08.759706 28695 leader_election.cc:336] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.760263 28695 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:08.761807  3668 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:08.762089  3740 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:08.763720 28470 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.728978  3727 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:08.767410 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:08.774685 28652 raft_consensus.cc:2368] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:14:08.774921 28726 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:08.768673 28654 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:14:08.769404 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:08.776017 29224 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:14:08.776116 28695 consensus_peers.cc:597] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.777076 28648 raft_consensus.cc:2410] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:14:08.779034 28648 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:14:08.777539 28695 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.785161 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:08.785480 28695 leader_election.cc:336] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.786150 28655 raft_consensus.cc:2368] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:14:08.788182 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:08.790922 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.791229 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.791635 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:08.793419 28652 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:08.793994 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.792296 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
W20260709 13:14:08.792326 28695 leader_election.cc:336] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:08.795861 28695 leader_election.cc:336] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:08.795756 28650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.796465 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:08.796653 28647 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:08.798203 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:08.799543 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:08.809198 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:08.774554  3704 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:08.787297  3416 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:08.795460  3715 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:08.822832  3044 raft_consensus.cc:2804] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:08.801910  3668 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:08.806402  3398 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:08.911280 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 135307us
I20260709 13:14:08.922235 28652 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 19.
I20260709 13:14:08.923295 28726 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:08.845119  3673 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:08.803714  3538 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.946825 28546 leader_election.cc:400] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15.
I20260709 13:14:08.955669 28651 raft_consensus.cc:2468] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
W20260709 13:14:08.956281 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 152567us
W20260709 13:14:08.956459 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 150058us
I20260709 13:14:08.870903  3704 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:08.957857  3774 log.cc:927] Time spent T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:14:08.960786  3727 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:08.979805 28721 raft_consensus.cc:1275] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:14:08.951735  3538 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:08.981715  3461 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541) with higher term. Message: Invalid argument: T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 20. Current term is 21.
I20260709 13:14:08.982182  3783 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:08.982371  3780 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:08.983351  3433 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:08.985572  3704 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:08.999670 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:09.004624 28654 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f22d83287460fb8c0db0ba2799895 in term 21.
I20260709 13:14:08.962568  3744 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:09.021206  3398 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:09.038787  3538 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:09.039942  3398 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:08.971239 28470 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 16, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 16 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.045950  3744 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:09.047247 28724 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate ed517a03edd141a798f07798667c1c04 in this term.
I20260709 13:14:09.047230 28470 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 13 to 16, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 16 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:09.043188  3727 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.066908 28470 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 13 to 14, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 14 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:09.069571 28470 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 15 to 17, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.109228 28470 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.114251 28470 catalog_manager.cc:5697] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 3 to 18, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 18 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.115999 28723 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:09.132421 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.136370  3783 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.152138  3783 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.152521  3704 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:09.154628  3783 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.142413  3694 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.155591  3694 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.159399  3694 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.160207 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:09.161087 28723 raft_consensus.cc:2393] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 19: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:09.163514 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:09.167172 28470 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 13 to 16, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 16 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:09.169991 28470 catalog_manager.cc:5697] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 15, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 15 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.224058 28470 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 19, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 19 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.227828 28470 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 17, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.274842 28470 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 17, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.046000  3398 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.301681  3044 raft_consensus.cc:697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:09.328584 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:09.330111 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 378948us
I20260709 13:14:09.336992 28652 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:14:09.339954 28546 leader_election.cc:400] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245) with higher term. Message: Invalid argument: T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 for earlier term 20. Current term is 21.
I20260709 13:14:09.323756  3704 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:09.341681 28648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:09.343647 28648 raft_consensus.cc:2393] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ed517a03edd141a798f07798667c1c04 in current term 19: Already voted for candidate 178f22d83287460fb8c0db0ba2799895 in this term.
I20260709 13:14:09.338383  3785 raft_consensus.cc:493] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:09.354959  3785 raft_consensus.cc:515] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.345139  3704 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.359163  3704 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.360520 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:09.373109  3476 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:09.366662  3707 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:09.381562  3707 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.384177  3707 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.388343 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:09.405787  3785 leader_election.cc:290] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.342456  3044 consensus_queue.cc:237] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.447089 28546 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:09.448339 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.449167 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.451464 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.451723 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.452072 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.456525 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.456689 28546 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.457333 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.460216 28654 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:14:09.460584 28654 pending_rounds.cc:85] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting all ops after (but not including) 10
I20260709 13:14:09.460563 28546 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895; no voters: ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.461047 28654 pending_rounds.cc:107] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:14:09.461565 28654 raft_consensus.cc:2889] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:09.464461  3794 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:09.456090  3686 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:09.456350  3636 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:09.454263  3640 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:09.483805 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.491111  3640 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:09.505640  3791 consensus_queue.cc:1048] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:14:09.485756  3707 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:09.461407  3783 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:14:09.521713 29251 raft_consensus.cc:1240] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Rejecting Update request from peer 178f22d83287460fb8c0db0ba2799895 for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:09.523757 28621 leader_election.cc:336] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:09.525270 28621 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.511102  3552 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:09.537807 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1404e4e726904b9da0d047a2f50142f0" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:09.538353 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:09.539136 28729 raft_consensus.cc:2368] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19.
I20260709 13:14:09.519366  3023 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:14:09.505856  3572 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:14:09.544513 28695 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
W20260709 13:14:09.554699 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 46848.2us
I20260709 13:14:09.557823 28647 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:09.560078 28620 leader_election.cc:304] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.564913 28620 leader_election.cc:400] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19.
I20260709 13:14:09.565341 28620 leader_election.cc:403] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:14:09.580317 28729 raft_consensus.cc:1275] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:14:09.567291  3398 raft_consensus.cc:2804] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:09.566926  3706 raft_consensus.cc:2749] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:09.569962  3694 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.569736  3780 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:09.579360  3785 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339) with higher term. Message: Invalid argument: T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ecde0af494dc9b152dee191c6d3e6 for earlier term 18. Current term is 19.
W20260709 13:14:09.650641  3806 log.cc:927] Time spent T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:14:09.609594  3707 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Becoming Leader. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
W20260709 13:14:09.662575 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 94784.7us
I20260709 13:14:09.639174  3783 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:09.644505  3398 raft_consensus.cc:697] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 20 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:09.645138  3709 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:09.649106  3792 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:14:09.660552  3640 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:09.645377  3790 consensus_queue.cc:1048] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:14:09.643963  3694 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:09.678026  3801 log.cc:927] Time spent T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:14:09.672580  3433 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:09.669195  3783 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.690416  3640 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:09.673467  3709 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.745988 28653 raft_consensus.cc:1275] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:14:09.697062  3579 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
W20260709 13:14:09.755461 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 178603us
I20260709 13:14:09.780678 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:09.704201  3433 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.798925  3470 raft_consensus.cc:493] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.758562  3640 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.647367  3780 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.741977  3398 consensus_queue.cc:237] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:09.753600  3707 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:09.832396 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 269277us
I20260709 13:14:09.772387  3579 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:09.834298 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 317414us
I20260709 13:14:09.837790 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.851442 28547 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.833791  3470 raft_consensus.cc:515] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.852851  3568 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:09.877498 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.885533  3640 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.885632  3783 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.892463 28547 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:09.904670 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.904922 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.881572  3817 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:14:09.895923  3727 raft_consensus.cc:3060] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:09.897578  3694 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.898589  3783 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:09.938066  3780 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.939642  3470 leader_election.cc:290] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.940343 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:09.945098 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:09.917184  3792 consensus_queue.cc:1059] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:14:09.946358  3792 consensus_queue.cc:1243] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Peer d64d870625d6461b89b1fb75cd2e26e0 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:14:09.946587  3704 raft_consensus.cc:3055] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:09.947046  3704 raft_consensus.cc:740] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 178f22d83287460fb8c0db0ba2799895, State: Running, Role: LEADER
I20260709 13:14:09.947639  3704 consensus_queue.cc:260] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:09.948619 28544 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:09.960647  3812 log.cc:927] Time spent T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:14:09.973202  3694 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:09.974167  3433 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:09.973891  3694 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.976224  3694 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:09.977499  3808 log.cc:927] Time spent T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:14:09.983108 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ff2d657aad54bbe97b4cda17edf3957" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.983974  3789 consensus_queue.cc:1048] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:09.988454 28696 leader_election.cc:304] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:09.990031  3816 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:09.990468  3793 raft_consensus.cc:2749] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:09.990669  3816 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:09.995369 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:09.995617  3704 raft_consensus.cc:3060] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:09.993389  3727 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:10.002714  3706 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.003301  3706 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:10.009196 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.009737  3816 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.005900  3706 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.029130 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.031255 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.033073 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.046296 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.065312  3816 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
W20260709 13:14:10.070619 28545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46785.2us
I20260709 13:14:10.065915  3787 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:10.086115  3787 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:10.088367  3787 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.046838  3433 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.076807  3498 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.089152  3433 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:10.077150  3568 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.090149  3568 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:10.091454  3433 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:10.092141  3568 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.089265  3498 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:10.080595 28647 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:14:10.094791  3498 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.096330 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:10.099643  3810 log.cc:927] Time spent T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: Append to log took a long time: real 0.211s	user 0.006s	sys 0.004s
I20260709 13:14:10.102203 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.113657 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.129284  3476 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:10.130589 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.128917  3709 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.069216  3816 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:10.134222  3816 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.144526 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.150589 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.145675  3579 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.151310 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.153381 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.154294 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.159643 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.160245 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.154666 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.161698 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:10.157419 28695 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:10.166538 29255 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:14:10.167128 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.167487 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:14:10.168766 28695 leader_election.cc:336] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:10.169198 28695 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.195756 28547 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.203912 28653 raft_consensus.cc:1275] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:14:10.197160  3398 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:10.171042  3746 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:10.181520  3552 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:10.187012  3579 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:14:10.249166 29224 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:10.247709  3552 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:10.257797  3552 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:10.270466 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.271555  3584 consensus_queue.cc:1048] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:10.261207  3579 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:10.277340  3579 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:10.278259  3709 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:10.267637 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 72020.1us
I20260709 13:14:10.281059 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.282196  3709 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:10.283962 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:10.285373 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 204136us
I20260709 13:14:10.285900 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.290860  3709 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:10.292026 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.292457 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.293381 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.294473 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.301808 28546 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.303718  3704 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:10.321547 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.322365  3579 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:10.323092  3579 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:10.323949 28621 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:10.324431 28621 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.324546 28547 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.325202  3558 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:10.325402  3709 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:10.337733 28621 leader_election.cc:336] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:10.339593 28621 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.340551 28547 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.341313  3558 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:10.343580 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:10.344314 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:10.349637 28621 leader_election.cc:336] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:10.351147  3709 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:10.352708 28621 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.354678  3558 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:10.355911  3704 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:10.364442 28547 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.370625  3816 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:10.373729 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.378634  3704 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:10.392338 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.394363  3704 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:10.395694 28547 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.398444 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.399035  3704 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:10.411058 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.411401 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.412964 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:10.409451  3816 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:10.427487  3023 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.428076 28547 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:10.429301 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.430174  3709 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:10.430859  3709 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:10.431300 28647 raft_consensus.cc:1275] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:10.433073 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.434576  3816 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:10.428093  3023 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:10.450168  3835 log.cc:927] Time spent T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:14:10.449807  3398 consensus_queue.cc:1048] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:14:10.471906  3023 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:10.502992 27432 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 28606)
W20260709 13:14:10.510008 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 63522.8us
I20260709 13:14:10.518548 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:10.527056 28695 consensus_peers.cc:597] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:10.535228 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.547747 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.588735  3787 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.589895  3787 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:10.595978  3787 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:10.597539 28652 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:10.612958  3023 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:10.590632  3636 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:10.622466  3636 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.623425  3636 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:10.627302  3636 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:10.642383 28647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:10.645409  3838 log.cc:927] Time spent T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: Append to log took a long time: real 0.170s	user 0.000s	sys 0.004s
I20260709 13:14:10.651113 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b644d4c5865d4fd89ed3c9e770e2eaac" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.655015 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.660107  3582 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.666929  3582 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:10.662598 28725 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 178f22d83287460fb8c0db0ba2799895: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:10.671846  3582 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:10.714169 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:10.723171 28545 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.732170  3792 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:10.733366 28726 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
W20260709 13:14:10.738590 28621 consensus_peers.cc:597] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:10.750996 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:10.752472  3508 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:10.752969  3508 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.753408  3508 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:10.735193  3568 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
W20260709 13:14:10.766428 28621 consensus_peers.cc:597] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:10.768952 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:10.773164 28546 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:10.774825  3787 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:10.805661 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 89672.8us
I20260709 13:14:10.814327  3508 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:10.787356 28621 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 149 similar messages]
W20260709 13:14:10.832484 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 45155.9us
I20260709 13:14:10.840122  3508 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:10.833173 28621 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:10.845619 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:10.846670 28726 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:10.883523 28621 consensus_peers.cc:597] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:10.894315 28621 consensus_peers.cc:597] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:10.897658 28621 consensus_peers.cc:597] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:10.929914 29224 leader_election.cc:336] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:10.931562 29224 leader_election.cc:336] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:10.934615 28726 raft_consensus.cc:2468] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:14:10.966322 29223 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:10.967675  3508 raft_consensus.cc:2804] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:10.968312  3508 raft_consensus.cc:697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:10.969570  3508 consensus_queue.cc:237] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.082307 28473 catalog_manager.cc:5697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 9 to 14, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 14 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.095578 28473 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 11 to 21. New cstate: current_term: 21 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.106787 28473 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 13 to 14, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 14 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.110180  3636 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.110939  3636 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.113627  3636 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:11.118422 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:11.123467 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:11.126120 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:11.128753  3552 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:11.145371 28470 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53932 (request call id 280) took 12937 ms (client timeout 15000 ms). Trace:
W20260709 13:14:11.145996 28470 rpcz_store.cc:269] 0709 13:13:58.170842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.171836 (+   994us) service_pool.cc:224] Handling call
0709 13:14:11.108361 (+12936525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:10.215406 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:10.271280 (+ 55874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:10.271321 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:14:10.271343 (+    22us) tablet.cc:662] Decoding operations
0709 13:14:10.302213 (+ 30870us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:10.302316 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:10.302353 (+    37us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:14:10.308381 (+  6028us) tablet.cc:701] Row locks acquired
0709 13:14:10.308404 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:14:10.308582 (+   178us) write_op.cc:270] Start()
0709 13:14:10.308709 (+   127us) write_op.cc:276] Timestamp: P: 1783602850308527 usec, L: 0
0709 13:14:10.308733 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:14:10.324537 (+ 15804us) log.cc:844] Serialized 10790 byte log entry
0709 13:14:10.475875 (+151338us) op_driver.cc:464] REPLICATION: finished
0709 13:14:10.478788 (+  2913us) write_op.cc:301] APPLY: starting
0709 13:14:10.478876 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:10.824153 (+345277us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:10.824348 (+   195us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:10.976937 (+152589us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:10.977488 (+   551us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:14:10.977527 (+    39us) write_op.cc:312] APPLY: finished
0709 13:14:10.978227 (+   700us) log.cc:844] Serialized 244 byte log entry
0709 13:14:10.980353 (+  2126us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:10.993536 (+ 13183us) write_op.cc:454] Released schema lock
0709 13:14:10.993629 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:11.010668 (+ 17039us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:11.010703 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1714066,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":2591,"apply.run_cpu_time_us":48394,"apply.run_wall_time_us":531822,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121111,"num_ops":28,"prepare.queue_time_us":104933,"prepare.run_cpu_time_us":29621,"prepare.run_wall_time_us":213076,"raft.queue_time_us":24194,"raft.run_cpu_time_us":2788,"raft.run_wall_time_us":2969,"replication_time_us":166914,"thread_start_us":105626,"threads_started":4,"wal-append.queue_time_us":74837}]]}
I20260709 13:14:11.170432 28473 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.172537 28473 catalog_manager.cc:5697] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.175729 28473 catalog_manager.cc:5697] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 14 to 18, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 18 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:11.178243 28695 consensus_peers.cc:597] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:11.190686  3636 raft_consensus.cc:493] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.191630 28473 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.195477 28473 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 reported cstate change: term changed from 10 to 15, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:11.198993 28621 consensus_peers.cc:597] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:11.222808  3552 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:11.223732  3552 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.228487  3552 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:11.229600 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:11.242133 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:11.258978 28621 consensus_peers.cc:597] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:11.259827 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:11.261571  3579 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:11.263301  3579 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.263888  3579 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:11.266775  3579 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:11.191421  3636 raft_consensus.cc:515] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.268121 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:11.272465 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:11.273694 28725 raft_consensus.cc:2393] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 178f22d83287460fb8c0db0ba2799895 in current term 17: Already voted for candidate d64d870625d6461b89b1fb75cd2e26e0 in this term.
I20260709 13:14:11.292320 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d30c923964844ccad86f6776b30b074" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:11.294463 28545 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:11.296460  3579 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:11.304636 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35fc728c038d4d8d8827779516ffce5f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:11.311160 28547 leader_election.cc:304] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:11.312158  3552 raft_consensus.cc:3060] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:11.305821  3636 leader_election.cc:290] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:11.356910  3579 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.357754  3579 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.360903 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:11.363143  3579 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:11.366367 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:11.392311 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:11.393924  3636 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:11.401876  3787 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.402534  3787 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.404832  3787 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:11.408277 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:11.414054 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908e88869b314709ad606ff91b8da799" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:11.431741 28547 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:11.439210  3636 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:11.447306 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 44391.2us
W20260709 13:14:11.463124 28621 consensus_peers.cc:597] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:11.483194 28726 raft_consensus.cc:1275] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:14:11.485110  3508 consensus_queue.cc:1048] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:14:11.503971 27432 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 28606)
I20260709 13:14:11.514268  3787 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:11.515146  3787 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.521667 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:11.520607  3552 raft_consensus.cc:2749] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:11.526969 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:11.531826 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:11.533542  3579 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:11.534616  3787 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:11.536916  3579 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.539129  3579 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:11.543247 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:11.547402  3579 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:11.548897 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:11.551460 28545 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:11.552816  3579 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:11.572624 29224 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:11.574597 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:11.574872 28473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43518 (request call id 379) took 31401 ms (client timeout 15000 ms). Trace:
W20260709 13:14:11.575287 28473 rpcz_store.cc:269] 0709 13:13:40.173557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.185463 (+ 11906us) service_pool.cc:224] Handling call
0709 13:14:11.574768 (+31389305us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:11.358525 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:11.359235 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:11.359291 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:14:11.359310 (+    19us) tablet.cc:662] Decoding operations
0709 13:14:11.360257 (+   947us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:11.360343 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:11.360370 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:14:11.361290 (+   920us) tablet.cc:701] Row locks acquired
0709 13:14:11.361340 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:14:11.361542 (+   202us) write_op.cc:270] Start()
0709 13:14:11.361681 (+   139us) write_op.cc:276] Timestamp: P: 1783602851361472 usec, L: 0
0709 13:14:11.361706 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:14:11.362417 (+   711us) log.cc:844] Serialized 3214 byte log entry
0709 13:14:11.464351 (+101934us) op_driver.cc:464] REPLICATION: finished
0709 13:14:11.475037 (+ 10686us) write_op.cc:301] APPLY: starting
0709 13:14:11.475141 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:11.480909 (+  5768us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:11.495197 (+ 14288us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:11.529153 (+ 33956us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:11.529341 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:14:11.529385 (+    44us) write_op.cc:312] APPLY: finished
0709 13:14:11.529870 (+   485us) log.cc:844] Serialized 81 byte log entry
0709 13:14:11.530069 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:11.530209 (+   140us) write_op.cc:454] Released schema lock
0709 13:14:11.530264 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:11.544411 (+ 14147us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:11.552333 (+  7922us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6700,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":10422,"apply.run_cpu_time_us":13338,"apply.run_wall_time_us":55584,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33424,"num_ops":8,"prepare.queue_time_us":149606,"prepare.run_cpu_time_us":11415,"prepare.run_wall_time_us":33576,"replication_time_us":102455,"thread_start_us":152177,"threads_started":1}]]}
W20260709 13:14:11.598280 29224 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:11.599189 29224 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:11.612757 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:11.613523 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:11.655886 28695 consensus_peers.cc:597] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:11.673347 28476 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43518 (request call id 376) took 95444 ms (client timeout 15000 ms). Trace:
W20260709 13:14:11.685201 28476 rpcz_store.cc:269] 0709 13:12:36.230247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.230598 (+   351us) service_pool.cc:224] Handling call
0709 13:14:11.673106 (+95442508us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13092,"reported_tablets":44}
I20260709 13:14:11.706300 28473 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 20 to 21, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 21 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.708499 28473 catalog_manager.cc:5697] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 16, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 16 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.710502 28473 catalog_manager.cc:5697] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.717773 28473 catalog_manager.cc:5697] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 19 to 21, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 21 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.719676 28473 catalog_manager.cc:5697] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.722585 28473 catalog_manager.cc:5697] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 21, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 21 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:11.727823 28477 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 380) took 82279 ms (client timeout 15000 ms). Trace:
W20260709 13:14:11.728837 28477 rpcz_store.cc:269] 0709 13:12:49.448681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.450324 (+  1643us) service_pool.cc:224] Handling call
0709 13:14:11.727600 (+82277276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6144,"reported_tablets":44}
I20260709 13:14:11.724547 28473 catalog_manager.cc:5697] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.732137 28473 catalog_manager.cc:5697] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 18 to 21, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 21 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:11.732908 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 43928.4us
I20260709 13:14:11.735036 28473 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.738849 28473 catalog_manager.cc:5697] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 9 to 15, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 15 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.740857 28473 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 20 to 22, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 22 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.743829 28473 catalog_manager.cc:5697] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 10 to 13, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 13 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.745396 28473 catalog_manager.cc:5697] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.747076 28473 catalog_manager.cc:5697] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 19 to 21, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 21 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.749153 28473 catalog_manager.cc:5697] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.750864 28473 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 18 to 21, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 21 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.752396 28473 catalog_manager.cc:5697] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 18, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 18 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.754379 28473 catalog_manager.cc:5697] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 17 to 21, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 21 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.755903 28473 catalog_manager.cc:5697] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.757563 28473 catalog_manager.cc:5697] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.763644 28473 catalog_manager.cc:5697] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 21 to 27, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 27 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.765630 28473 catalog_manager.cc:5697] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 15 to 21, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 21 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.767503 28473 catalog_manager.cc:5697] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.769237 28473 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 21 to 22, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 22 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.770735 28473 catalog_manager.cc:5697] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.772552 28473 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 18, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 18 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.774133 28473 catalog_manager.cc:5697] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.775790 28473 catalog_manager.cc:5697] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 17, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.777482 28473 catalog_manager.cc:5697] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 18 to 19, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.780135 28473 catalog_manager.cc:5697] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 17 to 19, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 19 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.782485  3568 raft_consensus.cc:493] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.782475 28473 catalog_manager.cc:5697] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 20, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 20 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.783509  3568 raft_consensus.cc:515] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.784663 28473 catalog_manager.cc:5697] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 17 to 20, leader changed from d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 20 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.787122 28473 catalog_manager.cc:5697] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 17 to 20, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 20 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.789208 28473 catalog_manager.cc:5697] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.789893  3568 leader_election.cc:290] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:11.791898 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:11.791162 28473 catalog_manager.cc:5697] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.796756 28473 catalog_manager.cc:5697] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 15 to 17, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.798523 28473 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } } }
I20260709 13:14:11.802968 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cf5b8cf3c9a478da7deba36d7acbe96" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:11.827976 28545 leader_election.cc:304] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:11.846113  3568 raft_consensus.cc:2749] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:14:11.863147 28695 consensus_peers.cc:597] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:11.863893 29224 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:11.891000  3568 raft_consensus.cc:493] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:11.891711  3568 raft_consensus.cc:515] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.894070  3568 leader_election.cc:290] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:11.896251 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:11.909088 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9f7022e7f24efaa9b25cb129729504" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:11.911087 28545 leader_election.cc:304] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:11.912524  3568 raft_consensus.cc:2749] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:11.926033  3568 raft_consensus.cc:493] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.926748  3568 raft_consensus.cc:515] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:11.930668 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:11.949303 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd08c8d0651d4f21937f0b958dcaaba7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:11.953502 28547 leader_election.cc:304] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:11.955819  3552 raft_consensus.cc:2749] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:11.956841  3568 leader_election.cc:290] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:11.983915 28695 consensus_peers.cc:597] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:11.990962 29224 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:12.087256 29224 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:12.139303 28695 consensus_peers.cc:597] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:12.184408 29224 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:12.192602  3552 raft_consensus.cc:493] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.193653  3552 raft_consensus.cc:515] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:12.195873  3552 leader_election.cc:290] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:12.196951 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:12.198240  3552 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.198812 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9ebd651cf34b18b29911e247dc9834" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.198760  3552 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:12.200239 28545 leader_election.cc:304] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.200989  3568 raft_consensus.cc:2749] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:12.201315  3552 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:12.201927 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:12.205731 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.206692  3552 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:12.207674  3552 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:12.210554  3552 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:12.211941 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:12.214922 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95579b54a2ec400081e0a348b2395dfc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.216766 28545 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.233999 28545 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.235654  3552 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:12.241251  3787 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:12.273819 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:12.282076  3568 raft_consensus.cc:493] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.282826  3568 raft_consensus.cc:515] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:12.286598 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:12.288779  3568 leader_election.cc:290] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:12.288964 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3680992ef7b48798cdf5ea60753f423" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.290887 28545 leader_election.cc:304] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.292095  3568 raft_consensus.cc:2749] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:12.332448 29224 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:12.334930 28474 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 14 to 15, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 15 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.339962 28474 catalog_manager.cc:5697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 11 to 12, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 12 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.348716  3552 raft_consensus.cc:493] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:12.349423  3552 raft_consensus.cc:515] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:12.351656  3552 leader_election.cc:290] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:12.352711 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:12.354637 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b0cf1ebd07944b7aec6c6ff6e22de83" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.355681 28474 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:12.358901 28547 leader_election.cc:304] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.359723  3552 raft_consensus.cc:2749] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:12.363440 28478 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43518 (request call id 378) took 54005 ms (client timeout 15000 ms). Trace:
W20260709 13:14:12.363921 28478 rpcz_store.cc:269] 0709 13:13:18.358007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.358239 (+   232us) service_pool.cc:224] Handling call
0709 13:14:12.363239 (+54005000us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38571,"reported_tablets":44}
I20260709 13:14:12.367561  3552 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:12.368310  3552 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:12.371414 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.373956  3552 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:12.375022 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fbdeb3c093d412b871d55add092cb37" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:12.376657 28547 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.377789  3552 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:12.485569 28479 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 14 to 15, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
W20260709 13:14:12.505460 27432 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 28606)
W20260709 13:14:12.497812 28474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 382) took 33083 ms (client timeout 15000 ms). Trace:
W20260709 13:14:12.509176 28474 rpcz_store.cc:269] 0709 13:13:39.414666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.415095 (+   429us) service_pool.cc:224] Handling call
0709 13:14:12.497730 (+33082635us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:12.377937 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:12.378615 (+   678us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:12.378660 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:14:12.378682 (+    22us) tablet.cc:662] Decoding operations
0709 13:14:12.379399 (+   717us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:12.379492 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:12.379527 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:14:12.379903 (+   376us) tablet.cc:701] Row locks acquired
0709 13:14:12.379929 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:14:12.380118 (+   189us) write_op.cc:270] Start()
0709 13:14:12.380249 (+   131us) write_op.cc:276] Timestamp: P: 1783602852380057 usec, L: 0
0709 13:14:12.380276 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:14:12.381139 (+   863us) log.cc:844] Serialized 1308 byte log entry
0709 13:14:12.397818 (+ 16679us) op_driver.cc:464] REPLICATION: finished
0709 13:14:12.405360 (+  7542us) write_op.cc:301] APPLY: starting
0709 13:14:12.405454 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:12.407420 (+  1966us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:12.407530 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:12.415820 (+  8290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:12.416028 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:14:12.416084 (+    56us) write_op.cc:312] APPLY: finished
0709 13:14:12.416338 (+   254us) log.cc:844] Serialized 41 byte log entry
0709 13:14:12.416517 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:12.416623 (+   106us) write_op.cc:454] Released schema lock
0709 13:14:12.416676 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":43674,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":7283,"apply.run_cpu_time_us":5623,"apply.run_wall_time_us":11669,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12534,"num_ops":3,"prepare.queue_time_us":10723,"prepare.run_cpu_time_us":3684,"prepare.run_wall_time_us":10143,"replication_time_us":17360,"thread_start_us":17978,"threads_started":1}]]}
I20260709 13:14:12.528949  3552 raft_consensus.cc:493] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.529696  3552 raft_consensus.cc:515] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:12.537156 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:12.563738  3552 leader_election.cc:290] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:12.567507 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b5276724f2468eb1927555abdfcc2a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.574744 28545 leader_election.cc:304] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.581321  3568 raft_consensus.cc:2749] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:12.622571 28472 catalog_manager.cc:5697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.624183 28472 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.625587 28472 catalog_manager.cc:5697] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 15 to 17, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 17 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.627319 28472 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.629220 28472 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.630692 28472 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 15 to 19, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:12.642590 28479 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 381) took 55573 ms (client timeout 15000 ms). Trace:
W20260709 13:14:12.642850 29224 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:12.644902 28479 rpcz_store.cc:269] 0709 13:13:17.069199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.069386 (+   187us) service_pool.cc:224] Handling call
0709 13:14:12.642504 (+55573118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:12.528022 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:12.528695 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:12.528741 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:14:12.528763 (+    22us) tablet.cc:662] Decoding operations
0709 13:14:12.529189 (+   426us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:12.529258 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:12.529293 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:12.529518 (+   225us) tablet.cc:701] Row locks acquired
0709 13:14:12.529541 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:14:12.529722 (+   181us) write_op.cc:270] Start()
0709 13:14:12.529849 (+   127us) write_op.cc:276] Timestamp: P: 1783602852529662 usec, L: 0
0709 13:14:12.529869 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:14:12.530631 (+   762us) log.cc:844] Serialized 538 byte log entry
0709 13:14:12.532846 (+  2215us) op_driver.cc:464] REPLICATION: finished
0709 13:14:12.533326 (+   480us) write_op.cc:301] APPLY: starting
0709 13:14:12.533406 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:12.534256 (+   850us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:12.534349 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:12.535061 (+   712us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:12.535242 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:14:12.535293 (+    51us) write_op.cc:312] APPLY: finished
0709 13:14:12.535494 (+   201us) log.cc:844] Serialized 25 byte log entry
0709 13:14:12.535662 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:12.535750 (+    88us) write_op.cc:454] Released schema lock
0709 13:14:12.535800 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:12.536189 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:12.536222 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":355202,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":266,"apply.run_cpu_time_us":2805,"apply.run_wall_time_us":2805,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":2928,"prepare.run_wall_time_us":2929,"replication_time_us":2817}]]}
I20260709 13:14:12.643819 28472 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.657665 28472 catalog_manager.cc:5697] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 12 to 15, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 15 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.666468 28472 catalog_manager.cc:5697] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 11 to 19, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.668357 28472 catalog_manager.cc:5697] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
W20260709 13:14:12.684082 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:12.693681  3552 raft_consensus.cc:493] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:12.694434  3552 raft_consensus.cc:515] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:12.698164  3568 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.698305 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:12.698705  3568 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:12.700860  3568 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:12.710757  3552 leader_election.cc:290] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:12.713423 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc836b2fe6541889bfb8d09a2bc3d2c" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.715984 28725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:12.717851 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d9db35d52e47849f6205fef1ea841a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:12.721163 28545 leader_election.cc:304] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.722863  3552 raft_consensus.cc:2749] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:12.722354 28545 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:12.740433  3552 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:12.781908 28470 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 19 to 23, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 23 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.783811 28470 catalog_manager.cc:5697] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.785439 28470 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.787806 28470 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.792961 28470 catalog_manager.cc:5697] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.795028 28470 catalog_manager.cc:5697] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 18 to 20, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 20 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
W20260709 13:14:12.798564 28472 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 383) took 11594 ms (client timeout 15000 ms). Trace:
I20260709 13:14:12.894634  3568 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:12.899827  3568 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:12.799088 28472 rpcz_store.cc:269] 0709 13:14:01.204668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.386712 (+182044us) service_pool.cc:224] Handling call
0709 13:14:12.798457 (+11411745us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:12.693290 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:12.693917 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:12.693958 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:14:12.693989 (+    31us) tablet.cc:662] Decoding operations
0709 13:14:12.695258 (+  1269us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:12.695322 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:12.695357 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:14:12.696226 (+   869us) tablet.cc:701] Row locks acquired
0709 13:14:12.696248 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:14:12.696404 (+   156us) write_op.cc:270] Start()
0709 13:14:12.696518 (+   114us) write_op.cc:276] Timestamp: P: 1783602852696360 usec, L: 0
0709 13:14:12.696536 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:14:12.697249 (+   713us) log.cc:844] Serialized 4004 byte log entry
0709 13:14:12.699562 (+  2313us) op_driver.cc:464] REPLICATION: finished
0709 13:14:12.700007 (+   445us) write_op.cc:301] APPLY: starting
0709 13:14:12.700083 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:12.705662 (+  5579us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:12.705801 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:12.715606 (+  9805us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:12.715853 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:14:12.715907 (+    54us) write_op.cc:312] APPLY: finished
0709 13:14:12.716235 (+   328us) log.cc:844] Serialized 97 byte log entry
0709 13:14:12.717223 (+   988us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:12.717379 (+   156us) write_op.cc:454] Released schema lock
0709 13:14:12.717428 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:12.722739 (+  5311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:12.722771 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24794,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":13755,"apply.run_wall_time_us":22674,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41780,"num_ops":10,"prepare.queue_time_us":10119,"prepare.run_cpu_time_us":4219,"prepare.run_wall_time_us":11875,"replication_time_us":2916}]]}
I20260709 13:14:12.913367  3552 raft_consensus.cc:493] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:12.914340  3568 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:12.931135 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:12.917984  3552 raft_consensus.cc:515] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:12.936941  3552 leader_election.cc:290] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:12.949980 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:12.808976 28470 catalog_manager.cc:5697] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 21 to 22, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 22 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:12.957798 28470 catalog_manager.cc:5697] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 17 to 19, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.959956 28470 catalog_manager.cc:5697] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:12.962989 28470 catalog_manager.cc:5697] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:13.027550  3552 raft_consensus.cc:493] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:13.028297  3552 raft_consensus.cc:515] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.112941 28470 catalog_manager.cc:5697] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 15 to 19, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:13.117192 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8259ae9bad54fb1b2f26e7b813a8bd6" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:13.117674 28470 catalog_manager.cc:5697] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:13.119508 28470 catalog_manager.cc:5697] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 16 to 20, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 20 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.148205  3552 leader_election.cc:290] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.182027  3552 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:13.182792  3552 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.185622  3552 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.228221  3859 raft_consensus.cc:493] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.228844  3859 raft_consensus.cc:515] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.231005  3859 leader_election.cc:290] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.246028 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed00f783ec545f7a156d77cd9062498" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:13.248980 28546 leader_election.cc:304] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
W20260709 13:14:13.303489 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 54580.1us
I20260709 13:14:13.439414  3858 raft_consensus.cc:2749] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:13.440486  3860 raft_consensus.cc:493] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:13.441228  3860 raft_consensus.cc:515] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:13.505992 27432 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 28606)
W20260709 13:14:13.526031 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 84465.9us
I20260709 13:14:13.553880  3872 raft_consensus.cc:493] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.555047  3872 raft_consensus.cc:515] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.556082  3860 leader_election.cc:290] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.559401  3872 leader_election.cc:290] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.563676  3860 raft_consensus.cc:493] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:13.566591  3860 raft_consensus.cc:515] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.570149  3859 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:13.565455  3873 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:13.571645  3873 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.571350  3859 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.575181  3859 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.574806  3873 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.576925  3872 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:13.592808  3872 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.577978  3860 leader_election.cc:290] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.602944  3860 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.603554  3860 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:13.584513  3873 raft_consensus.cc:493] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:13.607779  3873 raft_consensus.cc:515] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.612802  3860 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:13.609283  3872 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.614743  3873 leader_election.cc:290] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.617457 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:13.628522 28546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 95000us
I20260709 13:14:13.631567 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:13.633893 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:13.635864 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:13.638809 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:13.644232 28545 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:13.645567  3882 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:13.646855  3815 raft_consensus.cc:493] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:13.647231 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:13.647688 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:13.647449  3815 raft_consensus.cc:515] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.649619 28723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:13.649863  3815 leader_election.cc:290] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.651433 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74487246ff8b4903996c628e2ca7c948" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:13.654958 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:13.712538 28621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 61753.9us
I20260709 13:14:13.734611 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:13.736069 28546 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:13.736769  3871 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.736871  3882 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:13.737370  3871 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:13.739167 29225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.008s	sys 0.008s
W20260709 13:14:13.739478 29225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.008s	sys 0.008s
I20260709 13:14:13.739549  3871 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:13.748473 28621 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:13.748523 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:13.750011 28621 consensus_peers.cc:597] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:13.750631 28621 consensus_peers.cc:597] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:13.751201 28621 consensus_peers.cc:597] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:13.751816 28621 consensus_peers.cc:597] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:13.753070 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:13.762925 29224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.041s
W20260709 13:14:13.763324 29224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.005s	sys 0.041s
I20260709 13:14:13.764150 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220dd03eba974f23a47374679c6d2fb7" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.766748 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e868dee9130744a3bc9fab23a236b03a" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.767408 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d00e421d5e40fb93fa17b07c0e88a3" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.772085 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.773038  3870 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:13.773685 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce221ba4bb64300a7d2ae39b8b95b77" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.773594  3870 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.775137 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6003600bf2df4ecbaeff7fa53e044e91" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.775676  3870 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:13.776515 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce0ec29e76b45f59ccace895ac58f28" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.777969 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.780802 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220149aed66a471b9a682f9229ae53fd" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.789821 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8877b0f244204425983fb5d505497cf3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:13.792079 29223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.012s	sys 0.040s
W20260709 13:14:13.792435 29223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.012s	sys 0.040s
I20260709 13:14:13.797802 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb791c0c5eb14aff83f666f36ab82a30" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:13.806147  3835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.005s	sys 0.006s
W20260709 13:14:13.806602  3835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.005s	sys 0.006s
W20260709 13:14:13.811256 28693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.039s	sys 0.080s
W20260709 13:14:13.811668 28693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.040s	sys 0.081s
I20260709 13:14:13.816473 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0bc7b3c800463996a3d14ce7e5786f" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:13.821228 29222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.013s	sys 0.032s
W20260709 13:14:13.821707 29222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.013s	sys 0.032s
I20260709 13:14:13.857628 28622 leader_election.cc:304] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:13.858600 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8522d0aafd845c3b071def21aaaec24" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:13.859014  3558 raft_consensus.cc:2749] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:13.868736 28547 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:13.873188  3882 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:13.874902 28621 consensus_peers.cc:597] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:13.876878 28547 leader_election.cc:304] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:13.877888  3568 raft_consensus.cc:2749] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:13.879364 28547 leader_election.cc:304] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:13.880162  3568 raft_consensus.cc:2749] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:13.882511 28547 leader_election.cc:304] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:13.883368  3568 raft_consensus.cc:2749] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:13.883978 28547 leader_election.cc:304] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:13.885416 28547 leader_election.cc:304] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:13.883370 28470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 394) took 3614 ms. Trace:
I20260709 13:14:13.886178  3568 raft_consensus.cc:2749] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:13.887346  3882 raft_consensus.cc:2749] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:13.888994 28547 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:13.891167  3882 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:13.891491 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 64239.1us
I20260709 13:14:13.892540 28547 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:13.906461  3882 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:13.908470  3568 raft_consensus.cc:493] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.909170  3568 raft_consensus.cc:515] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:13.912627  3568 leader_election.cc:290] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:13.915315 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:13.886202 28470 rpcz_store.cc:276] 0709 13:14:10.269481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.197326 (+927845us) service_pool.cc:224] Handling call
0709 13:14:13.883290 (+2685964us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:13.135528 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:13.169187 (+ 33659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:13.169227 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:14:13.169245 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:13.170438 (+  1193us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:13.170513 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:13.170570 (+    57us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:14:13.172007 (+  1437us) tablet.cc:701] Row locks acquired
0709 13:14:13.172035 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:14:13.172247 (+   212us) write_op.cc:270] Start()
0709 13:14:13.172402 (+   155us) write_op.cc:276] Timestamp: P: 1783602853172181 usec, L: 0
0709 13:14:13.172433 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:14:13.225172 (+ 52739us) log.cc:844] Serialized 5159 byte log entry
0709 13:14:13.536539 (+311367us) op_driver.cc:464] REPLICATION: finished
0709 13:14:13.602287 (+ 65748us) write_op.cc:301] APPLY: starting
0709 13:14:13.602402 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:13.689215 (+ 86813us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:13.689354 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:13.731771 (+ 42417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:13.732048 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:14:13.732096 (+    48us) write_op.cc:312] APPLY: finished
0709 13:14:13.736697 (+  4601us) log.cc:844] Serialized 121 byte log entry
0709 13:14:13.736895 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:13.737064 (+   169us) write_op.cc:454] Released schema lock
0709 13:14:13.737114 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:13.737501 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:13.737531 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21620,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":65420,"apply.run_cpu_time_us":21457,"apply.run_wall_time_us":135206,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":525,"prepare.run_cpu_time_us":5613,"prepare.run_wall_time_us":89955,"replication_time_us":363897,"thread_start_us":27242,"threads_started":1}]]}
I20260709 13:14:13.915850 28547 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:13.923220  3568 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:13.926065 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:13.939810 28547 leader_election.cc:304] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:13.947258  3568 raft_consensus.cc:2749] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:13.954792 28547 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:13.955698  3882 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:13.956933 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8a47d75d1241b7acc3796f628c9196" candidate_uuid: "178f22d83287460fb8c0db0ba2799895" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:13.962530 28471 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43518 (request call id 380) took 11463 ms (client timeout 15000 ms). Trace:
W20260709 13:14:13.962965 28471 rpcz_store.cc:269] 0709 13:14:02.498684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.169110 (+5670426us) service_pool.cc:224] Handling call
0709 13:14:13.962366 (+5793256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":830,"reported_tablets":44}
I20260709 13:14:13.969861 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:13.975641 28470 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 17 to 19, leader changed from ed517a03edd141a798f07798667c1c04 (127.26.202.3) to 178f22d83287460fb8c0db0ba2799895 (127.26.202.1). New cstate: current_term: 19 leader_uuid: "178f22d83287460fb8c0db0ba2799895" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } }
I20260709 13:14:13.971633 27432 tablet_replica.cc:333] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
W20260709 13:14:13.976995 28695 consensus_peers.cc:597] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:13.978281 27432 raft_consensus.cc:2243] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.978929 27432 raft_consensus.cc:2272] T bd08c8d0651d4f21937f0b958dcaaba7 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.981307 28547 leader_election.cc:304] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f22d83287460fb8c0db0ba2799895; no voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04
I20260709 13:14:13.987690  3882 raft_consensus.cc:2749] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:13.988754 27432 tablet_replica.cc:333] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:13.989818 27432 raft_consensus.cc:2243] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:13.990525 27432 raft_consensus.cc:2272] T bdc0b4abdc504f32a67b93235778cdbc P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:13.994259 27432 tablet_replica.cc:333] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
W20260709 13:14:14.002023 28475 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43532 (request call id 393) took 20907 ms (client timeout 15000 ms). Trace:
W20260709 13:14:14.002573 28475 rpcz_store.cc:269] 0709 13:13:53.095169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.095476 (+   307us) service_pool.cc:224] Handling call
0709 13:14:14.001817 (+20906341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29174,"reported_tablets":45}
I20260709 13:14:14.006188 27432 raft_consensus.cc:2243] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.007537 27432 raft_consensus.cc:2272] T 74487246ff8b4903996c628e2ca7c948 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.012878 27432 tablet_replica.cc:333] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
W20260709 13:14:14.015280 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:14.021278 27432 raft_consensus.cc:2243] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.023777 27432 raft_consensus.cc:2272] T 220149aed66a471b9a682f9229ae53fd P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.027129 27432 tablet_replica.cc:333] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
W20260709 13:14:14.022348 29224 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:14.027801 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:14.029179  3874 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:14.031800 27432 raft_consensus.cc:2243] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.032564 27432 pending_rounds.cc:70] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Trying to abort 3 pending ops.
I20260709 13:14:14.032897 27432 pending_rounds.cc:77] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305637266560991232 op_type: NO_OP noop_request { }
I20260709 13:14:14.033466 27432 raft_consensus.cc:2889] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:14.033840 27432 pending_rounds.cc:77] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Aborting op as it isn't in flight: id { term: 13 index: 12 } timestamp: 7305637242351005696 op_type: NO_OP noop_request { }
I20260709 13:14:14.034294 27432 raft_consensus.cc:2889] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:14.034895 27432 pending_rounds.cc:77] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895: Aborting op as it isn't in flight: id { term: 11 index: 11 } timestamp: 7305637221281099776 op_type: NO_OP noop_request { }
I20260709 13:14:14.035318 27432 raft_consensus.cc:2889] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:14.035741 27432 raft_consensus.cc:2272] T fce221ba4bb64300a7d2ae39b8b95b77 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.043334 27432 tablet_replica.cc:333] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.045058 27432 raft_consensus.cc:2243] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.045924 27432 pending_rounds.cc:70] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Trying to abort 1 pending ops.
I20260709 13:14:14.046279 27432 pending_rounds.cc:77] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895: Aborting op as it isn't in flight: id { term: 16 index: 12 } timestamp: 7305637251832164352 op_type: NO_OP noop_request { }
I20260709 13:14:14.046767 27432 raft_consensus.cc:2889] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:14.047528 27432 raft_consensus.cc:2272] T eb791c0c5eb14aff83f666f36ab82a30 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.051139 27432 tablet_replica.cc:333] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.052595 27432 raft_consensus.cc:2243] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.053367 27432 raft_consensus.cc:2272] T 908e88869b314709ad606ff91b8da799 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.056970 27432 tablet_replica.cc:333] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.058089 27432 raft_consensus.cc:2243] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.059432 27432 raft_consensus.cc:2272] T 04a304ac38c74ef5af43514ad1732e01 P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.062696 27432 tablet_replica.cc:333] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.063726 27432 raft_consensus.cc:2243] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.064991 27432 raft_consensus.cc:2272] T 6caf9ec933124d00b3e0e2cfeccd317b P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.068176 27432 tablet_replica.cc:333] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.069120 27432 raft_consensus.cc:2243] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.069850 27432 raft_consensus.cc:2272] T 95579b54a2ec400081e0a348b2395dfc P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.073037 27432 tablet_replica.cc:333] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.074319 27432 raft_consensus.cc:2243] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.074965 27432 raft_consensus.cc:2272] T b644d4c5865d4fd89ed3c9e770e2eaac P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.078076 27432 tablet_replica.cc:333] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.079010 27432 raft_consensus.cc:2243] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.080322 27432 raft_consensus.cc:2272] T f91cfbc609274be4a869217b22fc197b P 178f22d83287460fb8c0db0ba2799895 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.102262 27432 tablet_replica.cc:333] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.103400 27432 raft_consensus.cc:2243] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.104599 27432 pending_rounds.cc:70] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Trying to abort 1 pending ops.
I20260709 13:14:14.104956 27432 pending_rounds.cc:77] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895: Aborting op as it isn't in flight: id { term: 19 index: 12 } timestamp: 7305637263803568128 op_type: NO_OP noop_request { }
I20260709 13:14:14.105446 27432 raft_consensus.cc:2889] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:14.105870 27432 raft_consensus.cc:2272] T e3680992ef7b48798cdf5ea60753f423 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.109033 27432 tablet_replica.cc:333] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.110067 27432 raft_consensus.cc:2243] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.111009 27432 raft_consensus.cc:2272] T 7c9f7022e7f24efaa9b25cb129729504 P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.114101 27432 tablet_replica.cc:333] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.115180 27432 raft_consensus.cc:2243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.116430 27432 raft_consensus.cc:2272] T 7cf5b8cf3c9a478da7deba36d7acbe96 P 178f22d83287460fb8c0db0ba2799895 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.123754 27432 tablet_replica.cc:333] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.124871 27432 raft_consensus.cc:2243] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.125593 27432 raft_consensus.cc:2272] T a8522d0aafd845c3b071def21aaaec24 P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.128827 27432 tablet_replica.cc:333] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.129734 27432 raft_consensus.cc:2243] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.131003 27432 raft_consensus.cc:2272] T 2ae379c498ad42cb8a8201bd2640f6e3 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.134943 27432 tablet_replica.cc:333] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.135910 27432 raft_consensus.cc:2243] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.136950 27432 raft_consensus.cc:2272] T b905a9410ce147d093be203901159c35 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.148785 27432 tablet_replica.cc:333] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.149087 28472 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43526 (request call id 384) took 1197 ms. Trace:
I20260709 13:14:14.149556 28472 rpcz_store.cc:276] 0709 13:14:12.951315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.951462 (+   147us) service_pool.cc:224] Handling call
0709 13:14:14.148952 (+1197490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2874,"reported_tablets":40}
I20260709 13:14:14.149991 27432 raft_consensus.cc:2243] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.151425 27432 raft_consensus.cc:2272] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P 178f22d83287460fb8c0db0ba2799895 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.154857 27432 tablet_replica.cc:333] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.156154 27432 raft_consensus.cc:2243] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.157361 27432 raft_consensus.cc:2272] T 07a2389891a145aeb0c85e04f061855a P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.160211 27432 tablet_replica.cc:333] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.161114 27432 raft_consensus.cc:2243] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.161754 27432 pending_rounds.cc:70] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Trying to abort 1 pending ops.
I20260709 13:14:14.162046 27432 pending_rounds.cc:77] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895: Aborting op as it isn't in flight: id { term: 19 index: 16 } timestamp: 7305637241045032960 op_type: NO_OP noop_request { }
I20260709 13:14:14.162467 27432 raft_consensus.cc:2889] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:14.162864 27432 raft_consensus.cc:2272] T e1d00e421d5e40fb93fa17b07c0e88a3 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.166589 27432 tablet_replica.cc:333] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.167712 27432 raft_consensus.cc:2243] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.168912 27432 raft_consensus.cc:2272] T 55ea2a86b4ee4d399b9b439246c9d92a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.172013 27432 tablet_replica.cc:333] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.173024 27432 raft_consensus.cc:2243] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.173744 27432 raft_consensus.cc:2272] T 5f0bc7b3c800463996a3d14ce7e5786f P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.176743 27432 tablet_replica.cc:333] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.177600 27432 raft_consensus.cc:2243] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.178216 27432 raft_consensus.cc:2272] T 8a8a47d75d1241b7acc3796f628c9196 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.182138 27432 tablet_replica.cc:333] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.183145 27432 raft_consensus.cc:2243] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.184022 27432 raft_consensus.cc:2272] T 4ce0ec29e76b45f59ccace895ac58f28 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.186995 27432 tablet_replica.cc:333] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.188004 27432 raft_consensus.cc:2243] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.194172 27432 raft_consensus.cc:2272] T 507239c483484d3abb552ab606bfd45c P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.200232 27432 tablet_replica.cc:333] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.203495 27432 raft_consensus.cc:2243] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.204280 27432 raft_consensus.cc:2272] T 220dd03eba974f23a47374679c6d2fb7 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.210626 27432 tablet_replica.cc:333] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
W20260709 13:14:14.286806 28677 debug-util.cc:398] Leaking SignalData structure 0x7b08001228c0 after lost signal to thread 27435
W20260709 13:14:14.310150 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800343a40 after lost signal to thread 28513
W20260709 13:14:14.310784 28677 debug-util.cc:398] Leaking SignalData structure 0x7b08000ef000 after lost signal to thread 28605
W20260709 13:14:14.311880 28677 debug-util.cc:398] Leaking SignalData structure 0x7b080034f660 after lost signal to thread 28680
W20260709 13:14:14.312970 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800340c40 after lost signal to thread 28754
W20260709 13:14:14.314435 28677 debug-util.cc:398] Leaking SignalData structure 0x7b08003eaee0 after lost signal to thread 29286
W20260709 13:14:14.315021 28677 debug-util.cc:398] Leaking SignalData structure 0x7b0800133520 after lost signal to thread 3856
I20260709 13:14:14.321704 27432 raft_consensus.cc:2243] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.344372 27432 raft_consensus.cc:2272] T 6003600bf2df4ecbaeff7fa53e044e91 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:14.375679 28695 consensus_peers.cc:597] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:14.376502 27432 tablet_replica.cc:333] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.379513 27432 raft_consensus.cc:2243] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.384497 27432 raft_consensus.cc:2272] T 1fc836b2fe6541889bfb8d09a2bc3d2c P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:14.407672 28621 consensus_peers.cc:597] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:14.413655 27432 tablet_replica.cc:333] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.418723 27432 raft_consensus.cc:2243] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:14.420727 27437 debug-util.cc:398] Leaking SignalData structure 0x7b0800351e40 after lost signal to thread 3835
I20260709 13:14:14.421304 27432 raft_consensus.cc:2272] T ed9ebd651cf34b18b29911e247dc9834 P 178f22d83287460fb8c0db0ba2799895 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.445909 27432 tablet_replica.cc:333] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.447072 27432 raft_consensus.cc:2243] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.448642 27432 raft_consensus.cc:2272] T 4fbdeb3c093d412b871d55add092cb37 P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.469574 27432 tablet_replica.cc:333] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.478650 27432 raft_consensus.cc:2243] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.493418 27432 raft_consensus.cc:2272] T 50de2f4297b44d57a1acdb6f6af1f02f P 178f22d83287460fb8c0db0ba2799895 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.500041 27432 tablet_replica.cc:333] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.500900 27432 raft_consensus.cc:2243] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.501629 27432 raft_consensus.cc:2272] T f8259ae9bad54fb1b2f26e7b813a8bd6 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.526152 27432 tablet_replica.cc:333] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.527127 27432 raft_consensus.cc:2243] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.527807 27432 raft_consensus.cc:2272] T 61d9db35d52e47849f6205fef1ea841a P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.536316 27432 tablet_replica.cc:333] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.537209 27432 raft_consensus.cc:2243] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.537808 27432 raft_consensus.cc:2272] T a9b5276724f2468eb1927555abdfcc2a P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.540913 27432 tablet_replica.cc:333] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.541826 27432 raft_consensus.cc:2243] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.546401 27432 raft_consensus.cc:2272] T 6ed00f783ec545f7a156d77cd9062498 P 178f22d83287460fb8c0db0ba2799895 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.549528 27432 tablet_replica.cc:333] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.550318 27432 raft_consensus.cc:2243] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.551550 27432 raft_consensus.cc:2272] T aee1d5c683234ed9969b70eb583d0724 P 178f22d83287460fb8c0db0ba2799895 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.564600 27432 tablet_replica.cc:333] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.565625 27432 raft_consensus.cc:2243] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:14:14.576366 29224 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:14.581060 27432 raft_consensus.cc:2272] T 5080a9ad719842a1b28d579fb99c6282 P 178f22d83287460fb8c0db0ba2799895 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.591974 27432 tablet_replica.cc:333] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.592960 27432 raft_consensus.cc:2243] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.593763 27432 raft_consensus.cc:2272] T 35fc728c038d4d8d8827779516ffce5f P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.597110 27432 tablet_replica.cc:333] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
W20260709 13:14:14.597833 28621 consensus_peers.cc:597] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:14.605155 27432 raft_consensus.cc:2243] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.606523 27432 raft_consensus.cc:2272] T 788a727f92304a5a9926b2f15933af88 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.609618 27432 tablet_replica.cc:333] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.610387 27432 raft_consensus.cc:2243] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:14.624053 28621 consensus_peers.cc:597] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:14.639295 27432 raft_consensus.cc:2272] T 3d30c923964844ccad86f6776b30b074 P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.642608 27432 tablet_replica.cc:333] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.643426 27432 raft_consensus.cc:2243] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.644552 27432 raft_consensus.cc:2272] T c5e88af67eea4aa588b7cf82a03a9c3d P 178f22d83287460fb8c0db0ba2799895 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.649884 27432 tablet_replica.cc:333] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.655921 27432 raft_consensus.cc:2243] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:14.657207 27432 raft_consensus.cc:2272] T cbbd878f3c5b4d8f829666660878c2ef P 178f22d83287460fb8c0db0ba2799895 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:14.660142 27432 tablet_replica.cc:333] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895: stopping tablet replica
I20260709 13:14:14.660888 27432 raft_consensus.cc:2243] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:14.661590 27432 raft_consensus.cc:2272] T e868dee9130744a3bc9fab23a236b03a P 178f22d83287460fb8c0db0ba2799895 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:14.788595 29224 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:14.881995 28695 consensus_peers.cc:597] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:14.916183 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:14.941469 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:14.953322 28695 consensus_peers.cc:597] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:15.020578 29224 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:15.079185 28695 consensus_peers.cc:597] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:15.157990  3815 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.158675  3815 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:15.184332 28621 leader_election.cc:336] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.188030 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.190227 28620 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:15.192517  3851 raft_consensus.cc:2749] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:15.193938  3815 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:15.197307 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:15.250772  3888 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.251480  3888 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:15.253366 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:15.255506 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:15.253865  3888 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:15.260763 28695 leader_election.cc:336] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.265856 28696 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:15.266745  3888 raft_consensus.cc:2749] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:15.268323  3888 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.268802  3888 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.270886  3888 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:15.272313 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:15.279075 28695 leader_election.cc:336] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:15.276103 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 86007.3us
I20260709 13:14:15.281327 28695 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:15.283110  3888 raft_consensus.cc:2749] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:15.323762  3888 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.324352  3869 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.325044  3869 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.327412  3869 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:15.324384  3888 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.330502  3888 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:15.336602 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:15.336781 28649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:15.359194  3894 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.359829  3894 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.362619  3894 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:15.388302 28695 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.388849 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.389843  3888 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:14:15.403216 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 86620us
I20260709 13:14:15.411659  3899 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.412369  3899 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.421167  3815 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.421787  3815 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.424046  3815 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:15.428933 28621 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.442716 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
W20260709 13:14:15.448379 29224 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:15.473368  3888 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:15.473439 29224 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:15.474071  3888 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.476595  3888 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:15.466900 28695 leader_election.cc:336] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.477653 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.467398  3899 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.478619  3888 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:15.479667 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 68345.9us
W20260709 13:14:15.470904 28621 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.485123  3899 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.485775  3899 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.504422 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:15.505453 28651 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 23.
I20260709 13:14:15.524922  3899 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.531827 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:14:15.535205 28621 leader_election.cc:336] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.537338  3815 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.537958  3815 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.540441  3815 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.542757  3888 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:15.543270  3888 raft_consensus.cc:493] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.543732  3888 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:15.555181  3894 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.556139  3894 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.568635 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.569419 28721 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 22.
I20260709 13:14:15.571242 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:15.573305  3876 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:15.573848  3876 raft_consensus.cc:493] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.574568  3876 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:14:15.580163 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 48440.8us
I20260709 13:14:15.580255  3815 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.581157  3815 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.584879 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:15.586055  3869 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.586688  3869 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.587221  3815 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:15.590602  3894 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.592638 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.594040  3869 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:15.601481 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.605556 28726 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 23.
I20260709 13:14:15.607218 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.596856  3815 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.607843 28726 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 18.
W20260709 13:14:15.608099 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 100161us
I20260709 13:14:15.611088  3815 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.617568 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:15.615003 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.617223 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.621625 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:15.624900  3899 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:15.625059 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.625474 29252 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 21.
I20260709 13:14:15.619199  3888 raft_consensus.cc:515] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.628628  3888 leader_election.cc:290] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:15.629650 28621 leader_election.cc:336] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:15.630293 28621 leader_election.cc:336] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.630621 28621 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:15.633988  3851 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:15.634501  3851 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.634876  3851 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.629484 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:15.625401  3899 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:15.613354 29224 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:15.636368 29224 leader_election.cc:336] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.636987 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.638970 28620 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:15.639199  3903 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:15.640062  3889 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:15.618988  3815 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:15.637691  3899 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:15.646143  3815 raft_consensus.cc:2749] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:15.647773  3815 raft_consensus.cc:2749] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:15.654438  3851 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.658660  3889 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.641026  3903 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.659323  3889 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:15.660202 28695 consensus_peers.cc:597] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:15.662755 28695 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.663645  3903 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:15.664286  3851 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.665727  3899 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.662130  3902 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.666280  3851 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:15.666857 28695 leader_election.cc:336] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.693888  3902 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.694020  3851 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.696381  3902 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:15.668257  3894 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.696424  3851 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.697178  3894 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.699692  3894 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.670433  3889 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:15.635804  3876 raft_consensus.cc:515] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.701592  3899 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.703514  3876 leader_election.cc:290] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:15.678227 28621 leader_election.cc:336] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.703594  3903 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.683917 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:15.683880  3905 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:15.693063 29224 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:15.704169 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.705585 28721 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 16.
I20260709 13:14:15.705363  3905 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:15.705623 29224 leader_election.cc:336] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:15.685470 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 46580.6us
W20260709 13:14:15.708153 28695 leader_election.cc:336] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.710091 28721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55ea2a86b4ee4d399b9b439246c9d92a" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:15.710705 28721 raft_consensus.cc:3060] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:15.712412 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a304ac38c74ef5af43514ad1732e01" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:15.712937 29252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a2389891a145aeb0c85e04f061855a" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:15.713519 29252 raft_consensus.cc:3060] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:15.713949 28621 leader_election.cc:336] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.709705 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:15.707697  3905 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.717344 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:15.712985 28655 raft_consensus.cc:3060] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:15.718335 28651 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:14:15.719635  3894 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:15.719825 28620 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:15.720204  3894 raft_consensus.cc:493] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.720593  3894 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:15.722347  3851 raft_consensus.cc:2749] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:15.729914 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.730409 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91cfbc609274be4a869217b22fc197b" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:15.730598 28728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.730751 28724 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
I20260709 13:14:15.731015 28729 raft_consensus.cc:3060] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:15.732669  3903 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:15.738927 28721 raft_consensus.cc:2468] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 23.
I20260709 13:14:15.739720 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae379c498ad42cb8a8201bd2640f6e3" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:15.740051 29223 leader_election.cc:304] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:15.740298 28726 raft_consensus.cc:3060] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.740864  3876 raft_consensus.cc:2804] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:15.741382  3876 raft_consensus.cc:697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 23 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:15.742259  3876 consensus_queue.cc:237] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.735754 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.749330 28655 raft_consensus.cc:2468] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 24.
I20260709 13:14:15.749047  3902 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:15.753865 28621 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.755642 29252 raft_consensus.cc:2468] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 22.
I20260709 13:14:15.753751 28729 raft_consensus.cc:2468] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 24.
I20260709 13:14:15.752687 28726 raft_consensus.cc:2468] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 19.
W20260709 13:14:15.754386 28621 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.758093 28622 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
W20260709 13:14:15.759959 28621 leader_election.cc:336] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.758850 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
W20260709 13:14:15.760938 28621 leader_election.cc:336] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.761610 28695 leader_election.cc:304] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.762635  3888 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:15.763068  3888 raft_consensus.cc:493] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.763481  3888 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:15.765406  3905 raft_consensus.cc:2804] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:15.766860  3905 raft_consensus.cc:697] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:15.767858  3905 consensus_queue.cc:237] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:15.778249 28621 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:15.778767 28621 consensus_peers.cc:597] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:15.781776  3888 raft_consensus.cc:515] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.784571  3888 leader_election.cc:290] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:15.788287  3902 raft_consensus.cc:2804] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:14:15.788738 28695 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.792441  3902 raft_consensus.cc:697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 24 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:15.793556  3902 consensus_queue.cc:237] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:15.796535 29224 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111) [suppressed 281 similar messages]
W20260709 13:14:15.797389 29224 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.797801 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.802075 28620 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:15.802407 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507239c483484d3abb552ab606bfd45c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:15.802965 28651 raft_consensus.cc:3060] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:15.803944  3900 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:15.811851 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.813289  3851 raft_consensus.cc:2749] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:15.814085  3851 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:15.814486  3851 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.814864  3851 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:15.815092 28620 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.815893  3899 raft_consensus.cc:2804] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:15.816272 28620 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:15.816462  3899 raft_consensus.cc:697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:15.819578  3905 raft_consensus.cc:2804] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:15.820073  3905 raft_consensus.cc:697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:15.819926  3899 consensus_queue.cc:237] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.820982  3905 consensus_queue.cc:237] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.817395  3894 raft_consensus.cc:515] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:15.826445 29224 leader_election.cc:336] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:15.829846 29224 leader_election.cc:336] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.826120 28472 catalog_manager.cc:5697] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 21 to 22, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 22 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.814023 28651 raft_consensus.cc:2468] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:14:15.849772  3906 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.850960  3906 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.861799 28470 catalog_manager.cc:5697] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 22 to 23, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 23 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:15.864774 27432 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28602)
I20260709 13:14:15.872262  3906 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:15.877800 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:15.878463 29251 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 16.
I20260709 13:14:15.903653  3918 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
W20260709 13:14:15.905140 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 60729.3us
I20260709 13:14:15.908838 28695 leader_election.cc:304] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:15.877426  3902 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.917526 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:15.918675  3906 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:15.918910  3916 raft_consensus.cc:2804] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:15.919229  3906 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.904695  3918 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.919799  3906 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:15.923640  3918 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.905334  3851 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.933264 28475 catalog_manager.cc:5697] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 23 to 24, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 24 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.944489 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:15.934617  3904 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.949164  3904 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:15.952271  3904 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:15.956775 28621 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:15.957168 28695 leader_election.cc:336] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.961990  3894 leader_election.cc:290] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:15.975262 29223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 95966.5us
I20260709 13:14:15.976342 28722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b905a9410ce147d093be203901159c35" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:15.976953 28722 raft_consensus.cc:3060] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:15.976374 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:15.917678  3902 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:15.981403 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6caf9ec933124d00b3e0e2cfeccd317b" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:15.989251 28726 raft_consensus.cc:3060] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:15.986606 28621 leader_election.cc:336] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:15.990126 29224 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:15.989980 28621 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:15.987540  3901 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:15.987804  3851 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:15.995709  3916 raft_consensus.cc:697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 20 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:14:15.996945 28621 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:15.997663 28621 leader_election.cc:336] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:15.998199  3911 raft_consensus.cc:2749] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:15.998121 28621 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:15.999487  3899 raft_consensus.cc:2749] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:15.997208  3916 consensus_queue.cc:237] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.001430 28726 raft_consensus.cc:2468] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 17.
I20260709 13:14:16.003716 29223 leader_election.cc:304] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:16.000243  3901 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:16.007402  3901 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:16.009414  3901 raft_consensus.cc:2804] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:16.010066  3888 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:16.010432  3901 raft_consensus.cc:697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:16.010646  3888 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.011925  3901 consensus_queue.cc:237] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:16.012919  3888 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:16.015519 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:16.016189 28655 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 22.
W20260709 13:14:16.017522 28621 consensus_peers.cc:597] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:16.017717 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:16.018445  3923 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:16.018894  3923 raft_consensus.cc:493] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:16.019270  3923 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:14:16.019680 28695 leader_election.cc:336] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:16.015527 28722 raft_consensus.cc:2468] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 20.
I20260709 13:14:16.022140 28620 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:16.023423  3904 raft_consensus.cc:2804] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:16.023905  3902 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:16.024266  3904 raft_consensus.cc:697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:16.024744 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:16.025460 28655 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:14:16.039109  3904 consensus_queue.cc:237] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.040985 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:16.057505 28655 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 15.
I20260709 13:14:16.041219  3888 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:16.059001  3888 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.020460  3906 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:16.044229 28695 leader_election.cc:336] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:16.064663 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:16.066179 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50de2f4297b44d57a1acdb6f6af1f02f" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0"
I20260709 13:14:16.066478  3902 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:16.066866 29251 raft_consensus.cc:3060] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:16.067019  3902 raft_consensus.cc:493] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:16.067492  3902 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:16.047391 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:16.064757  3906 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:16.074923  3919 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:16.075372  3919 raft_consensus.cc:493] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:16.075726  3919 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:16.077268  3894 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:16.077817  3894 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:16.078720 29251 raft_consensus.cc:2468] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0ecde0af494dc9b152dee191c6d3e6 in term 17.
I20260709 13:14:16.079896 28622 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:16.080042  3894 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:16.080718  3906 raft_consensus.cc:2804] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:16.081259  3906 raft_consensus.cc:697] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Becoming Leader. State: Replica: 0c0ecde0af494dc9b152dee191c6d3e6, State: Running, Role: LEADER
I20260709 13:14:16.082129  3906 consensus_queue.cc:237] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:16.087149  3888 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:16.092630 28695 leader_election.cc:336] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:16.054494  3923 raft_consensus.cc:515] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.101493 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:16.102349 28651 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
W20260709 13:14:16.105527 29224 leader_election.cc:336] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:16.106788 29224 leader_election.cc:336] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:16.109476 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" is_pre_election: true
I20260709 13:14:16.110335 28655 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 19.
I20260709 13:14:16.112649 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:16.120909  3869 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:16.125212  3869 raft_consensus.cc:493] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:16.131304  3869 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:16.129881 28621 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:16.145586 28621 consensus_peers.cc:597] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:16.146890  3923 leader_election.cc:290] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:16.145898 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:16.161897 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5080a9ad719842a1b28d579fb99c6282" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:16.162611 28651 raft_consensus.cc:3060] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:16.163992  3869 raft_consensus.cc:515] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:16.169703 29224 leader_election.cc:336] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:16.170634 28651 raft_consensus.cc:2468] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 23.
I20260709 13:14:16.175042 28695 leader_election.cc:304] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:16.161906  3920 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:16.176699  3920 raft_consensus.cc:493] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 178f22d83287460fb8c0db0ba2799895)
I20260709 13:14:16.177125  3920 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:16.179594  3869 leader_election.cc:290] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:16.180500 28621 consensus_peers.cc:597] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:16.195811 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbbd878f3c5b4d8f829666660878c2ef" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:16.187692  3920 raft_consensus.cc:515] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:16.196838 28655 raft_consensus.cc:3060] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:16.198493 28695 leader_election.cc:336] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:16.199317  3919 raft_consensus.cc:515] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:16.201202  3920 leader_election.cc:290] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:16.216375 28651 raft_consensus.cc:1275] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:14:16.189384  3869 raft_consensus.cc:2804] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:16.219296  3869 raft_consensus.cc:697] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 23 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:16.220362  3869 consensus_queue.cc:237] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.206063 28655 raft_consensus.cc:2468] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 20.
I20260709 13:14:16.209527  3902 raft_consensus.cc:515] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.230871  3902 leader_election.cc:290] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:16.215348 28695 leader_election.cc:336] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:16.238031  3902 consensus_queue.cc:1048] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:16.238456 28695 leader_election.cc:304] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:16.240428  3902 raft_consensus.cc:2804] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:16.241063  3902 raft_consensus.cc:697] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 20 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
W20260709 13:14:16.241888 28695 consensus_peers.cc:597] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.242102  3902 consensus_queue.cc:237] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.203336  3919 leader_election.cc:290] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Requested vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:16.278874 28470 catalog_manager.cc:5697] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 23 to 24, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 24 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.279597 28472 catalog_manager.cc:5697] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 16 to 17, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 17 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.285709 28651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788a727f92304a5a9926b2f15933af88" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:16.286332 28651 raft_consensus.cc:3060] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:16.290376 28695 leader_election.cc:336] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:16.285192 28470 catalog_manager.cc:5697] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 18 to 19, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 19 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.294777 28470 catalog_manager.cc:5697] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 19 to 20, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 20 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.296939 28470 catalog_manager.cc:5697] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 reported cstate change: term changed from 16 to 17, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2). New cstate: current_term: 17 leader_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.301668 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee1d5c683234ed9969b70eb583d0724" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:16.302450 28655 raft_consensus.cc:3060] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:16.303226 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e88af67eea4aa588b7cf82a03a9c3d" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0c0ecde0af494dc9b152dee191c6d3e6"
I20260709 13:14:16.303783 28652 raft_consensus.cc:3060] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:16.312196 28652 raft_consensus.cc:2468] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 22.
W20260709 13:14:16.313963 29224 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:16.314105 28621 consensus_peers.cc:597] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:14:16.327154 28651 raft_consensus.cc:2468] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 22.
I20260709 13:14:16.331625 29224 leader_election.cc:304] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:16.332580  3912 raft_consensus.cc:2804] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:16.333149  3912 raft_consensus.cc:697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:16.333981  3912 consensus_queue.cc:237] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:16.339802 28655 raft_consensus.cc:2468] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed517a03edd141a798f07798667c1c04 in term 16.
I20260709 13:14:16.341626 29224 leader_election.cc:304] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0; no voters: 
I20260709 13:14:16.343832 28695 leader_election.cc:304] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04; no voters: 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:16.347432  3923 raft_consensus.cc:2804] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:16.349401  3923 raft_consensus.cc:697] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Becoming Leader. State: Replica: ed517a03edd141a798f07798667c1c04, State: Running, Role: LEADER
I20260709 13:14:16.343328  3919 raft_consensus.cc:2804] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:16.350332  3923 consensus_queue.cc:237] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:16.350921  3919 raft_consensus.cc:697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:16.351796  3919 consensus_queue.cc:237] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:16.357650 28621 consensus_peers.cc:597] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:16.358194 28621 consensus_peers.cc:597] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:16.359359 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:16.359938 29224 leader_election.cc:336] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:16.363034 29224 leader_election.cc:336] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:16.368944 29224 consensus_peers.cc:597] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.369750 29251 raft_consensus.cc:1275] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:16.373687 28722 raft_consensus.cc:1275] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:16.373759 28729 raft_consensus.cc:1275] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:14:16.372591 28475 catalog_manager.cc:5697] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 19 to 20, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 20 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.375756  3900 consensus_queue.cc:1048] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:14:16.376106  3899 consensus_queue.cc:1048] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:14:16.373579 28621 consensus_peers.cc:597] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.382645 28475 catalog_manager.cc:5697] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 22 to 23, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 23 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.386797 28475 catalog_manager.cc:5697] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 19 to 20, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 20 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.389782  3905 consensus_queue.cc:1048] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:14:16.409351 28695 consensus_peers.cc:597] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:16.425586 28726 raft_consensus.cc:1275] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:14:16.463429  3851 consensus_queue.cc:1048] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
W20260709 13:14:16.504930 29224 consensus_peers.cc:597] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.534171 28475 catalog_manager.cc:5697] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 21 to 22, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 22 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.536013 28475 catalog_manager.cc:5697] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 21 to 22, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 22 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.545380 28472 catalog_manager.cc:5697] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 reported cstate change: term changed from 15 to 16, leader changed from 178f22d83287460fb8c0db0ba2799895 (127.26.202.1) to ed517a03edd141a798f07798667c1c04 (127.26.202.3). New cstate: current_term: 16 leader_uuid: "ed517a03edd141a798f07798667c1c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:16.583935 28726 raft_consensus.cc:1275] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:14:16.587498 28722 raft_consensus.cc:1275] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:14:16.588052 28695 consensus_peers.cc:597] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.592810  3889 consensus_queue.cc:1048] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:14:16.599895 28621 consensus_peers.cc:597] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:16.600737 28621 consensus_peers.cc:597] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.601630  3903 consensus_queue.cc:1048] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:16.611037 29251 raft_consensus.cc:1275] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Refusing update from remote peer 0c0ecde0af494dc9b152dee191c6d3e6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:14:16.613770  3851 consensus_queue.cc:1048] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:16.624538 28649 raft_consensus.cc:1275] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:16.631872  3941 consensus_queue.cc:1048] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:14:16.676422 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:16.680022 28649 raft_consensus.cc:1275] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:16.695325  3916 consensus_queue.cc:1048] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:14:16.721252 28695 consensus_peers.cc:597] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.723625 28649 raft_consensus.cc:1275] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:16.733819  3902 consensus_queue.cc:1048] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:14:16.740463 28695 consensus_peers.cc:597] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:16.753469 28695 consensus_peers.cc:597] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:16.790865 28621 consensus_peers.cc:597] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:16.791889 28695 consensus_peers.cc:597] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.804842 28655 raft_consensus.cc:1275] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Refusing update from remote peer ed517a03edd141a798f07798667c1c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:16.810611  3888 consensus_queue.cc:1048] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:14:16.836416 29224 consensus_peers.cc:597] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.862145 28654 raft_consensus.cc:1275] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:14:16.865422 28654 raft_consensus.cc:1275] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Refusing update from remote peer d64d870625d6461b89b1fb75cd2e26e0: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:14:16.866173 27432 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 28602)
I20260709 13:14:16.873994  3920 consensus_queue.cc:1048] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:14:16.875135  3951 consensus_queue.cc:1048] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:14:16.969449 29224 consensus_peers.cc:597] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:16.981707 28621 consensus_peers.cc:597] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.132534 28621 consensus_peers.cc:597] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.253865 29224 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.335929 29224 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.439422 28695 consensus_peers.cc:597] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.466650 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.622913 28695 consensus_peers.cc:597] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.714000 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.720393 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.723796 29224 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:17.727466 28695 consensus_peers.cc:597] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.775844 29224 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.810160 29224 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.866677 27432 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 28602)
W20260709 13:14:17.890884 29224 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:17.952788 29224 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:18.018700 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:18.249440 28621 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:18.262820 28621 consensus_peers.cc:597] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:18.290578 28695 consensus_peers.cc:597] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:18.431514 28621 consensus_peers.cc:597] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:18.458415 29224 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:18.633275 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:18.726881 28621 consensus_peers.cc:597] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:18.816484 28621 consensus_peers.cc:597] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:18.847491 28621 consensus_peers.cc:597] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:18.858273 28695 consensus_peers.cc:597] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:18.867182 27432 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 28602)
W20260709 13:14:18.878788 28621 consensus_peers.cc:597] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:18.896582 28695 consensus_peers.cc:597] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:18.907684 29224 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:18.926023 28621 consensus_peers.cc:597] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:18.929273 28621 consensus_peers.cc:597] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:18.943374 28621 consensus_peers.cc:597] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:19.005048 29224 consensus_peers.cc:597] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.111513 28621 consensus_peers.cc:597] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.113452 29224 consensus_peers.cc:597] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.114130 28695 consensus_peers.cc:597] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.284329 28621 consensus_peers.cc:597] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:19.316735 28695 consensus_peers.cc:597] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.372628 29224 consensus_peers.cc:597] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.381507 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 135873us
W20260709 13:14:19.473701 28695 consensus_peers.cc:597] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:19.474295 28621 consensus_peers.cc:597] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:19.510637 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:19.527336 28695 consensus_peers.cc:597] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.528270 28621 consensus_peers.cc:597] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:19.570746 28695 consensus_peers.cc:597] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.639676 29224 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:19.680569 29224 consensus_peers.cc:597] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:19.786121 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 47626.9us
W20260709 13:14:19.867677 27432 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 28602)
W20260709 13:14:19.996896 28695 consensus_peers.cc:597] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.044247 29224 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.045286 29224 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:20.052402 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 54526.7us
W20260709 13:14:20.107313 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.108383 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.111256 28695 consensus_peers.cc:597] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.261247 29224 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.269304 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.389171 29224 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.461444 28695 consensus_peers.cc:597] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.500546 29224 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.535584 29224 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.757722 28621 consensus_peers.cc:597] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:20.822737 28621 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:20.823449 28621 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111) [suppressed 436 similar messages]
W20260709 13:14:20.846362 28621 consensus_peers.cc:597] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:20.861367 28695 consensus_peers.cc:597] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:20.869071 27432 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 28602)
W20260709 13:14:20.974100 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:21.132649 28621 consensus_peers.cc:597] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:21.155406 29224 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:21.156621 28621 consensus_peers.cc:597] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.235791 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:21.274020 28621 consensus_peers.cc:597] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:21.473436 28695 consensus_peers.cc:597] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:21.488298 28621 consensus_peers.cc:597] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.522629 28621 consensus_peers.cc:597] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.538551 28621 consensus_peers.cc:597] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.543988 28695 consensus_peers.cc:597] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.555697 28695 consensus_peers.cc:597] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.577950 28621 consensus_peers.cc:597] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.659226 29224 consensus_peers.cc:597] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.667245 28621 consensus_peers.cc:597] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:21.748062 28621 consensus_peers.cc:597] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:21.774417 28621 consensus_peers.cc:597] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:21.776891 29224 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:21.783066 29224 consensus_peers.cc:597] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.869647 27432 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 28602)
W20260709 13:14:21.913252 28695 consensus_peers.cc:597] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:21.919904 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 49154.1us
W20260709 13:14:21.967834 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 61878.3us
W20260709 13:14:22.033330 28621 consensus_peers.cc:597] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.041815 29224 consensus_peers.cc:597] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:22.160135 28695 consensus_peers.cc:597] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.354617 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:22.367998 29224 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.367051 28695 consensus_peers.cc:597] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:22.389986 28695 consensus_peers.cc:597] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.408797 29224 consensus_peers.cc:597] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:22.427386 28695 consensus_peers.cc:597] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:22.436448 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.502344 29224 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.602048 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.684152 29224 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:22.755586 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.871299 27432 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 28602)
W20260709 13:14:22.873584 28695 consensus_peers.cc:597] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.926783 29224 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:22.942413 28621 consensus_peers.cc:597] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:23.119092 28695 consensus_peers.cc:597] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:23.139297 29224 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:23.187724 29224 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:23.194856 29224 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:23.209493 28621 consensus_peers.cc:597] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:23.312266 28621 consensus_peers.cc:597] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:23.314759 28695 consensus_peers.cc:597] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:23.659009 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:36115, user_credentials={real_user=slave}} blocked reactor thread for 123748us
W20260709 13:14:23.701959 28620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:40339, user_credentials={real_user=slave}} blocked reactor thread for 204192us
W20260709 13:14:23.746017 28621 consensus_peers.cc:597] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:23.754335 28621 consensus_peers.cc:597] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:23.765302 29224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 54808.3us
W20260709 13:14:23.802249 28621 consensus_peers.cc:597] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:23.843057 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:23.886324 28695 consensus_peers.cc:597] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:24.714110 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:38541, user_credentials={real_user=slave}} blocked reactor thread for 85541.6us
I20260709 13:14:24.720082  4008 raft_consensus.cc:493] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d64d870625d6461b89b1fb75cd2e26e0)
I20260709 13:14:24.721385  4008 raft_consensus.cc:515] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:24.726841  4008 leader_election.cc:290] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:24.747854 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc0b4abdc504f32a67b93235778cdbc" candidate_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:24.775851 28621 consensus_peers.cc:597] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:24.779480 28695 consensus_peers.cc:597] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:24.780275 28695 consensus_peers.cc:597] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:24.780426 28621 consensus_peers.cc:597] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:24.780947 28621 consensus_peers.cc:597] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:24.781101 28695 consensus_peers.cc:597] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:24.781549 28695 consensus_peers.cc:597] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:24.781713 28621 consensus_peers.cc:597] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:24.782430 28621 consensus_peers.cc:597] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:24.782862 28621 consensus_peers.cc:597] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:24.783247 28621 leader_election.cc:336] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:24.783602 28621 leader_election.cc:304] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ecde0af494dc9b152dee191c6d3e6; no voters: 178f22d83287460fb8c0db0ba2799895, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:24.784258  4017 raft_consensus.cc:2749] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:24.784471 28621 consensus_peers.cc:597] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:24.810472 29224 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:24.811268 29224 consensus_peers.cc:597] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:24.811838 29224 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:24.814294 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:25.054423 29224 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:25.065209 28695 consensus_peers.cc:597] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:25.073297 28695 consensus_peers.cc:597] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:14:25.107617 27432 tablet_server.cc:196] TabletServer@127.26.202.1:0 shutdown complete.
W20260709 13:14:25.116873 29224 consensus_peers.cc:597] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:25.167661 29224 consensus_peers.cc:597] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:25.181149 29224 consensus_peers.cc:597] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:25.215461 28695 consensus_peers.cc:597] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:14:25.235155 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:25.260802 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:25.274601 28621 consensus_peers.cc:597] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:14:25.332320 27432 tablet_server.cc:179] TabletServer@127.26.202.2:0 shutting down...
W20260709 13:14:25.343212 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.357836 28695 consensus_peers.cc:597] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:25.396454 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:25.397671 27432 tablet_replica.cc:333] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.398461 27432 raft_consensus.cc:2243] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.399545 27432 raft_consensus.cc:2272] T 220149aed66a471b9a682f9229ae53fd P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.402334 27432 tablet_replica.cc:333] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.403376 27432 raft_consensus.cc:2243] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.404019 27432 raft_consensus.cc:2272] T bd08c8d0651d4f21937f0b958dcaaba7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.406735 27432 tablet_replica.cc:333] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.407378 27432 raft_consensus.cc:2243] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.408522 27432 raft_consensus.cc:2272] T 74487246ff8b4903996c628e2ca7c948 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.410987 27432 tablet_replica.cc:333] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.411610 27432 raft_consensus.cc:2243] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.412165 27432 raft_consensus.cc:2272] T bdc0b4abdc504f32a67b93235778cdbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.414412 27432 tablet_replica.cc:333] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.415032 27432 raft_consensus.cc:2243] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.415557 27432 raft_consensus.cc:2272] T fce221ba4bb64300a7d2ae39b8b95b77 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.417949 27432 tablet_replica.cc:333] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.418583 27432 raft_consensus.cc:2243] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.419263 27432 raft_consensus.cc:2272] T de05bba072764f32aeb479edb07a9d4b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.421967 27432 tablet_replica.cc:333] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.422986 27432 raft_consensus.cc:2243] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.423725 27432 raft_consensus.cc:2272] T 04a304ac38c74ef5af43514ad1732e01 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.426414 27432 tablet_replica.cc:333] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.427100 27432 raft_consensus.cc:2243] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.427785 27432 raft_consensus.cc:2272] T b445e2209eb343cf9d87aa63ba0becbc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.430452 27432 tablet_replica.cc:333] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.431277 27432 raft_consensus.cc:2243] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.432405 27432 raft_consensus.cc:2272] T 95579b54a2ec400081e0a348b2395dfc P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.435179 27432 tablet_replica.cc:333] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.435875 27432 raft_consensus.cc:2243] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.436554 27432 raft_consensus.cc:2272] T e3680992ef7b48798cdf5ea60753f423 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.438916 27432 tablet_replica.cc:333] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.439507 27432 raft_consensus.cc:2243] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.440618 27432 raft_consensus.cc:2272] T b644d4c5865d4fd89ed3c9e770e2eaac P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.443101 27432 tablet_replica.cc:333] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.443776 27432 raft_consensus.cc:2243] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.444691 27432 raft_consensus.cc:2272] T f91cfbc609274be4a869217b22fc197b P 0c0ecde0af494dc9b152dee191c6d3e6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.446877 27432 tablet_replica.cc:333] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.447614 27432 raft_consensus.cc:2243] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.448508 27432 raft_consensus.cc:2272] T a8522d0aafd845c3b071def21aaaec24 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.450656 27432 tablet_replica.cc:333] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.451340 27432 raft_consensus.cc:2243] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.451910 27432 raft_consensus.cc:2272] T e1d00e421d5e40fb93fa17b07c0e88a3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.454078 27432 tablet_replica.cc:333] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.454700 27432 raft_consensus.cc:2243] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.455665 27432 raft_consensus.cc:2272] T c23648b5c68c4f9584b74b6a8ff47454 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.457962 27432 tablet_replica.cc:333] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.458514 27432 raft_consensus.cc:2243] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.459372 27432 raft_consensus.cc:2272] T 07a2389891a145aeb0c85e04f061855a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.461338 27432 tablet_replica.cc:333] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.461901 27432 raft_consensus.cc:2243] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.462886 27432 raft_consensus.cc:2272] T 2ae379c498ad42cb8a8201bd2640f6e3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.465317 27432 tablet_replica.cc:333] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.465902 27432 raft_consensus.cc:2243] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.466476 27432 raft_consensus.cc:2272] T 507239c483484d3abb552ab606bfd45c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.468641 27432 tablet_replica.cc:333] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.469487 27432 raft_consensus.cc:2243] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.470393 27432 raft_consensus.cc:2272] T b051a542445141ae99fc26201430f3ae P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.472755 27432 tablet_replica.cc:333] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.473510 27432 raft_consensus.cc:2243] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.474957 27432 raft_consensus.cc:2272] T b905a9410ce147d093be203901159c35 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.478574 27432 tablet_replica.cc:333] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.479652 27432 raft_consensus.cc:2243] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.480695 27432 raft_consensus.cc:2272] T 1404e4e726904b9da0d047a2f50142f0 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.484185 27432 tablet_replica.cc:333] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.485520 27432 raft_consensus.cc:2243] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.486361 27432 raft_consensus.cc:2272] T 1ff2d657aad54bbe97b4cda17edf3957 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.489598 27432 tablet_replica.cc:333] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.490232 27432 raft_consensus.cc:2243] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.490957 27432 raft_consensus.cc:2272] T 788a727f92304a5a9926b2f15933af88 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:25.491148 28695 consensus_peers.cc:597] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:25.493925 27432 tablet_replica.cc:333] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.494612 27432 raft_consensus.cc:2243] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:14:25.494750 28695 consensus_peers.cc:597] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:25.495937 27432 raft_consensus.cc:2272] T a055ab5c44004b99a22596b86a4c2a45 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.498415 27432 tablet_replica.cc:333] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.499365 27432 raft_consensus.cc:2243] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.500479 27432 raft_consensus.cc:2272] T 4ce0ec29e76b45f59ccace895ac58f28 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.503330 27432 tablet_replica.cc:333] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
W20260709 13:14:25.503717 29224 consensus_peers.cc:597] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:25.504176 27432 raft_consensus.cc:2243] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.505276 27432 raft_consensus.cc:2272] T 220dd03eba974f23a47374679c6d2fb7 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.507763 27432 tablet_replica.cc:333] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.508520 27432 raft_consensus.cc:2243] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.509357 27432 raft_consensus.cc:2272] T 6003600bf2df4ecbaeff7fa53e044e91 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.512616 27432 tablet_replica.cc:333] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.513337 27432 raft_consensus.cc:2243] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.514684 27432 raft_consensus.cc:2272] T 50de2f4297b44d57a1acdb6f6af1f02f P 0c0ecde0af494dc9b152dee191c6d3e6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.518585 27432 tablet_replica.cc:333] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.519830 27432 raft_consensus.cc:2243] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.520512 27432 raft_consensus.cc:2272] T 4380fb261ad646d49d956c3ba5036856 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:25.521831 29224 consensus_peers.cc:597] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:25.523411 27432 tablet_replica.cc:333] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.524207 27432 raft_consensus.cc:2243] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.525453 27432 raft_consensus.cc:2272] T 61d9db35d52e47849f6205fef1ea841a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:25.525458 28695 consensus_peers.cc:597] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:25.528507 27432 tablet_replica.cc:333] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.529366 27432 raft_consensus.cc:2243] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.530035 27432 raft_consensus.cc:2272] T 8877b0f244204425983fb5d505497cf3 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:25.531517 29224 consensus_peers.cc:597] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:25.533245 27432 tablet_replica.cc:333] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.534149 27432 raft_consensus.cc:2243] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.535132 27432 raft_consensus.cc:2272] T a9b5276724f2468eb1927555abdfcc2a P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.538160 27432 tablet_replica.cc:333] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.539009 27432 raft_consensus.cc:2243] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.539660 27432 raft_consensus.cc:2272] T 5080a9ad719842a1b28d579fb99c6282 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.542713 27432 tablet_replica.cc:333] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.543503 27432 raft_consensus.cc:2243] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.544241 27432 raft_consensus.cc:2272] T f2a02df07d6643edb55e844cfc7fbe3e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.547374 27432 tablet_replica.cc:333] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.548200 27432 raft_consensus.cc:2243] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.548905 27432 raft_consensus.cc:2272] T aee1d5c683234ed9969b70eb583d0724 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.551541 27432 tablet_replica.cc:333] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.552191 27432 raft_consensus.cc:2243] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.553164 27432 raft_consensus.cc:2272] T e1210d5a904b4f328048e3c924967b95 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.555576 27432 tablet_replica.cc:333] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.556344 27432 raft_consensus.cc:2243] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.556835 27432 raft_consensus.cc:2272] T c5e88af67eea4aa588b7cf82a03a9c3d P 0c0ecde0af494dc9b152dee191c6d3e6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.559217 27432 tablet_replica.cc:333] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.559772 27432 raft_consensus.cc:2243] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.560376 27432 raft_consensus.cc:2272] T cbbd878f3c5b4d8f829666660878c2ef P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.562503 27432 tablet_replica.cc:333] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.563211 27432 raft_consensus.cc:2243] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.563856 27432 raft_consensus.cc:2272] T 6ed00f783ec545f7a156d77cd9062498 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.566349 27432 tablet_replica.cc:333] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.567119 27432 raft_consensus.cc:2243] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.567968 27432 raft_consensus.cc:2272] T 299a315de86c44c0a3613934339689e4 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.570398 27432 tablet_replica.cc:333] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.571190 27432 raft_consensus.cc:2243] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.571822 27432 raft_consensus.cc:2272] T 0817000b219d44bc891d4c9a50a56999 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:25.572397 29282 debug-util.cc:398] Leaking SignalData structure 0x7b080004a560 after lost signal to thread 27435
W20260709 13:14:25.573642 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2ea0 after lost signal to thread 28513
W20260709 13:14:25.574152 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08001eeea0 after lost signal to thread 28602
I20260709 13:14:25.574851 27432 tablet_replica.cc:333] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
W20260709 13:14:25.575433 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800401640 after lost signal to thread 28680
I20260709 13:14:25.575618 27432 raft_consensus.cc:2243] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:14:25.576689 29282 debug-util.cc:398] Leaking SignalData structure 0x7b0800393ac0 after lost signal to thread 28754
I20260709 13:14:25.576802 27432 raft_consensus.cc:2272] T 3d30c923964844ccad86f6776b30b074 P 0c0ecde0af494dc9b152dee191c6d3e6 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:25.577926 29282 debug-util.cc:398] Leaking SignalData structure 0x7b08003fea80 after lost signal to thread 29286
I20260709 13:14:25.579639 27432 tablet_replica.cc:333] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.580382 27432 raft_consensus.cc:2243] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.581555 27432 raft_consensus.cc:2272] T f19fc0b4baf8421e9b460fa2e2eb4b8c P 0c0ecde0af494dc9b152dee191c6d3e6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.584332 27432 tablet_replica.cc:333] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6: stopping tablet replica
I20260709 13:14:25.585071 27432 raft_consensus.cc:2243] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.585778 27432 raft_consensus.cc:2272] T 31c48009ac1c494fac1b2eb14ee5e90e P 0c0ecde0af494dc9b152dee191c6d3e6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:25.590551 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:25.592126 28695 consensus_peers.cc:597] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.685672 28695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39245, user_credentials={real_user=slave}} blocked reactor thread for 93610.7us
W20260709 13:14:25.718866 28695 consensus_peers.cc:597] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:25.778450 28695 consensus_peers.cc:597] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.779181 28695 consensus_peers.cc:597] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.779870 28695 consensus_peers.cc:597] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.791787 29224 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:14:25.792459 29224 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:25.823928 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.824751 29224 consensus_peers.cc:597] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.829056 29224 consensus_peers.cc:597] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.829902 29224 consensus_peers.cc:597] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.830595 29224 consensus_peers.cc:597] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.831187 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.831809 29224 consensus_peers.cc:597] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.832410 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.833253 29224 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 407 similar messages]
W20260709 13:14:25.838083 29224 connection.cc:769] client connection to 127.26.202.2:39245 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:14:25.846868 29224 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:25.850366 29224 consensus_peers.cc:597] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.851003 29224 consensus_peers.cc:597] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.851512 29224 consensus_peers.cc:597] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.852175 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.861979 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.866192 29224 consensus_peers.cc:597] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:25.866380 28695 consensus_peers.cc:597] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:26.215039 28695 consensus_peers.cc:597] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:26.315843 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:26.316401 29224 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:26.325735 29224 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:26.411330 28695 consensus_peers.cc:597] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:26.424866 29224 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:14:26.532758  4000 raft_consensus.cc:493] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.533385  4000 raft_consensus.cc:515] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:26.535602  4000 leader_election.cc:290] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:26.575367  4004 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.575949  4004 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.578390  4004 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:26.580788  4007 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.581851 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:26.582553  4024 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.581648  4007 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.583132  4024 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.584868  4007 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:26.585474  4007 raft_consensus.cc:493] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.586056  4007 raft_consensus.cc:515] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.590699  4024 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:26.607540 28695 leader_election.cc:336] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.617534  4007 leader_election.cc:290] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:26.628963 28695 leader_election.cc:336] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:26.629632 28695 leader_election.cc:304] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.630390  4004 raft_consensus.cc:493] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.630985  4000 raft_consensus.cc:2749] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:26.630900  4004 raft_consensus.cc:515] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:26.633034  4004 leader_election.cc:290] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:26.645220  4004 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.645761  4004 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.648654  4004 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:26.648888 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
I20260709 13:14:26.650655  4004 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.651217  4004 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.652254  4023 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.652843  4023 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.655268  4023 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:26.659727  4004 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
I20260709 13:14:26.659899 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:26.661036 29224 leader_election.cc:336] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:26.662743 29224 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:26.662840  4004 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
W20260709 13:14:26.663447 29224 leader_election.cc:336] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:26.663547  4004 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:26.666522 29224 leader_election.cc:336] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.667057 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
W20260709 13:14:26.668062 29224 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.668502  4025 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:26.672538 29251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19fc0b4baf8421e9b460fa2e2eb4b8c" candidate_uuid: "ed517a03edd141a798f07798667c1c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d64d870625d6461b89b1fb75cd2e26e0" is_pre_election: true
W20260709 13:14:26.673468 28695 leader_election.cc:336] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.673970 28695 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:26.674499  4028 raft_consensus.cc:493] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.675227  4000 raft_consensus.cc:2749] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:26.675303  4028 raft_consensus.cc:515] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:26.678043  4028 leader_election.cc:290] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:26.682699 28695 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.670907 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.685884  4025 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:26.674467  4004 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4:38541)
W20260709 13:14:26.688948 28695 leader_election.cc:336] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:26.689514 28695 leader_election.cc:304] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.691380  4004 raft_consensus.cc:2749] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:26.694797 29224 leader_election.cc:336] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:26.697268 29224 leader_election.cc:336] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.697861 29224 leader_election.cc:304] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.700018  4007 raft_consensus.cc:2749] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:26.700244 29224 leader_election.cc:336] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.700779 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.701668  4024 raft_consensus.cc:2749] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:26.702381 28695 leader_election.cc:336] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.703612 28695 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:26.704347  4004 raft_consensus.cc:2749] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:26.706349 28695 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.706827 28695 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:26.707571  4004 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:26.708629 28695 leader_election.cc:336] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.709389 28695 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, d64d870625d6461b89b1fb75cd2e26e0
I20260709 13:14:26.712373  4004 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:26.713340 28695 leader_election.cc:336] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
W20260709 13:14:26.714267 28695 leader_election.cc:336] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:26.714689 28695 leader_election.cc:304] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.715380  4004 raft_consensus.cc:2749] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:26.726478  4004 raft_consensus.cc:493] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.726995  4004 raft_consensus.cc:515] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:26.729206  4004 leader_election.cc:290] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:26.735488  4024 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.736064  4024 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.738493  4024 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:26.740124 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:26.741081 28724 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 18.
I20260709 13:14:26.741827  4004 raft_consensus.cc:493] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.742359  4004 raft_consensus.cc:515] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:26.744300  4004 leader_election.cc:290] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:26.745869 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:26.748428  4023 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:26.748813  4023 raft_consensus.cc:493] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.749190  4023 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:26.759503 29224 leader_election.cc:336] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.760090  4023 raft_consensus.cc:515] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.768155  4023 leader_election.cc:290] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:26.766371 27432 tablet_server.cc:196] TabletServer@127.26.202.2:0 shutdown complete.
I20260709 13:14:26.771991 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23648b5c68c4f9584b74b6a8ff47454" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:26.772735 28724 raft_consensus.cc:3060] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:26.774049 29224 leader_election.cc:336] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
W20260709 13:14:26.772142 28695 leader_election.cc:336] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
W20260709 13:14:26.778254 28695 leader_election.cc:336] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:26.778697 28695 leader_election.cc:304] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.782081 28724 raft_consensus.cc:2468] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 19.
I20260709 13:14:26.784014 29223 leader_election.cc:304] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6
I20260709 13:14:26.785231  4023 raft_consensus.cc:2804] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:26.785871  4023 raft_consensus.cc:697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:26.786926  4023 consensus_queue.cc:237] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.787709  4024 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.788296  4024 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.787727  4004 raft_consensus.cc:2749] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:26.793396  4004 raft_consensus.cc:493] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.794051  4004 raft_consensus.cc:515] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
W20260709 13:14:26.797952 28695 leader_election.cc:336] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.800484  4024 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:26.800894 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
W20260709 13:14:26.802021 28695 leader_election.cc:336] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:26.801631 28724 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 22.
I20260709 13:14:26.802500 28695 leader_election.cc:304] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.803488  4028 raft_consensus.cc:2749] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:26.803846 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:26.806473  4025 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:26.807096  4025 raft_consensus.cc:493] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.807533  4025 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:26.796778  4004 leader_election.cc:290] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:26.821776 29224 leader_election.cc:336] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
W20260709 13:14:26.823561 28695 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:26.824939 28695 leader_election.cc:336] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.825392 28695 leader_election.cc:304] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.826123  4028 raft_consensus.cc:2749] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:14:26.836825 28695 consensus_peers.cc:597] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:14:26.837905  4025 raft_consensus.cc:515] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:26.843811 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:14:26.849121 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055ab5c44004b99a22596b86a4c2a45" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04"
I20260709 13:14:26.849792 28724 raft_consensus.cc:3060] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:26.850687  4024 raft_consensus.cc:493] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.851262  4024 raft_consensus.cc:515] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.855461  4024 leader_election.cc:290] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:26.856875 28724 raft_consensus.cc:2468] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 23.
I20260709 13:14:26.858139 29223 leader_election.cc:304] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:26.859141  4024 raft_consensus.cc:2804] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:26.862020  4024 raft_consensus.cc:697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 LEADER]: Becoming Leader. State: Replica: d64d870625d6461b89b1fb75cd2e26e0, State: Running, Role: LEADER
I20260709 13:14:26.862989  4024 consensus_queue.cc:237] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:26.874289 28472 catalog_manager.cc:5697] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 18 to 19, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 19 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.863237  4025 leader_election.cc:290] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:26.880897 29224 leader_election.cc:336] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
W20260709 13:14:26.881893 29224 leader_election.cc:336] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
W20260709 13:14:26.887243 29224 leader_election.cc:336] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:26.887655 29224 leader_election.cc:304] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.889423  4025 raft_consensus.cc:2749] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:26.896203  4028 raft_consensus.cc:493] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.896847  4028 raft_consensus.cc:515] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:26.899062  4028 leader_election.cc:290] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:26.913483 28695 leader_election.cc:336] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:26.915468 28695 leader_election.cc:336] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:26.916075 28695 leader_election.cc:304] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:26.916903  4028 raft_consensus.cc:2749] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:26.925529  4023 raft_consensus.cc:493] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.926249  4023 raft_consensus.cc:515] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:26.927408 28695 consensus_peers.cc:597] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:14:26.928619  4023 leader_election.cc:290] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:26.991912  4028 raft_consensus.cc:493] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:26.992655  4028 raft_consensus.cc:515] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } }
I20260709 13:14:26.995332  4028 leader_election.cc:290] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:27.009708 28695 leader_election.cc:336] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:27.010560 28695 leader_election.cc:336] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:27.011031 28695 leader_election.cc:304] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed517a03edd141a798f07798667c1c04; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:27.007843 28472 catalog_manager.cc:5697] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 reported cstate change: term changed from 22 to 23, leader changed from 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2) to d64d870625d6461b89b1fb75cd2e26e0 (127.26.202.4). New cstate: current_term: 23 leader_uuid: "d64d870625d6461b89b1fb75cd2e26e0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:27.012528  4028 raft_consensus.cc:2749] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:27.030689 29224 leader_election.cc:336] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:27.035974 29224 leader_election.cc:336] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:27.036764  4025 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:27.037576  4025 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:27.039764  4025 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:27.041180 28724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1210d5a904b4f328048e3c924967b95" candidate_uuid: "d64d870625d6461b89b1fb75cd2e26e0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ed517a03edd141a798f07798667c1c04" is_pre_election: true
I20260709 13:14:27.041987 28724 raft_consensus.cc:2468] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d64d870625d6461b89b1fb75cd2e26e0 in term 21.
I20260709 13:14:27.043171 29223 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0, ed517a03edd141a798f07798667c1c04; no voters: 
I20260709 13:14:27.044157  4025 raft_consensus.cc:2804] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:27.044634  4025 raft_consensus.cc:493] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:27.045090  4025 raft_consensus.cc:3060] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:27.041297 29224 leader_election.cc:304] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:27.047641  4014 raft_consensus.cc:2749] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:27.066113 27432 tablet_server.cc:179] TabletServer@127.26.202.3:0 shutting down...
I20260709 13:14:27.076647  4014 raft_consensus.cc:493] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:27.076349  4025 raft_consensus.cc:515] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:27.080792 29224 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:27.080595  4014 raft_consensus.cc:515] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:27.086767  4014 leader_election.cc:290] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:27.090307 29223 leader_election.cc:336] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:27.091435  4025 leader_election.cc:290] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Requested vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:27.097190 29223 consensus_peers.cc:597] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.098176 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:27.099382 29223 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:27.108349 29224 leader_election.cc:336] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:27.109086 29224 leader_election.cc:304] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:27.111472  4024 raft_consensus.cc:2749] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:27.112727 29224 leader_election.cc:336] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:27.114645 29224 leader_election.cc:304] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:27.116024  4024 raft_consensus.cc:2749] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:14:27.122397 29223 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.129246 29223 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.130649 29223 consensus_peers.cc:597] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.136463 29223 consensus_peers.cc:597] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.141049 29224 consensus_peers.cc:597] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:27.160769 29223 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.162726 29223 consensus_peers.cc:597] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.174383 29223 consensus_peers.cc:597] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.188520 29223 consensus_peers.cc:597] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.194401 29223 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.209761 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:27.211781 29224 consensus_peers.cc:597] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.212018 27432 tablet_replica.cc:333] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.213267 27432 raft_consensus.cc:2243] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.213973 27432 raft_consensus.cc:2272] T 74487246ff8b4903996c628e2ca7c948 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.220407 27432 tablet_replica.cc:333] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.221554 27432 raft_consensus.cc:2243] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.223388 27432 raft_consensus.cc:2272] T eb791c0c5eb14aff83f666f36ab82a30 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.231437 28695 consensus_peers.cc:597] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:14:27.233445 27432 tablet_replica.cc:333] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.234580 27432 raft_consensus.cc:2243] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.235342 27432 raft_consensus.cc:2272] T de05bba072764f32aeb479edb07a9d4b P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.239442 27432 tablet_replica.cc:333] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.241122 27432 raft_consensus.cc:2243] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.242449 27432 raft_consensus.cc:2272] T 908e88869b314709ad606ff91b8da799 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.243897 28695 consensus_peers.cc:597] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:14:27.245424 27432 tablet_replica.cc:333] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.246497 27432 raft_consensus.cc:2243] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.247131 27432 raft_consensus.cc:2272] T 299a315de86c44c0a3613934339689e4 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.249985 27432 tablet_replica.cc:333] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.250825 27432 raft_consensus.cc:2243] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.251431 27432 raft_consensus.cc:2272] T b445e2209eb343cf9d87aa63ba0becbc P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.254290 27432 tablet_replica.cc:333] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.255178 27432 raft_consensus.cc:2243] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.255896 27432 raft_consensus.cc:2272] T b644d4c5865d4fd89ed3c9e770e2eaac P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.258702 27432 tablet_replica.cc:333] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.259528 27432 raft_consensus.cc:2243] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.260251 27432 raft_consensus.cc:2272] T f91cfbc609274be4a869217b22fc197b P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.262962 27432 tablet_replica.cc:333] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.263757 27432 raft_consensus.cc:2243] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.264346 27432 raft_consensus.cc:2272] T 95579b54a2ec400081e0a348b2395dfc P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.267189 27432 tablet_replica.cc:333] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.268052 27432 raft_consensus.cc:2243] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.268821 27432 raft_consensus.cc:2272] T 7c9f7022e7f24efaa9b25cb129729504 P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.271677 27432 tablet_replica.cc:333] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.272560 27432 raft_consensus.cc:2243] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.273727 27432 raft_consensus.cc:2272] T e3680992ef7b48798cdf5ea60753f423 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.276741 27432 tablet_replica.cc:333] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.277668 27432 raft_consensus.cc:2243] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.278545 27432 raft_consensus.cc:2272] T 2ae379c498ad42cb8a8201bd2640f6e3 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.281404 27432 tablet_replica.cc:333] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.282238 27432 raft_consensus.cc:2243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.282855 27432 raft_consensus.cc:2272] T 7cf5b8cf3c9a478da7deba36d7acbe96 P ed517a03edd141a798f07798667c1c04 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.286221 27432 tablet_replica.cc:333] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.287297 27432 raft_consensus.cc:2243] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.288589 27432 raft_consensus.cc:2272] T 507239c483484d3abb552ab606bfd45c P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.291635 27432 tablet_replica.cc:333] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.292580 27432 raft_consensus.cc:2243] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.293241 27432 raft_consensus.cc:2272] T c23648b5c68c4f9584b74b6a8ff47454 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.295634 29223 consensus_peers.cc:597] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.296341 27432 tablet_replica.cc:333] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.297343 27432 raft_consensus.cc:2243] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.298925 27432 raft_consensus.cc:2272] T 55ea2a86b4ee4d399b9b439246c9d92a P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.302592 27432 tablet_replica.cc:333] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.303485 27432 raft_consensus.cc:2243] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.304273 27432 raft_consensus.cc:2272] T 5f0bc7b3c800463996a3d14ce7e5786f P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.304411 28695 consensus_peers.cc:597] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:14:27.307925 27432 tablet_replica.cc:333] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.309453 27432 raft_consensus.cc:2243] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.310348 27432 raft_consensus.cc:2272] T 8a8a47d75d1241b7acc3796f628c9196 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.315835 27432 tablet_replica.cc:333] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.316855 27432 raft_consensus.cc:2243] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.317906 27432 raft_consensus.cc:2272] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P ed517a03edd141a798f07798667c1c04 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.317924 29223 consensus_peers.cc:597] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.323498 27432 tablet_replica.cc:333] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.324540 27432 raft_consensus.cc:2243] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.325553 27432 raft_consensus.cc:2272] T b905a9410ce147d093be203901159c35 P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.329504 27432 tablet_replica.cc:333] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.330513 27432 raft_consensus.cc:2243] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.331133 27432 raft_consensus.cc:2272] T 1404e4e726904b9da0d047a2f50142f0 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.334846 27432 tablet_replica.cc:333] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.335695 27432 raft_consensus.cc:2243] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.336903 27432 raft_consensus.cc:2272] T b051a542445141ae99fc26201430f3ae P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.339987 27432 tablet_replica.cc:333] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.340916 27432 raft_consensus.cc:2243] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.341897 27432 raft_consensus.cc:2272] T 4380fb261ad646d49d956c3ba5036856 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.344815 27432 tablet_replica.cc:333] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.345664 27432 raft_consensus.cc:2243] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.346401 27432 raft_consensus.cc:2272] T 1fc836b2fe6541889bfb8d09a2bc3d2c P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.350330 29223 consensus_peers.cc:597] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.351204 27432 tablet_replica.cc:333] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.352187 27432 raft_consensus.cc:2243] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.352972 27432 raft_consensus.cc:2272] T 6caf9ec933124d00b3e0e2cfeccd317b P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.354403 29223 consensus_peers.cc:597] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.356287 27432 tablet_replica.cc:333] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.357244 27432 raft_consensus.cc:2243] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.358556 27432 raft_consensus.cc:2272] T 04a304ac38c74ef5af43514ad1732e01 P ed517a03edd141a798f07798667c1c04 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.361474 27432 tablet_replica.cc:333] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.362548 27432 raft_consensus.cc:2243] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.364130 27432 raft_consensus.cc:2272] T aee1d5c683234ed9969b70eb583d0724 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.367362 27432 tablet_replica.cc:333] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.368232 27432 raft_consensus.cc:2243] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.368876 27432 raft_consensus.cc:2272] T e1210d5a904b4f328048e3c924967b95 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.371666 27432 tablet_replica.cc:333] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04: stopping tablet replica
W20260709 13:14:27.372066 29223 consensus_peers.cc:597] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.372764 27432 raft_consensus.cc:2243] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.374089 27432 raft_consensus.cc:2272] T a9b5276724f2468eb1927555abdfcc2a P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.376883 27432 tablet_replica.cc:333] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.377785 27432 raft_consensus.cc:2243] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.378463 27432 raft_consensus.cc:2272] T 61d9db35d52e47849f6205fef1ea841a P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.381129 27432 tablet_replica.cc:333] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.381925 27432 raft_consensus.cc:2243] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.382630 27432 raft_consensus.cc:2272] T 8877b0f244204425983fb5d505497cf3 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.385468 27432 tablet_replica.cc:333] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.386221 27432 raft_consensus.cc:2243] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.387457 27432 raft_consensus.cc:2272] T 5080a9ad719842a1b28d579fb99c6282 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.390267 29224 consensus_peers.cc:597] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.391690 27432 tablet_replica.cc:333] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.392800 27432 raft_consensus.cc:2243] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.393563 27432 raft_consensus.cc:2272] T 35fc728c038d4d8d8827779516ffce5f P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.396672 27432 tablet_replica.cc:333] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.397539 27432 raft_consensus.cc:2243] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.398370 27432 raft_consensus.cc:2272] T f2a02df07d6643edb55e844cfc7fbe3e P ed517a03edd141a798f07798667c1c04 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.400954 27432 tablet_replica.cc:333] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.401754 27432 raft_consensus.cc:2243] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.402347 27432 raft_consensus.cc:2272] T ed9ebd651cf34b18b29911e247dc9834 P ed517a03edd141a798f07798667c1c04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.404886 27432 tablet_replica.cc:333] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.405619 27432 raft_consensus.cc:2243] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.406257 27432 raft_consensus.cc:2272] T 1ff2d657aad54bbe97b4cda17edf3957 P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.409379 27432 tablet_replica.cc:333] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.410096 27432 raft_consensus.cc:2243] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.411247 27432 raft_consensus.cc:2272] T 4fbdeb3c093d412b871d55add092cb37 P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.413862 27432 tablet_replica.cc:333] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.414677 27432 raft_consensus.cc:2243] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.415805 27432 raft_consensus.cc:2272] T f8259ae9bad54fb1b2f26e7b813a8bd6 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.419071 27432 tablet_replica.cc:333] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.419878 27432 raft_consensus.cc:2243] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:27.421340 27432 raft_consensus.cc:2272] T cbbd878f3c5b4d8f829666660878c2ef P ed517a03edd141a798f07798667c1c04 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.423350 29223 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:27.424037 27432 tablet_replica.cc:333] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.424818 27432 raft_consensus.cc:2243] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.425422 27432 raft_consensus.cc:2272] T 31c48009ac1c494fac1b2eb14ee5e90e P ed517a03edd141a798f07798667c1c04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.428118 27432 tablet_replica.cc:333] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.428879 27432 raft_consensus.cc:2243] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.429857 27432 raft_consensus.cc:2272] T a055ab5c44004b99a22596b86a4c2a45 P ed517a03edd141a798f07798667c1c04 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.432341 27432 tablet_replica.cc:333] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.433025 27432 raft_consensus.cc:2243] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.433643 27432 raft_consensus.cc:2272] T 3d30c923964844ccad86f6776b30b074 P ed517a03edd141a798f07798667c1c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.436206 27432 tablet_replica.cc:333] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.436861 27432 raft_consensus.cc:2243] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.437446 27432 raft_consensus.cc:2272] T f19fc0b4baf8421e9b460fa2e2eb4b8c P ed517a03edd141a798f07798667c1c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.440008 27432 tablet_replica.cc:333] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.440707 27432 raft_consensus.cc:2243] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.441424 27432 raft_consensus.cc:2272] T 0817000b219d44bc891d4c9a50a56999 P ed517a03edd141a798f07798667c1c04 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:27.444003 27432 tablet_replica.cc:333] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04: stopping tablet replica
I20260709 13:14:27.444655 27432 raft_consensus.cc:2243] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:27.445732 27432 raft_consensus.cc:2272] T e868dee9130744a3bc9fab23a236b03a P ed517a03edd141a798f07798667c1c04 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:27.471226 29223 consensus_peers.cc:597] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.477917 29223 consensus_peers.cc:597] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.491781 29223 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.529754 29223 consensus_peers.cc:597] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.530594 29223 consensus_peers.cc:597] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.531245 29223 consensus_peers.cc:597] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.561668 29224 consensus_peers.cc:597] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:27.562160 29224 consensus_peers.cc:597] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:27.562528 29224 consensus_peers.cc:597] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:27.570498 29223 consensus_peers.cc:597] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Couldn't send request to peer ed517a03edd141a798f07798667c1c04. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.3:40339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:27.712378 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:27.715997 29224 consensus_peers.cc:597] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:14:27.791039 29224 consensus_peers.cc:597] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:27.900036 29224 consensus_peers.cc:597] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:27.944478 29224 consensus_peers.cc:597] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:27.945842 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:14:27.970858 29224 consensus_peers.cc:597] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:14:27.977914 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:14:27.978945 29224 consensus_peers.cc:597] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.002823 29224 consensus_peers.cc:597] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.016944 29224 consensus_peers.cc:597] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.086661 29224 consensus_peers.cc:597] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.125427 29224 consensus_peers.cc:597] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.178571 29224 consensus_peers.cc:597] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:14:28.210680 29224 consensus_peers.cc:597] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.252947 29224 consensus_peers.cc:597] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:14:28.264729 29224 consensus_peers.cc:597] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.270087 29224 consensus_peers.cc:597] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.309484 29224 consensus_peers.cc:597] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.318073 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.328349 29224 consensus_peers.cc:597] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.340690 29224 consensus_peers.cc:597] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.374369 29224 consensus_peers.cc:597] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.392946 29224 consensus_peers.cc:597] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:14:28.411443 27432 tablet_server.cc:196] TabletServer@127.26.202.3:0 shutdown complete.
I20260709 13:14:28.414891  4007 raft_consensus.cc:493] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:28.415462  4007 raft_consensus.cc:515] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:28.417567  4007 leader_election.cc:290] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:28.422029 29224 leader_election.cc:336] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:28.422740 29224 leader_election.cc:336] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:28.423188 29224 leader_election.cc:304] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:28.423820  4007 raft_consensus.cc:2749] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:28.467597  4023 raft_consensus.cc:493] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:28.468206  4023 raft_consensus.cc:515] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:28.470790  4023 leader_election.cc:290] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
W20260709 13:14:28.480849 29224 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
W20260709 13:14:28.481580 29224 consensus_peers.cc:597] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.485512 29224 consensus_peers.cc:597] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:28.486582 29224 leader_election.cc:336] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:28.487120 29224 leader_election.cc:304] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:28.487905  4023 raft_consensus.cc:2749] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:28.490172 29224 consensus_peers.cc:597] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Couldn't send request to peer 0c0ecde0af494dc9b152dee191c6d3e6. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:28.539795  4023 raft_consensus.cc:493] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:28.540398  4023 raft_consensus.cc:515] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:28.542564  4023 leader_election.cc:290] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:28.548539 29224 leader_election.cc:336] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:28.549502  4024 raft_consensus.cc:493] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:28.550097  4024 raft_consensus.cc:515] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
W20260709 13:14:28.550911 29223 leader_election.cc:336] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Network error: Client connection negotiation failed: client connection to 127.26.202.3:40339: connect: Connection refused (error 111)
I20260709 13:14:28.551515 29223 leader_election.cc:304] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:28.552322  4007 raft_consensus.cc:2749] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:28.552488  4024 leader_election.cc:290] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:28.563370 29223 leader_election.cc:336] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Network error: Client connection negotiation failed: client connection to 127.26.202.3:40339: connect: Connection refused (error 111)
W20260709 13:14:28.564409 29224 leader_election.cc:336] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:28.564663 27432 tablet_server.cc:179] TabletServer@127.26.202.4:0 shutting down...
I20260709 13:14:28.564970 29224 leader_election.cc:304] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, ed517a03edd141a798f07798667c1c04
I20260709 13:14:28.567237  4023 raft_consensus.cc:2749] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:28.605429  4024 raft_consensus.cc:493] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:28.605995  4024 raft_consensus.cc:515] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:28.608186  4024 leader_election.cc:290] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
W20260709 13:14:28.613224 29224 leader_election.cc:336] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
W20260709 13:14:28.617305 29223 leader_election.cc:336] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Network error: Client connection negotiation failed: client connection to 127.26.202.3:40339: connect: Connection refused (error 111)
I20260709 13:14:28.618959 29223 leader_election.cc:304] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:28.619663  4024 raft_consensus.cc:2749] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:28.619825 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:28.620760 27432 tablet_replica.cc:333] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.622524 27432 raft_consensus.cc:2243] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.623641 27432 raft_consensus.cc:2272] T 6caf9ec933124d00b3e0e2cfeccd317b P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.626520 27432 tablet_replica.cc:333] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.627406 27432 raft_consensus.cc:2243] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.628233 27432 raft_consensus.cc:2272] T 5f0bc7b3c800463996a3d14ce7e5786f P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.630558 27432 tablet_replica.cc:333] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.631188 27432 raft_consensus.cc:2243] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.632050 27432 raft_consensus.cc:2272] T 1ff2d657aad54bbe97b4cda17edf3957 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.634240 27432 tablet_replica.cc:333] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.634927 27432 raft_consensus.cc:2243] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.635819 27432 raft_consensus.cc:2272] T c5e88af67eea4aa588b7cf82a03a9c3d P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.638693 27432 tablet_replica.cc:333] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.639609 27432 raft_consensus.cc:2243] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.640787 27432 raft_consensus.cc:2272] T e868dee9130744a3bc9fab23a236b03a P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.643543 27432 tablet_replica.cc:333] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.644248 27432 raft_consensus.cc:2243] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.645200 27432 raft_consensus.cc:2272] T 0817000b219d44bc891d4c9a50a56999 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.647305 27432 tablet_replica.cc:333] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.647929 27432 raft_consensus.cc:2243] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.648574 27432 raft_consensus.cc:2272] T f19fc0b4baf8421e9b460fa2e2eb4b8c P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.650673 27432 tablet_replica.cc:333] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.651304 27432 raft_consensus.cc:2243] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.652124 27432 pending_rounds.cc:70] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Trying to abort 1 pending ops.
I20260709 13:14:28.652305 27432 pending_rounds.cc:77] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0: Aborting op as it isn't in flight: id { term: 23 index: 18 } timestamp: 7305637342706049024 op_type: NO_OP noop_request { }
I20260709 13:14:28.652874 27432 raft_consensus.cc:2889] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:28.653264 27432 raft_consensus.cc:2272] T a055ab5c44004b99a22596b86a4c2a45 P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.655735 27432 tablet_replica.cc:333] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.656319 27432 raft_consensus.cc:2243] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.656764 27432 raft_consensus.cc:2272] T 2b0cf1ebd07944b7aec6c6ff6e22de83 P d64d870625d6461b89b1fb75cd2e26e0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.658694 27432 tablet_replica.cc:333] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.659245 27432 raft_consensus.cc:2243] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.660068 27432 raft_consensus.cc:2272] T 6ed00f783ec545f7a156d77cd9062498 P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.662030 27432 tablet_replica.cc:333] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.662613 27432 raft_consensus.cc:2243] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.663542 27432 raft_consensus.cc:2272] T e1d00e421d5e40fb93fa17b07c0e88a3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.665482 27432 tablet_replica.cc:333] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.666031 27432 raft_consensus.cc:2243] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.666493 27432 raft_consensus.cc:2272] T e1210d5a904b4f328048e3c924967b95 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.668360 27432 tablet_replica.cc:333] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.668907 27432 raft_consensus.cc:2243] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.669776 27432 raft_consensus.cc:2272] T 8877b0f244204425983fb5d505497cf3 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.671654 27432 tablet_replica.cc:333] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.672209 27432 raft_consensus.cc:2243] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.673069 27432 raft_consensus.cc:2272] T 788a727f92304a5a9926b2f15933af88 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.675335 27432 tablet_replica.cc:333] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.676102 27432 raft_consensus.cc:2243] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.676899 27432 raft_consensus.cc:2272] T 07a2389891a145aeb0c85e04f061855a P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.679029 27432 tablet_replica.cc:333] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.679713 27432 raft_consensus.cc:2243] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.680568 27432 raft_consensus.cc:2272] T fce221ba4bb64300a7d2ae39b8b95b77 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.682410 27432 tablet_replica.cc:333] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.682963 27432 raft_consensus.cc:2243] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.683584 27432 raft_consensus.cc:2272] T 4ce0ec29e76b45f59ccace895ac58f28 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.686021 27432 tablet_replica.cc:333] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.686622 27432 raft_consensus.cc:2243] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.687242 27432 raft_consensus.cc:2272] T 908e88869b314709ad606ff91b8da799 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.689792 27432 tablet_replica.cc:333] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.690508 27432 raft_consensus.cc:2243] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.691560 27432 raft_consensus.cc:2272] T 4380fb261ad646d49d956c3ba5036856 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.694628 27432 tablet_replica.cc:333] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.695335 27432 raft_consensus.cc:2243] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.696449 27432 raft_consensus.cc:2272] T 1fc836b2fe6541889bfb8d09a2bc3d2c P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.698693  4024 raft_consensus.cc:493] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0c0ecde0af494dc9b152dee191c6d3e6)
I20260709 13:14:28.699313 27432 tablet_replica.cc:333] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.699239  4024 raft_consensus.cc:515] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "0c0ecde0af494dc9b152dee191c6d3e6" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39245 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:28.700299 27432 raft_consensus.cc:2243] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.701449 27432 raft_consensus.cc:2272] T 299a315de86c44c0a3613934339689e4 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.701608  4024 leader_election.cc:290] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245)
I20260709 13:14:28.704658 27432 tablet_replica.cc:333] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.705583 27432 raft_consensus.cc:2243] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:28.705672 29224 leader_election.cc:336] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:28.706476 27432 raft_consensus.cc:2272] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:28.708544 29224 leader_election.cc:336] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0c0ecde0af494dc9b152dee191c6d3e6 (127.26.202.2:39245): Network error: Client connection negotiation failed: client connection to 127.26.202.2:39245: connect: Connection refused (error 111)
I20260709 13:14:28.708992 29224 leader_election.cc:304] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 0c0ecde0af494dc9b152dee191c6d3e6, 178f22d83287460fb8c0db0ba2799895
I20260709 13:14:28.709576 27432 tablet_replica.cc:333] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
W20260709 13:14:28.709628 29224 raft_consensus.cc:2686] T 220dd03eba974f23a47374679c6d2fb7 P d64d870625d6461b89b1fb75cd2e26e0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:14:28.710677 29224 consensus_peers.cc:597] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 -> Peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Couldn't send request to peer 178f22d83287460fb8c0db0ba2799895. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:14:28.710677 27432 raft_consensus.cc:2243] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.711481 27432 raft_consensus.cc:2272] T b051a542445141ae99fc26201430f3ae P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.714148 27432 tablet_replica.cc:333] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.714766 27432 raft_consensus.cc:2243] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.715754 27432 raft_consensus.cc:2272] T ed9ebd651cf34b18b29911e247dc9834 P d64d870625d6461b89b1fb75cd2e26e0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.718422 27432 tablet_replica.cc:333] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.719142 27432 raft_consensus.cc:2243] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.719049  4024 raft_consensus.cc:493] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ed517a03edd141a798f07798667c1c04)
I20260709 13:14:28.720346 27432 raft_consensus.cc:2272] T b445e2209eb343cf9d87aa63ba0becbc P d64d870625d6461b89b1fb75cd2e26e0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.720239  4024 raft_consensus.cc:515] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "178f22d83287460fb8c0db0ba2799895" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36115 } } peers { permanent_uuid: "ed517a03edd141a798f07798667c1c04" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 40339 } } peers { permanent_uuid: "d64d870625d6461b89b1fb75cd2e26e0" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 38541 } attrs { promote: false } }
I20260709 13:14:28.723347 27432 tablet_replica.cc:333] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.723927  4024 leader_election.cc:290] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115), ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339)
I20260709 13:14:28.724314 27432 raft_consensus.cc:2243] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.725479 27432 raft_consensus.cc:2272] T 220149aed66a471b9a682f9229ae53fd P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:28.727242 29223 leader_election.cc:336] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ed517a03edd141a798f07798667c1c04 (127.26.202.3:40339): Network error: Client connection negotiation failed: client connection to 127.26.202.3:40339: connect: Connection refused (error 111)
W20260709 13:14:28.727837 29224 leader_election.cc:336] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 178f22d83287460fb8c0db0ba2799895 (127.26.202.1:36115): Network error: Client connection negotiation failed: client connection to 127.26.202.1:36115: connect: Connection refused (error 111)
I20260709 13:14:28.728216 29224 leader_election.cc:304] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d64d870625d6461b89b1fb75cd2e26e0; no voters: 178f22d83287460fb8c0db0ba2799895, ed517a03edd141a798f07798667c1c04
I20260709 13:14:28.728487 27432 tablet_replica.cc:333] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.728917  4024 raft_consensus.cc:2749] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:28.729338 27432 raft_consensus.cc:2243] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.730206 27432 raft_consensus.cc:2272] T 7c9f7022e7f24efaa9b25cb129729504 P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.732293 27432 tablet_replica.cc:333] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.732790 27432 raft_consensus.cc:2243] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.733821 27432 raft_consensus.cc:2272] T 7cf5b8cf3c9a478da7deba36d7acbe96 P d64d870625d6461b89b1fb75cd2e26e0 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.735772 27432 tablet_replica.cc:333] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.736294 27432 raft_consensus.cc:2243] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.737141 27432 raft_consensus.cc:2272] T de05bba072764f32aeb479edb07a9d4b P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.739039 27432 tablet_replica.cc:333] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.739518 27432 raft_consensus.cc:2243] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.740080 27432 raft_consensus.cc:2272] T a8522d0aafd845c3b071def21aaaec24 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.742036 27432 tablet_replica.cc:333] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.742522 27432 raft_consensus.cc:2243] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.742889 27432 raft_consensus.cc:2272] T 4fbdeb3c093d412b871d55add092cb37 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.744761 27432 tablet_replica.cc:333] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.745343 27432 raft_consensus.cc:2243] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.745829 27432 raft_consensus.cc:2272] T 50de2f4297b44d57a1acdb6f6af1f02f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.747594 27432 tablet_replica.cc:333] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.748063 27432 raft_consensus.cc:2243] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:28.748443 27432 raft_consensus.cc:2272] T f8259ae9bad54fb1b2f26e7b813a8bd6 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.750335 27432 tablet_replica.cc:333] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.750778 27432 raft_consensus.cc:2243] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.751488 27432 raft_consensus.cc:2272] T 1404e4e726904b9da0d047a2f50142f0 P d64d870625d6461b89b1fb75cd2e26e0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.753350 27432 tablet_replica.cc:333] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.753818 27432 raft_consensus.cc:2243] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.754627 27432 raft_consensus.cc:2272] T 8a8a47d75d1241b7acc3796f628c9196 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.756733 27432 tablet_replica.cc:333] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.757511 27432 raft_consensus.cc:2243] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.758528 27432 pending_rounds.cc:70] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Trying to abort 1 pending ops.
I20260709 13:14:28.758769 27432 pending_rounds.cc:77] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0: Aborting op as it isn't in flight: id { term: 19 index: 16 } timestamp: 7305637342384623616 op_type: NO_OP noop_request { }
I20260709 13:14:28.759130 27432 raft_consensus.cc:2889] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:28.759483 27432 raft_consensus.cc:2272] T c23648b5c68c4f9584b74b6a8ff47454 P d64d870625d6461b89b1fb75cd2e26e0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.761876 27432 tablet_replica.cc:333] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.762660 27432 raft_consensus.cc:2243] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.763612 27432 raft_consensus.cc:2272] T 55ea2a86b4ee4d399b9b439246c9d92a P d64d870625d6461b89b1fb75cd2e26e0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.765654 27432 tablet_replica.cc:333] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.766232 27432 raft_consensus.cc:2243] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.767030 27432 raft_consensus.cc:2272] T 6003600bf2df4ecbaeff7fa53e044e91 P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.768925 27432 tablet_replica.cc:333] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.769526 27432 raft_consensus.cc:2243] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.770314 27432 raft_consensus.cc:2272] T eb791c0c5eb14aff83f666f36ab82a30 P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.772126 27432 tablet_replica.cc:333] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.772648 27432 raft_consensus.cc:2243] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.773559 27432 raft_consensus.cc:2272] T 35fc728c038d4d8d8827779516ffce5f P d64d870625d6461b89b1fb75cd2e26e0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.775678 27432 tablet_replica.cc:333] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.776196 27432 raft_consensus.cc:2243] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.777165 27432 raft_consensus.cc:2272] T bdc0b4abdc504f32a67b93235778cdbc P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.778894 27432 tablet_replica.cc:333] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.779422 27432 raft_consensus.cc:2243] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.780305 27432 raft_consensus.cc:2272] T 31c48009ac1c494fac1b2eb14ee5e90e P d64d870625d6461b89b1fb75cd2e26e0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.782485 27432 tablet_replica.cc:333] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.782974 27432 raft_consensus.cc:2243] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.783890 27432 raft_consensus.cc:2272] T bd08c8d0651d4f21937f0b958dcaaba7 P d64d870625d6461b89b1fb75cd2e26e0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:28.785719 27432 tablet_replica.cc:333] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0: stopping tablet replica
I20260709 13:14:28.786221 27432 raft_consensus.cc:2243] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:28.786971 27432 raft_consensus.cc:2272] T f2a02df07d6643edb55e844cfc7fbe3e P d64d870625d6461b89b1fb75cd2e26e0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.321678 27432 tablet_server.cc:196] TabletServer@127.26.202.4:0 shutdown complete.
I20260709 13:14:29.398043 27432 master.cc:562] Master@127.26.202.62:36613 shutting down...
I20260709 13:14:29.438004 27432 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:29.438629 27432 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:29.438997 27432 tablet_replica.cc:333] T 00000000000000000000000000000000 P 12655fdad3714eb6a91469c435fc7ad5: stopping tablet replica
I20260709 13:14:29.653889 27432 master.cc:584] Master@127.26.202.62:36613 shutdown complete.
I20260709 13:14:29.693571 27432 test_util.cc:182] -----------------------------------------------
I20260709 13:14:29.693789 27432 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602600408833-27432-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (243554 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:14:29.696897 27432 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.202.62:40011
I20260709 13:14:29.698112 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:29.704648  4039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:29.704798  4040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:29.705331  4042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:29.706939 27432 server_base.cc:1061] running on GCE node
I20260709 13:14:29.709965 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:29.710228 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:29.710393 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602869710376 us; error 0 us; skew 500 ppm
I20260709 13:14:29.710911 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:29.714020 27432 webserver.cc:533] Webserver started at http://127.26.202.62:33859/ using document root <none> and password file <none>
I20260709 13:14:29.714641 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:29.714874 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:29.715186 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:29.716478 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/master-0-root/instance:
uuid: "4a137dbbc3444cd9afb9e27e0428bacb"
format_stamp: "Formatted at 2026-07-09 13:14:29 on dist-test-slave-008w"
I20260709 13:14:29.721711 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:14:29.725705  4047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:29.726718 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:14:29.727142 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/master-0-root
uuid: "4a137dbbc3444cd9afb9e27e0428bacb"
format_stamp: "Formatted at 2026-07-09 13:14:29 on dist-test-slave-008w"
I20260709 13:14:29.727646 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:29.759356 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:29.760550 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:29.802662 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.62:40011
I20260709 13:14:29.802755  4098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.62:40011 every 8 connection(s)
I20260709 13:14:29.807103  4099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:29.817829  4099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb: Bootstrap starting.
I20260709 13:14:29.822755  4099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:29.827200  4099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb: No bootstrap required, opened a new log
I20260709 13:14:29.829744  4099 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a137dbbc3444cd9afb9e27e0428bacb" member_type: VOTER }
I20260709 13:14:29.830258  4099 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:29.830530  4099 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a137dbbc3444cd9afb9e27e0428bacb, State: Initialized, Role: FOLLOWER
I20260709 13:14:29.831137  4099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a137dbbc3444cd9afb9e27e0428bacb" member_type: VOTER }
I20260709 13:14:29.831557  4099 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:29.831826  4099 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:29.832124  4099 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:29.836758  4099 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a137dbbc3444cd9afb9e27e0428bacb" member_type: VOTER }
I20260709 13:14:29.837350  4099 leader_election.cc:304] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a137dbbc3444cd9afb9e27e0428bacb; no voters: 
I20260709 13:14:29.838596  4099 leader_election.cc:290] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:29.839080  4102 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:29.840508  4102 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 1 LEADER]: Becoming Leader. State: Replica: 4a137dbbc3444cd9afb9e27e0428bacb, State: Running, Role: LEADER
I20260709 13:14:29.841246  4102 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a137dbbc3444cd9afb9e27e0428bacb" member_type: VOTER }
I20260709 13:14:29.841521  4099 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:29.845887  4103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a137dbbc3444cd9afb9e27e0428bacb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a137dbbc3444cd9afb9e27e0428bacb" member_type: VOTER } }
I20260709 13:14:29.846473  4103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:29.848567  4104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a137dbbc3444cd9afb9e27e0428bacb. Latest consensus state: current_term: 1 leader_uuid: "4a137dbbc3444cd9afb9e27e0428bacb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a137dbbc3444cd9afb9e27e0428bacb" member_type: VOTER } }
I20260709 13:14:29.849073  4104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:29.855988  4110 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:29.862406  4110 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:29.863478 27432 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:29.872116  4110 catalog_manager.cc:1383] Generated new cluster ID: 4fc34eb82b9d4061886ea9257f9c8ecc
I20260709 13:14:29.872437  4110 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:29.897053  4110 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:29.898347  4110 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:29.912532  4110 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb: Generated new TSK 0
I20260709 13:14:29.913187  4110 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:29.930946 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:29.937817  4120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:29.938478  4121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:29.941871  4123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:29.941900 27432 server_base.cc:1061] running on GCE node
I20260709 13:14:29.944458 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:29.944705 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:29.944882 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602869944864 us; error 0 us; skew 500 ppm
I20260709 13:14:29.945444 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:29.947943 27432 webserver.cc:533] Webserver started at http://127.26.202.1:34903/ using document root <none> and password file <none>
I20260709 13:14:29.948446 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:29.948652 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:29.948915 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:29.950002 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/instance:
uuid: "5579adc264d4484692d94b04f0b4f974"
format_stamp: "Formatted at 2026-07-09 13:14:29 on dist-test-slave-008w"
I20260709 13:14:29.955010 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:14:29.958680  4128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:29.959509 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:14:29.959856 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "5579adc264d4484692d94b04f0b4f974"
format_stamp: "Formatted at 2026-07-09 13:14:29 on dist-test-slave-008w"
I20260709 13:14:29.960175 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:29.972505 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:29.973838 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:29.975380 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:29.977775 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:29.977990 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:29.978242 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:29.978442 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.023010 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:35785
I20260709 13:14:30.023128  4190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:35785 every 8 connection(s)
I20260709 13:14:30.028350 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:30.035955  4195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:30.037063  4196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:30.039992  4198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:30.041043 27432 server_base.cc:1061] running on GCE node
I20260709 13:14:30.043738 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:14:30.043764  4191 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40011
W20260709 13:14:30.044173 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:30.044343  4191 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:30.044387 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602870044369 us; error 0 us; skew 500 ppm
I20260709 13:14:30.045356 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:30.045462  4191 heartbeater.cc:507] Master 127.26.202.62:40011 requested a full tablet report, sending...
I20260709 13:14:30.048254  4064 ts_manager.cc:194] Registered new tserver with Master: 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:30.048440 27432 webserver.cc:533] Webserver started at http://127.26.202.2:37125/ using document root <none> and password file <none>
I20260709 13:14:30.049130 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:30.049319 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:30.049635 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:30.050433  4064 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53568
I20260709 13:14:30.050849 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/instance:
uuid: "ecb7bdee23254ebbb5be4faa5795e657"
format_stamp: "Formatted at 2026-07-09 13:14:30 on dist-test-slave-008w"
I20260709 13:14:30.057308 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:14:30.061995  4203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.062897 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:14:30.063220 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-1-root
uuid: "ecb7bdee23254ebbb5be4faa5795e657"
format_stamp: "Formatted at 2026-07-09 13:14:30 on dist-test-slave-008w"
I20260709 13:14:30.063630 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:30.084115 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:30.085572 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:30.087102 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:30.089663 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:30.089911 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.090188 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:30.090389 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.138595 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.2:41405
I20260709 13:14:30.138741  4265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.2:41405 every 8 connection(s)
I20260709 13:14:30.144228 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:30.151925  4269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:30.154363  4270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:30.155504 27432 server_base.cc:1061] running on GCE node
W20260709 13:14:30.156517  4272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:30.157877 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:30.158198 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:30.158432 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602870158406 us; error 0 us; skew 500 ppm
I20260709 13:14:30.159045  4266 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40011
I20260709 13:14:30.159154 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:30.159471  4266 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:30.160283  4266 heartbeater.cc:507] Master 127.26.202.62:40011 requested a full tablet report, sending...
I20260709 13:14:30.162420 27432 webserver.cc:533] Webserver started at http://127.26.202.3:36043/ using document root <none> and password file <none>
I20260709 13:14:30.162734  4064 ts_manager.cc:194] Registered new tserver with Master: ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:30.163110 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:30.163422 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:30.163729 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:30.164053  4064 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53582
I20260709 13:14:30.165267 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/instance:
uuid: "44912ba11bc04ab383e985aa41ec5b38"
format_stamp: "Formatted at 2026-07-09 13:14:30 on dist-test-slave-008w"
I20260709 13:14:30.170102 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:30.174037  4277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.175051 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:14:30.175462 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-2-root
uuid: "44912ba11bc04ab383e985aa41ec5b38"
format_stamp: "Formatted at 2026-07-09 13:14:30 on dist-test-slave-008w"
I20260709 13:14:30.175892 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:30.202867 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:30.204412 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:30.206095 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:30.208557 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:30.208817 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.209123 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:30.209338 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.256947  4339 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.3:35505 every 8 connection(s)
I20260709 13:14:30.256872 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.3:35505
I20260709 13:14:30.262307 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:30.269937  4343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:30.270455  4344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:30.277742  4346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:30.278093  4340 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40011
I20260709 13:14:30.278579  4340 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:30.279269 27432 server_base.cc:1061] running on GCE node
I20260709 13:14:30.279573  4340 heartbeater.cc:507] Master 127.26.202.62:40011 requested a full tablet report, sending...
I20260709 13:14:30.280253 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:30.280537 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:30.280766 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602870280748 us; error 0 us; skew 500 ppm
I20260709 13:14:30.281466 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:30.281878  4064 ts_manager.cc:194] Registered new tserver with Master: 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:30.283555  4064 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53588
I20260709 13:14:30.284188 27432 webserver.cc:533] Webserver started at http://127.26.202.4:33897/ using document root <none> and password file <none>
I20260709 13:14:30.284860 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:30.285128 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:30.285403 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:30.286494 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-3-root/instance:
uuid: "c3b8bb2dfba041dea91b3e6775c34505"
format_stamp: "Formatted at 2026-07-09 13:14:30 on dist-test-slave-008w"
I20260709 13:14:30.291133 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:14:30.294716  4351 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.295564 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:14:30.295884 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-3-root
uuid: "c3b8bb2dfba041dea91b3e6775c34505"
format_stamp: "Formatted at 2026-07-09 13:14:30 on dist-test-slave-008w"
I20260709 13:14:30.296221 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:30.316735 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:30.318075 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:30.319626 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:30.322237 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:30.322494 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.322752 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:30.322930 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:30.372505 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.4:36981
I20260709 13:14:30.372628  4413 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.4:36981 every 8 connection(s)
I20260709 13:14:30.388362  4414 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40011
I20260709 13:14:30.388741  4414 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:30.389773  4414 heartbeater.cc:507] Master 127.26.202.62:40011 requested a full tablet report, sending...
I20260709 13:14:30.391973  4064 ts_manager.cc:194] Registered new tserver with Master: c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:30.392788 27432 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016594672s
I20260709 13:14:30.393718  4064 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53594
I20260709 13:14:30.423219  4064 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53598:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:14:30.681473  4231 tablet_service.cc:1511] Processing CreateTablet for tablet eb795975f5724d21aea741fdb7dc678a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:30.683205  4231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb795975f5724d21aea741fdb7dc678a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.687062  4379 tablet_service.cc:1511] Processing CreateTablet for tablet c157a34e361841ed97d83cab3e137e59 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:30.687723  4378 tablet_service.cc:1511] Processing CreateTablet for tablet fc74b88e70804c2ba5f2b32882e1043a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:30.688664  4379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c157a34e361841ed97d83cab3e137e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.689304  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc74b88e70804c2ba5f2b32882e1043a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.693711  4230 tablet_service.cc:1511] Processing CreateTablet for tablet c157a34e361841ed97d83cab3e137e59 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:30.695233  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c157a34e361841ed97d83cab3e137e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.697561  4305 tablet_service.cc:1511] Processing CreateTablet for tablet eb795975f5724d21aea741fdb7dc678a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:30.699031  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb795975f5724d21aea741fdb7dc678a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.699333  4377 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70326950f444e7ac889e0c48b46af4 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:30.699739  4229 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70326950f444e7ac889e0c48b46af4 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:30.700717  4377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70326950f444e7ac889e0c48b46af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.701242  4229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70326950f444e7ac889e0c48b46af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.706384  4228 tablet_service.cc:1511] Processing CreateTablet for tablet 400506e66b634f6fbfc45dcc033f64f2 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:30.707858  4228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400506e66b634f6fbfc45dcc033f64f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.713313  4376 tablet_service.cc:1511] Processing CreateTablet for tablet 739d61d00a4f4a2688668ab2a87b2b44 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:30.714910  4376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739d61d00a4f4a2688668ab2a87b2b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.718308  4375 tablet_service.cc:1511] Processing CreateTablet for tablet f966b9e1356c4224a74a4b1f6e10fca5 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:30.719807  4375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f966b9e1356c4224a74a4b1f6e10fca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.722352  4374 tablet_service.cc:1511] Processing CreateTablet for tablet b04569646f764da18b971041e8187bf1 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:30.724058  4374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04569646f764da18b971041e8187bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.727591  4304 tablet_service.cc:1511] Processing CreateTablet for tablet fc74b88e70804c2ba5f2b32882e1043a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:30.729702  4304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc74b88e70804c2ba5f2b32882e1043a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.743813  4303 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70326950f444e7ac889e0c48b46af4 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:30.744434  4302 tablet_service.cc:1511] Processing CreateTablet for tablet 400506e66b634f6fbfc45dcc033f64f2 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:30.746232  4303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70326950f444e7ac889e0c48b46af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.747164  4302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400506e66b634f6fbfc45dcc033f64f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.764304  4156 tablet_service.cc:1511] Processing CreateTablet for tablet eb795975f5724d21aea741fdb7dc678a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:30.767050  4156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb795975f5724d21aea741fdb7dc678a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.775864  4155 tablet_service.cc:1511] Processing CreateTablet for tablet c157a34e361841ed97d83cab3e137e59 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:30.778475  4155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c157a34e361841ed97d83cab3e137e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.788178  4154 tablet_service.cc:1511] Processing CreateTablet for tablet fc74b88e70804c2ba5f2b32882e1043a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:30.790371  4154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc74b88e70804c2ba5f2b32882e1043a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.800783  4377 tablet_service.cc:1511] Processing CreateTablet for tablet a48d172190094aa293e39aed636ea970 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:30.802255  4377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48d172190094aa293e39aed636ea970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.847810  4434 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:30.851682  4435 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:30.855461  4434 tablet_bootstrap.cc:654] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.857187  4437 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:30.859400  4435 tablet_bootstrap.cc:654] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.863646  4434 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:30.864305  4434 ts_tablet_manager.cc:1403] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 13:14:30.866012  4437 tablet_bootstrap.cc:654] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:30.903107  4051 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 99819.9us
I20260709 13:14:30.953811  4304 tablet_service.cc:1511] Processing CreateTablet for tablet f966b9e1356c4224a74a4b1f6e10fca5 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
W20260709 13:14:30.956347  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:30.958511  4435 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:30.962594  4302 tablet_service.cc:1511] Processing CreateTablet for tablet b04569646f764da18b971041e8187bf1 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:30.963343  4150 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed53a0a3d8540fcad750a907a09fa6b (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:30.963627  4231 tablet_service.cc:1511] Processing CreateTablet for tablet b04569646f764da18b971041e8187bf1 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:30.964112  4151 tablet_service.cc:1511] Processing CreateTablet for tablet f966b9e1356c4224a74a4b1f6e10fca5 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:30.965493  4231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04569646f764da18b971041e8187bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.965966  4153 tablet_service.cc:1511] Processing CreateTablet for tablet 400506e66b634f6fbfc45dcc033f64f2 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:30.966503  4226 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed53a0a3d8540fcad750a907a09fa6b (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:30.966741  4227 tablet_service.cc:1511] Processing CreateTablet for tablet 739d61d00a4f4a2688668ab2a87b2b44 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:30.956902  4304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f966b9e1356c4224a74a4b1f6e10fca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.969523  4435 ts_tablet_manager.cc:1403] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.006s
I20260709 13:14:30.970032  4152 tablet_service.cc:1511] Processing CreateTablet for tablet 739d61d00a4f4a2688668ab2a87b2b44 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:30.972200  4226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed53a0a3d8540fcad750a907a09fa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.975376  4305 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed53a0a3d8540fcad750a907a09fa6b (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:30.977206  4227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739d61d00a4f4a2688668ab2a87b2b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.977224  4150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed53a0a3d8540fcad750a907a09fa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.978826  4152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739d61d00a4f4a2688668ab2a87b2b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.982091  4378 tablet_service.cc:1511] Processing CreateTablet for tablet 3569c9c3631041cc8cd59b958fd9b9e5 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:30.984368  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3569c9c3631041cc8cd59b958fd9b9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.973472  4302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04569646f764da18b971041e8187bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.986038  4151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f966b9e1356c4224a74a4b1f6e10fca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.989084  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400506e66b634f6fbfc45dcc033f64f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.989606  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed53a0a3d8540fcad750a907a09fa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.995546  4434 raft_consensus.cc:359] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:31.019047  4435 raft_consensus.cc:359] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:31.021718  4435 raft_consensus.cc:385] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.023079  4435 raft_consensus.cc:740] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.024478  4435 consensus_queue.cc:260] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:31.033753  4374 tablet_service.cc:1511] Processing CreateTablet for tablet 6775419b4ff84b9998e052bce5db37ef (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:31.035442  4374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6775419b4ff84b9998e052bce5db37ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.039790  4375 tablet_service.cc:1511] Processing CreateTablet for tablet 90cf1309a8c14cb4aef37461b8eb906c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:31.045501  4375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf1309a8c14cb4aef37461b8eb906c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.053046  4434 raft_consensus.cc:385] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.053637  4434 raft_consensus.cc:740] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.054003  4191 heartbeater.cc:499] Master 127.26.202.62:40011 was elected leader, sending a full tablet report...
I20260709 13:14:31.053537  4149 tablet_service.cc:1511] Processing CreateTablet for tablet a48d172190094aa293e39aed636ea970 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:31.055126  4434 consensus_queue.cc:260] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:31.055830  4149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48d172190094aa293e39aed636ea970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.058233  4303 tablet_service.cc:1511] Processing CreateTablet for tablet 3569c9c3631041cc8cd59b958fd9b9e5 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:31.059697  4303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3569c9c3631041cc8cd59b958fd9b9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.072818  4230 tablet_service.cc:1511] Processing CreateTablet for tablet a48d172190094aa293e39aed636ea970 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:31.075335  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a48d172190094aa293e39aed636ea970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.078639  4376 tablet_service.cc:1511] Processing CreateTablet for tablet 8f45a6a6cb72448ba6e261d361a0f446 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:31.080181  4376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f45a6a6cb72448ba6e261d361a0f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.086460  4434 ts_tablet_manager.cc:1434] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.222s	user 0.013s	sys 0.004s
I20260709 13:14:31.088263  4435 ts_tablet_manager.cc:1434] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.019s
I20260709 13:14:31.090994  4414 heartbeater.cc:499] Master 127.26.202.62:40011 was elected leader, sending a full tablet report...
I20260709 13:14:31.091321  4340 heartbeater.cc:499] Master 127.26.202.62:40011 was elected leader, sending a full tablet report...
I20260709 13:14:31.092851  4148 tablet_service.cc:1511] Processing CreateTablet for tablet 3569c9c3631041cc8cd59b958fd9b9e5 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:31.094601  4148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3569c9c3631041cc8cd59b958fd9b9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.103857  4434 tablet_bootstrap.cc:492] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:31.104278  4437 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:31.104946  4437 ts_tablet_manager.cc:1403] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.248s	user 0.029s	sys 0.044s
I20260709 13:14:31.113241  4435 tablet_bootstrap.cc:492] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:31.112485  4437 raft_consensus.cc:359] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:31.125217  4435 tablet_bootstrap.cc:654] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.125349  4437 raft_consensus.cc:385] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.125751  4437 raft_consensus.cc:740] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.135526  4226 tablet_service.cc:1511] Processing CreateTablet for tablet 6775419b4ff84b9998e052bce5db37ef (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:31.138237  4226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6775419b4ff84b9998e052bce5db37ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.126967  4437 consensus_queue.cc:260] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:31.148030  4228 tablet_service.cc:1511] Processing CreateTablet for tablet e8ed5b6d47f14476bba3acb7086b321e (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:31.151867  4305 tablet_service.cc:1511] Processing CreateTablet for tablet e8ed5b6d47f14476bba3acb7086b321e (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:31.153208  4228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ed5b6d47f14476bba3acb7086b321e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.153735  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ed5b6d47f14476bba3acb7086b321e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.166944  4266 heartbeater.cc:499] Master 127.26.202.62:40011 was elected leader, sending a full tablet report...
I20260709 13:14:31.160185  4304 tablet_service.cc:1511] Processing CreateTablet for tablet 6775419b4ff84b9998e052bce5db37ef (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:31.208096  4434 tablet_bootstrap.cc:654] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:31.214591  4415 tablet.cc:2406] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:31.219349  4442 raft_consensus.cc:493] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.220225  4442 raft_consensus.cc:515] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:31.212765  4443 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:31.234236  4442 leader_election.cc:290] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:31.223958  4304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6775419b4ff84b9998e052bce5db37ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.246214  4230 tablet_service.cc:1511] Processing CreateTablet for tablet 90cf1309a8c14cb4aef37461b8eb906c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:31.247702  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf1309a8c14cb4aef37461b8eb906c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.247503  4377 tablet_service.cc:1511] Processing CreateTablet for tablet f4e8c02c3d29423eb6b91bb28f5e7666 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:31.249763  4377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e8c02c3d29423eb6b91bb28f5e7666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.246214  4152 tablet_service.cc:1511] Processing CreateTablet for tablet e8ed5b6d47f14476bba3acb7086b321e (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:31.267251  4231 tablet_service.cc:1511] Processing CreateTablet for tablet f4e8c02c3d29423eb6b91bb28f5e7666 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:31.268872  4231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e8c02c3d29423eb6b91bb28f5e7666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.284879  4443 tablet_bootstrap.cc:654] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.291121  4441 raft_consensus.cc:493] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.291738  4441 raft_consensus.cc:515] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:31.291917  4376 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea9b5d28359489f94ce555295cfa1ed (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:31.305794  4152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ed5b6d47f14476bba3acb7086b321e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.315371  4374 tablet_service.cc:1511] Processing CreateTablet for tablet cea19effc04e4a57bfe81c26a27db285 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:31.315538  4375 tablet_service.cc:1511] Processing CreateTablet for tablet b82fde8e022a4d05bc9940a384ce326a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:31.315999  4441 leader_election.cc:290] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:31.317211  4375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82fde8e022a4d05bc9940a384ce326a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.319417  4379 tablet_service.cc:1511] Processing CreateTablet for tablet 34d3c8a715e14f2cb977c6ad59220712 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:31.324818  4376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea9b5d28359489f94ce555295cfa1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.331979  4379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d3c8a715e14f2cb977c6ad59220712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.333150  4374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea19effc04e4a57bfe81c26a27db285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.333793  4378 tablet_service.cc:1511] Processing CreateTablet for tablet 3edf1d07e3f84aad9c9bb382774c77a0 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:31.335162  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edf1d07e3f84aad9c9bb382774c77a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.343658  4435 tablet_bootstrap.cc:492] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:31.344273  4435 ts_tablet_manager.cc:1403] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.244s	user 0.042s	sys 0.044s
I20260709 13:14:31.343845  4229 tablet_service.cc:1511] Processing CreateTablet for tablet 7785a087d2b14d74a39cc2bcfd8e408b (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:31.345484  4229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7785a087d2b14d74a39cc2bcfd8e408b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.357785  4435 raft_consensus.cc:359] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:31.358666  4435 raft_consensus.cc:385] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.358979  4435 raft_consensus.cc:740] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.360209  4435 consensus_queue.cc:260] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:31.368233  4153 tablet_service.cc:1511] Processing CreateTablet for tablet 90cf1309a8c14cb4aef37461b8eb906c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:31.381651  4437 ts_tablet_manager.cc:1434] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.272s	user 0.026s	sys 0.044s
I20260709 13:14:31.382784  4437 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:31.383044  4149 tablet_service.cc:1511] Processing CreateTablet for tablet 8f45a6a6cb72448ba6e261d361a0f446 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:31.385587  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf1309a8c14cb4aef37461b8eb906c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.386055  4156 tablet_service.cc:1511] Processing CreateTablet for tablet 7785a087d2b14d74a39cc2bcfd8e408b (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:31.388298  4443 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:31.390663  4156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7785a087d2b14d74a39cc2bcfd8e408b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.393582  4149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f45a6a6cb72448ba6e261d361a0f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.395155  4437 tablet_bootstrap.cc:654] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.410293  4151 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea9b5d28359489f94ce555295cfa1ed (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:31.410557  4154 tablet_service.cc:1511] Processing CreateTablet for tablet cea19effc04e4a57bfe81c26a27db285 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:31.412932  4155 tablet_service.cc:1511] Processing CreateTablet for tablet d6fd7710f5714f70a0f2c2500729d68c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:31.425669  4150 tablet_service.cc:1511] Processing CreateTablet for tablet 34d3c8a715e14f2cb977c6ad59220712 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:31.415951  4443 ts_tablet_manager.cc:1403] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.007s
I20260709 13:14:31.415621  4435 ts_tablet_manager.cc:1434] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.071s	user 0.003s	sys 0.007s
I20260709 13:14:31.439352  4435 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:31.439495  4147 tablet_service.cc:1511] Processing CreateTablet for tablet 3edf1d07e3f84aad9c9bb382774c77a0 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:31.443070  4154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea19effc04e4a57bfe81c26a27db285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.445835  4155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd7710f5714f70a0f2c2500729d68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.451292  4434 tablet_bootstrap.cc:492] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:31.451942  4434 ts_tablet_manager.cc:1403] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.351s	user 0.023s	sys 0.021s
I20260709 13:14:31.455677  4434 raft_consensus.cc:359] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:31.456550  4434 raft_consensus.cc:385] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.456934  4434 raft_consensus.cc:740] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.457757  4434 consensus_queue.cc:260] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:31.460093  4443 raft_consensus.cc:359] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:31.474809  4437 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:31.514823  4443 raft_consensus.cc:385] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.515084  4437 ts_tablet_manager.cc:1403] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.010s
I20260709 13:14:31.515202  4443 raft_consensus.cc:740] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.516115  4443 consensus_queue.cc:260] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:31.481863  4435 tablet_bootstrap.cc:654] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.489025  4150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d3c8a715e14f2cb977c6ad59220712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.492211  4304 tablet_service.cc:1511] Processing CreateTablet for tablet 8f45a6a6cb72448ba6e261d361a0f446 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:31.492594  4303 tablet_service.cc:1511] Processing CreateTablet for tablet f4e8c02c3d29423eb6b91bb28f5e7666 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:31.525782  4304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f45a6a6cb72448ba6e261d361a0f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.493624  4301 tablet_service.cc:1511] Processing CreateTablet for tablet cea19effc04e4a57bfe81c26a27db285 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:31.494280  4302 tablet_service.cc:1511] Processing CreateTablet for tablet 7785a087d2b14d74a39cc2bcfd8e408b (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:31.496096  4300 tablet_service.cc:1511] Processing CreateTablet for tablet b82fde8e022a4d05bc9940a384ce326a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:31.498557  4299 tablet_service.cc:1511] Processing CreateTablet for tablet d6fd7710f5714f70a0f2c2500729d68c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:31.498811  4153 tablet_service.cc:1511] Processing CreateTablet for tablet f43e14aafd634647aacab29418de8662 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:31.500404  4298 tablet_service.cc:1511] Processing CreateTablet for tablet 3edf1d07e3f84aad9c9bb382774c77a0 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:31.521471  4437 raft_consensus.cc:359] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:31.532259  4437 raft_consensus.cc:385] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.502923  4297 tablet_service.cc:1511] Processing CreateTablet for tablet c98f6e00475941138b7b84fa7c833346 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:31.532605  4437 raft_consensus.cc:740] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.505961  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:31.533588  4441 raft_consensus.cc:493] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.534125  4441 raft_consensus.cc:515] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:31.536631  4441 leader_election.cc:290] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:31.520169  4374 tablet_service.cc:1511] Processing CreateTablet for tablet 3c201d492968497482b2b8432e5fbf37 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:31.537827  4374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c201d492968497482b2b8432e5fbf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.541601  4437 consensus_queue.cc:260] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:31.543754  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc74b88e70804c2ba5f2b32882e1043a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:31.544488  4166 raft_consensus.cc:2468] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:31.526985  4301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea19effc04e4a57bfe81c26a27db285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.545697  4299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd7710f5714f70a0f2c2500729d68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.548246  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc74b88e70804c2ba5f2b32882e1043a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:31.549440  4303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e8c02c3d29423eb6b91bb28f5e7666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.550307  4437 ts_tablet_manager.cc:1434] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:14:31.498402  4377 tablet_service.cc:1511] Processing CreateTablet for tablet c98f6e00475941138b7b84fa7c833346 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:31.512938  4296 tablet_service.cc:1511] Processing CreateTablet for tablet f43e14aafd634647aacab29418de8662 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:31.551263  4445 raft_consensus.cc:493] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.551630  4352 leader_election.cc:304] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:31.552203  4377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98f6e00475941138b7b84fa7c833346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.551846  4445 raft_consensus.cc:515] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:31.550117  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70326950f444e7ac889e0c48b46af4" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:31.531451  4443 ts_tablet_manager.cc:1434] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.006s
I20260709 13:14:31.575753  4228 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea9b5d28359489f94ce555295cfa1ed (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:31.577385  4228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea9b5d28359489f94ce555295cfa1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.566565  4441 raft_consensus.cc:2804] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.577894  4441 raft_consensus.cc:493] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.578287  4441 raft_consensus.cc:3060] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.581705  4314 raft_consensus.cc:2468] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:31.582664  4148 tablet_service.cc:1511] Processing CreateTablet for tablet 3c201d492968497482b2b8432e5fbf37 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:31.585306  4229 tablet_service.cc:1511] Processing CreateTablet for tablet b82fde8e022a4d05bc9940a384ce326a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:31.591833  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43e14aafd634647aacab29418de8662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.592556  4229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82fde8e022a4d05bc9940a384ce326a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.594399  4147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edf1d07e3f84aad9c9bb382774c77a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.595572  4227 tablet_service.cc:1511] Processing CreateTablet for tablet d6fd7710f5714f70a0f2c2500729d68c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:31.596983  4227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd7710f5714f70a0f2c2500729d68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.597751  4151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea9b5d28359489f94ce555295cfa1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.550166  4300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82fde8e022a4d05bc9940a384ce326a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.602111  4231 tablet_service.cc:1511] Processing CreateTablet for tablet c98f6e00475941138b7b84fa7c833346 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:31.605621  4231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98f6e00475941138b7b84fa7c833346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.606036  4226 tablet_service.cc:1511] Processing CreateTablet for tablet f43e14aafd634647aacab29418de8662 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:31.607384  4226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43e14aafd634647aacab29418de8662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.607893  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:31.608968  4241 raft_consensus.cc:2468] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:31.610765  4296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43e14aafd634647aacab29418de8662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.610416  4225 tablet_service.cc:1511] Processing CreateTablet for tablet 3c201d492968497482b2b8432e5fbf37 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:31.611927  4225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c201d492968497482b2b8432e5fbf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.612985  4297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98f6e00475941138b7b84fa7c833346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.614190  4302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7785a087d2b14d74a39cc2bcfd8e408b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.614379  4379 tablet_service.cc:1511] Processing CreateTablet for tablet f0f420ee7d254e55a1a16267eb181e9a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 13:14:31.615235  4278 leader_election.cc:343] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.629449  4298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3edf1d07e3f84aad9c9bb382774c77a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.616032  4230 tablet_service.cc:1511] Processing CreateTablet for tablet 34d3c8a715e14f2cb977c6ad59220712 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:31.631752  4278 leader_election.cc:304] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:31.632818  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d3c8a715e14f2cb977c6ad59220712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.632817  4442 raft_consensus.cc:2804] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.633601  4379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f420ee7d254e55a1a16267eb181e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.614787  4445 leader_election.cc:290] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:31.615939  4437 tablet_bootstrap.cc:492] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:31.642649  4148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c201d492968497482b2b8432e5fbf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.653512  4443 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:31.664213  4224 tablet_service.cc:1511] Processing CreateTablet for tablet be46b7b34a104332852aedf71a934cb3 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:14:31.616487  4352 leader_election.cc:343] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.635239  4305 tablet_service.cc:1511] Processing CreateTablet for tablet f0f420ee7d254e55a1a16267eb181e9a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:31.666788  4378 tablet_service.cc:1511] Processing CreateTablet for tablet be46b7b34a104332852aedf71a934cb3 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:31.667290  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f420ee7d254e55a1a16267eb181e9a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:31.666170  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 62243.5us
I20260709 13:14:31.668181  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be46b7b34a104332852aedf71a934cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.668475  4442 raft_consensus.cc:493] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.668982  4442 raft_consensus.cc:3060] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.669337  4352 leader_election.cc:304] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:31.644341  4441 raft_consensus.cc:515] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:31.671949  4441 leader_election.cc:290] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:31.672524  4441 raft_consensus.cc:2804] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.677912  4434 ts_tablet_manager.cc:1434] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.225s	user 0.009s	sys 0.000s
I20260709 13:14:31.672895  4441 raft_consensus.cc:493] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.679116  4441 raft_consensus.cc:3060] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.681351  4154 tablet_service.cc:1511] Processing CreateTablet for tablet f0f420ee7d254e55a1a16267eb181e9a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:31.683353  4154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f420ee7d254e55a1a16267eb181e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.703593  4224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be46b7b34a104332852aedf71a934cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.730800  4375 tablet_service.cc:1511] Processing CreateTablet for tablet fb735e4fccce42b2a96e24b96915088a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:31.732386  4375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb735e4fccce42b2a96e24b96915088a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.733672  4223 tablet_service.cc:1511] Processing CreateTablet for tablet e5ebbec07a3541cbada5d5e7bbb65f60 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:31.735132  4223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ebbec07a3541cbada5d5e7bbb65f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.735419  4437 tablet_bootstrap.cc:654] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.743307  4435 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:31.743978  4435 ts_tablet_manager.cc:1403] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.305s	user 0.041s	sys 0.052s
I20260709 13:14:31.745764  4152 tablet_service.cc:1511] Processing CreateTablet for tablet e5ebbec07a3541cbada5d5e7bbb65f60 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:31.747175  4152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ebbec07a3541cbada5d5e7bbb65f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.747244  4435 raft_consensus.cc:359] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:31.748090  4435 raft_consensus.cc:385] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.748397  4435 raft_consensus.cc:740] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.749202  4435 consensus_queue.cc:260] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:31.751616  4435 ts_tablet_manager.cc:1434] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:31.719360  4434 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:31.760169  4297 tablet_service.cc:1511] Processing CreateTablet for tablet be46b7b34a104332852aedf71a934cb3 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:31.762454  4303 tablet_service.cc:1511] Processing CreateTablet for tablet e5ebbec07a3541cbada5d5e7bbb65f60 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:31.763820  4303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ebbec07a3541cbada5d5e7bbb65f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.760260  4435 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
W20260709 13:14:31.719208  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 49967us
I20260709 13:14:31.786185  4434 tablet_bootstrap.cc:654] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.797658  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc74b88e70804c2ba5f2b32882e1043a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:31.798329  4166 raft_consensus.cc:3060] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.802570  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70326950f444e7ac889e0c48b46af4" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:31.806067  4166 raft_consensus.cc:2468] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
W20260709 13:14:31.807268  4352 leader_election.cc:343] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.808393  4352 leader_election.cc:304] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:31.809398  4460 raft_consensus.cc:2804] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.754827  4442 raft_consensus.cc:515] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:31.768923  4443 tablet_bootstrap.cc:654] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.831014  4442 leader_election.cc:290] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:31.832320  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:31.833038  4241 raft_consensus.cc:3060] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.839888  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:31.840782  4241 raft_consensus.cc:2468] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:31.842191  4278 leader_election.cc:304] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
W20260709 13:14:31.843537  4278 leader_election.cc:343] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.858120  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc74b88e70804c2ba5f2b32882e1043a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
W20260709 13:14:31.867461  4352 leader_election.cc:343] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.853924  4442 raft_consensus.cc:2804] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.871037  4155 tablet_service.cc:1511] Processing CreateTablet for tablet fb735e4fccce42b2a96e24b96915088a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:31.872619  4155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb735e4fccce42b2a96e24b96915088a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.883834  4297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be46b7b34a104332852aedf71a934cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.898473  4229 tablet_service.cc:1511] Processing CreateTablet for tablet fb735e4fccce42b2a96e24b96915088a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:31.900516  4229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb735e4fccce42b2a96e24b96915088a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.881274  4460 raft_consensus.cc:697] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:31.904954  4437 tablet_bootstrap.cc:492] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:31.936892  4437 ts_tablet_manager.cc:1403] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.321s	user 0.041s	sys 0.022s
I20260709 13:14:31.925966  4379 tablet_service.cc:1511] Processing CreateTablet for tablet 469c95e4231846a7b411bc8e662f7897 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:31.938700  4379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469c95e4231846a7b411bc8e662f7897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.940642  4437 raft_consensus.cc:359] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:31.904338  4435 tablet_bootstrap.cc:654] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.942921  4153 tablet_service.cc:1511] Processing CreateTablet for tablet 469c95e4231846a7b411bc8e662f7897 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:31.935889  4460 consensus_queue.cc:237] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:31.944648  4441 raft_consensus.cc:515] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:31.951427  4302 tablet_service.cc:1511] Processing CreateTablet for tablet 469c95e4231846a7b411bc8e662f7897 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:31.941620  4437 raft_consensus.cc:385] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.966897  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469c95e4231846a7b411bc8e662f7897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:31.958794  4445 raft_consensus.cc:493] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.973663  4445 raft_consensus.cc:515] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:31.976743  4445 leader_election.cc:290] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:31.958856  4437 raft_consensus.cc:740] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.992874  4377 tablet_service.cc:1511] Processing CreateTablet for tablet b80801dd62bc4b0894771a460938aa71 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:31.993613  4434 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
W20260709 13:14:31.982081  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:31.961241  4442 raft_consensus.cc:697] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:31.997424  4223 tablet_service.cc:1511] Processing CreateTablet for tablet b80801dd62bc4b0894771a460938aa71 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:32.008956  4377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80801dd62bc4b0894771a460938aa71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.010035  4223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80801dd62bc4b0894771a460938aa71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.010214  4304 tablet_service.cc:1511] Processing CreateTablet for tablet b80801dd62bc4b0894771a460938aa71 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:32.004961  4434 ts_tablet_manager.cc:1403] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.324s	user 0.035s	sys 0.049s
I20260709 13:14:32.018810  4435 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:32.018635  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:32.019383  4435 ts_tablet_manager.cc:1403] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.259s	user 0.038s	sys 0.017s
I20260709 13:14:32.020401  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:32.022135  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c157a34e361841ed97d83cab3e137e59" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:32.024168  4204 leader_election.cc:343] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.024699  4204 leader_election.cc:304] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:32.025552  4445 raft_consensus.cc:2749] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:32.027002  4204 leader_election.cc:343] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.027925  4435 raft_consensus.cc:359] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.028712  4435 raft_consensus.cc:385] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.029036  4435 raft_consensus.cc:740] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.029942  4435 consensus_queue.cc:260] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.012918  4302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469c95e4231846a7b411bc8e662f7897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.038875  4148 tablet_service.cc:1511] Processing CreateTablet for tablet 752f5e425310433598dde61b0db31f15 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:32.039438  4434 raft_consensus.cc:359] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:32.040339  4434 raft_consensus.cc:385] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.040673  4434 raft_consensus.cc:740] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.041510  4148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752f5e425310433598dde61b0db31f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.041815  4434 consensus_queue.cc:260] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:32.044126  4434 ts_tablet_manager.cc:1434] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:14:32.045344  4434 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:32.050845  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70326950f444e7ac889e0c48b46af4" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:32.051899  4441 leader_election.cc:290] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:32.052143  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70326950f444e7ac889e0c48b46af4" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:32.052826  4314 raft_consensus.cc:3060] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.008384  4437 consensus_queue.cc:260] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:32.055845  4437 ts_tablet_manager.cc:1434] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.001s
I20260709 13:14:32.057634  4437 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:32.059386  4241 raft_consensus.cc:3060] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.060994  4443 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:32.061720  4443 ts_tablet_manager.cc:1403] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.408s	user 0.027s	sys 0.030s
I20260709 13:14:32.065569  4443 raft_consensus.cc:359] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.067109  4443 raft_consensus.cc:385] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.067492  4443 raft_consensus.cc:740] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.067968  4435 ts_tablet_manager.cc:1434] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:14:32.068696  4304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80801dd62bc4b0894771a460938aa71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.068487  4443 consensus_queue.cc:260] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.074630  4442 consensus_queue.cc:237] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.075137  4441 raft_consensus.cc:493] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.076005  4441 raft_consensus.cc:515] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.084425  4241 raft_consensus.cc:2468] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:32.086090  4443 ts_tablet_manager.cc:1434] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:14:32.069195  4435 tablet_bootstrap.cc:492] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:32.093204  4314 raft_consensus.cc:2468] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:32.094797  4230 tablet_service.cc:1511] Processing CreateTablet for tablet 752f5e425310433598dde61b0db31f15 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:32.095857  4352 leader_election.cc:304] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:32.096203  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752f5e425310433598dde61b0db31f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.097015  4462 raft_consensus.cc:2804] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:32.113276  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c157a34e361841ed97d83cab3e137e59" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:32.114655  4062 catalog_manager.cc:5697] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.119669  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c157a34e361841ed97d83cab3e137e59" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:32.120442  4389 raft_consensus.cc:2468] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:32.123592  4378 tablet_service.cc:1511] Processing CreateTablet for tablet 9d73dfdf505542c191c5ec6047bb5fcb (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:32.124996  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d73dfdf505542c191c5ec6047bb5fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.129142  4443 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:32.129550  4207 leader_election.cc:304] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:32.130493  4445 raft_consensus.cc:2804] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.130877  4445 raft_consensus.cc:493] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.131235  4445 raft_consensus.cc:3060] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:32.134959  4352 leader_election.cc:343] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.135573  4225 tablet_service.cc:1511] Processing CreateTablet for tablet 9d73dfdf505542c191c5ec6047bb5fcb (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:32.136986  4225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d73dfdf505542c191c5ec6047bb5fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.139751  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c157a34e361841ed97d83cab3e137e59" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:32.142654  4153 tablet_service.cc:1511] Processing CreateTablet for tablet 9d73dfdf505542c191c5ec6047bb5fcb (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:32.146631  4435 tablet_bootstrap.cc:654] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.146944  4298 tablet_service.cc:1511] Processing CreateTablet for tablet 21a1999637a0409fbafc5b729b043472 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:32.148348  4298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a1999637a0409fbafc5b729b043472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.152312  4375 tablet_service.cc:1511] Processing CreateTablet for tablet 21a1999637a0409fbafc5b729b043472 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:32.144326  4441 leader_election.cc:290] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:32.153643  4375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a1999637a0409fbafc5b729b043472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.157725  4445 raft_consensus.cc:515] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.158542  4443 tablet_bootstrap.cc:654] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.159094  4240 raft_consensus.cc:2393] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3b8bb2dfba041dea91b3e6775c34505 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:32.160696  4445 leader_election.cc:290] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:32.161612  4303 tablet_service.cc:1511] Processing CreateTablet for tablet 752f5e425310433598dde61b0db31f15 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:32.162312  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c157a34e361841ed97d83cab3e137e59" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:32.144156  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d73dfdf505542c191c5ec6047bb5fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.165272  4154 tablet_service.cc:1511] Processing CreateTablet for tablet 21a1999637a0409fbafc5b729b043472 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:32.168099  4154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a1999637a0409fbafc5b729b043472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.163053  4352 leader_election.cc:304] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:32.169557  4460 raft_consensus.cc:3060] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.169903  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c157a34e361841ed97d83cab3e137e59" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:32.144564  4462 raft_consensus.cc:697] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:32.171289  4462 consensus_queue.cc:237] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:32.171741  4229 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfea592b3be44feb8ed92ca07526a44 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:32.173251  4229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfea592b3be44feb8ed92ca07526a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.164804  4434 tablet_bootstrap.cc:654] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:32.168004  4204 leader_election.cc:343] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.162739  4437 tablet_bootstrap.cc:654] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.165274  4441 raft_consensus.cc:493] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.177584  4441 raft_consensus.cc:515] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.179991  4441 leader_election.cc:290] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:32.182123  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d172190094aa293e39aed636ea970" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:32.182441  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d172190094aa293e39aed636ea970" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:32.184473  4303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752f5e425310433598dde61b0db31f15. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:32.189365  4352 leader_election.cc:343] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:32.190208  4352 leader_election.cc:343] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.190653  4352 leader_election.cc:304] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:32.190647  4460 raft_consensus.cc:2749] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:32.191996  4460 raft_consensus.cc:2749] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:32.208585  4304 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfea592b3be44feb8ed92ca07526a44 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:32.210191  4304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfea592b3be44feb8ed92ca07526a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.216066  4389 raft_consensus.cc:2468] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:32.220781  4379 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfea592b3be44feb8ed92ca07526a44 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:32.222226  4379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfea592b3be44feb8ed92ca07526a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.224929  4225 tablet_service.cc:1511] Processing CreateTablet for tablet 65e836aa87f0415ab357635172010986 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:32.226332  4225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e836aa87f0415ab357635172010986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.239593  4305 tablet_service.cc:1511] Processing CreateTablet for tablet 65e836aa87f0415ab357635172010986 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:32.241291  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e836aa87f0415ab357635172010986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.250825  4377 tablet_service.cc:1511] Processing CreateTablet for tablet cebbff40bd944f06b60fe91902f8e57a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:32.252401  4377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebbff40bd944f06b60fe91902f8e57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.254137  4150 tablet_service.cc:1511] Processing CreateTablet for tablet cebbff40bd944f06b60fe91902f8e57a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:32.255599  4150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebbff40bd944f06b60fe91902f8e57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.258240  4230 tablet_service.cc:1511] Processing CreateTablet for tablet cebbff40bd944f06b60fe91902f8e57a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:32.276866  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebbff40bd944f06b60fe91902f8e57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.224874  4153 tablet_service.cc:1511] Processing CreateTablet for tablet 65e836aa87f0415ab357635172010986 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:32.302589  4207 leader_election.cc:304] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:32.304781  4445 raft_consensus.cc:2804] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:32.309486  4064 catalog_manager.cc:5697] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:32.289187  4374 tablet_service.cc:1511] Processing CreateTablet for tablet fa55eb9f8d154841ba534af714307367 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:32.312078  4374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa55eb9f8d154841ba534af714307367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.312831  4148 tablet_service.cc:1511] Processing CreateTablet for tablet fa55eb9f8d154841ba534af714307367 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:32.315797  4148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa55eb9f8d154841ba534af714307367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.328806  4435 tablet_bootstrap.cc:492] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:32.335572  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e836aa87f0415ab357635172010986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.339799  4225 tablet_service.cc:1511] Processing CreateTablet for tablet 762ce0ab18a64b88be473be55dedb1a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:32.337540  4445 raft_consensus.cc:697] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:32.342288  4378 tablet_service.cc:1511] Processing CreateTablet for tablet 762ce0ab18a64b88be473be55dedb1a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:32.344727  4443 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:32.344846  4299 tablet_service.cc:1511] Processing CreateTablet for tablet 762ce0ab18a64b88be473be55dedb1a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:32.346012  4435 ts_tablet_manager.cc:1403] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.277s	user 0.014s	sys 0.013s
I20260709 13:14:32.350613  4155 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf65ed933a94d2781c82e8e3145354a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:32.350677  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762ce0ab18a64b88be473be55dedb1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.352378  4223 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf65ed933a94d2781c82e8e3145354a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:32.354905  4435 raft_consensus.cc:359] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:32.350966  4443 ts_tablet_manager.cc:1403] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.245s	user 0.018s	sys 0.002s
I20260709 13:14:32.360020  4223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf65ed933a94d2781c82e8e3145354a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.356354  4299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762ce0ab18a64b88be473be55dedb1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.359714  4443 raft_consensus.cc:359] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.364174  4443 raft_consensus.cc:385] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.364585  4443 raft_consensus.cc:740] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.367085  4434 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:32.367477  4435 raft_consensus.cc:385] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.367671  4434 ts_tablet_manager.cc:1403] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.323s	user 0.013s	sys 0.021s
I20260709 13:14:32.365872  4443 consensus_queue.cc:260] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.307416  4297 tablet_service.cc:1511] Processing CreateTablet for tablet fa55eb9f8d154841ba534af714307367 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:32.371194  4297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa55eb9f8d154841ba534af714307367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.371359  4437 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:32.371963  4437 ts_tablet_manager.cc:1403] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.315s	user 0.008s	sys 0.014s
I20260709 13:14:32.373517  4155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf65ed933a94d2781c82e8e3145354a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.372743  4225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762ce0ab18a64b88be473be55dedb1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.368996  4435 raft_consensus.cc:740] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.370364  4445 consensus_queue.cc:237] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.376559  4435 consensus_queue.cc:260] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:32.372784  4434 raft_consensus.cc:359] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.381080  4434 raft_consensus.cc:385] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.381484  4434 raft_consensus.cc:740] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.381726  4457 raft_consensus.cc:493] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.382304  4457 raft_consensus.cc:515] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.385396  4457 leader_election.cc:290] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:32.386083  4434 consensus_queue.cc:260] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.388758  4434 ts_tablet_manager.cc:1434] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:14:32.395341  4443 ts_tablet_manager.cc:1434] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:14:32.400511  4298 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf65ed933a94d2781c82e8e3145354a (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:32.410534  4437 raft_consensus.cc:359] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.411526  4437 raft_consensus.cc:385] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.414631  4437 raft_consensus.cc:740] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.423306  4442 raft_consensus.cc:493] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.411540  4379 tablet_service.cc:1511] Processing CreateTablet for tablet f9e515c59fdd462087377434a2fda3aa (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:32.420332  4150 tablet_service.cc:1511] Processing CreateTablet for tablet f9e515c59fdd462087377434a2fda3aa (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:32.447829  4379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e515c59fdd462087377434a2fda3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.448521  4150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e515c59fdd462087377434a2fda3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.448609  4302 tablet_service.cc:1511] Processing CreateTablet for tablet 8e41d162a7f742a0b613d0a3e9ebaeb2 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:32.429265  4443 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:32.416980  4298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf65ed933a94d2781c82e8e3145354a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.459627  4434 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:32.446348  4442 raft_consensus.cc:515] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:32.419232  4230 tablet_service.cc:1511] Processing CreateTablet for tablet f9e515c59fdd462087377434a2fda3aa (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:32.468669  4302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e41d162a7f742a0b613d0a3e9ebaeb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.478173  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e515c59fdd462087377434a2fda3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.486393  4374 tablet_service.cc:1511] Processing CreateTablet for tablet 8e41d162a7f742a0b613d0a3e9ebaeb2 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:32.487936  4374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e41d162a7f742a0b613d0a3e9ebaeb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.490235  4435 ts_tablet_manager.cc:1434] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.000s
I20260709 13:14:32.499084  4154 tablet_service.cc:1511] Processing CreateTablet for tablet 8e41d162a7f742a0b613d0a3e9ebaeb2 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:32.500840  4154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e41d162a7f742a0b613d0a3e9ebaeb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.502929  4435 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:32.509410  4442 leader_election.cc:290] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:32.464816  4437 consensus_queue.cc:260] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.540541  4378 tablet_service.cc:1511] Processing CreateTablet for tablet fcb55c5197494054ac66ee0284bc1234 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:32.548851  4437 ts_tablet_manager.cc:1434] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.176s	user 0.006s	sys 0.009s
I20260709 13:14:32.550040  4223 tablet_service.cc:1511] Processing CreateTablet for tablet fcb55c5197494054ac66ee0284bc1234 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:32.550658  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb55c5197494054ac66ee0284bc1234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.550096  4437 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:32.554430  4314 raft_consensus.cc:3060] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.563090  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc74b88e70804c2ba5f2b32882e1043a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:32.564113  4165 raft_consensus.cc:2393] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44912ba11bc04ab383e985aa41ec5b38 in current term 1: Already voted for candidate c3b8bb2dfba041dea91b3e6775c34505 in this term.
I20260709 13:14:32.564538  4223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb55c5197494054ac66ee0284bc1234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.564621  4305 tablet_service.cc:1511] Processing CreateTablet for tablet fcb55c5197494054ac66ee0284bc1234 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:32.566421  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb55c5197494054ac66ee0284bc1234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.570765  4435 tablet_bootstrap.cc:654] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.580806  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc74b88e70804c2ba5f2b32882e1043a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:32.581718  4153 tablet_service.cc:1511] Processing CreateTablet for tablet c6a4b9478f394578ba05a6d2c9402d7c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:32.582091  4462 consensus_queue.cc:1048] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:32.583171  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a4b9478f394578ba05a6d2c9402d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.582907  4281 leader_election.cc:304] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:32.593357  4442 raft_consensus.cc:2749] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:32.595824  4443 tablet_bootstrap.cc:654] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.604842  4229 tablet_service.cc:1511] Processing CreateTablet for tablet c6a4b9478f394578ba05a6d2c9402d7c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:32.606464  4229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a4b9478f394578ba05a6d2c9402d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.619159  4063 catalog_manager.cc:5697] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:32.623961  4434 tablet_bootstrap.cc:654] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.616621  4062 catalog_manager.cc:5697] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:32.638922  4437 tablet_bootstrap.cc:654] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.646872  4462 consensus_queue.cc:1048] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:32.653138  4435 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:32.653793  4435 ts_tablet_manager.cc:1403] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.004s
I20260709 13:14:32.657330  4435 raft_consensus.cc:359] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.658172  4435 raft_consensus.cc:385] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.658514  4435 raft_consensus.cc:740] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.659487  4435 consensus_queue.cc:260] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.661902  4457 raft_consensus.cc:493] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.662494  4457 raft_consensus.cc:515] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.666321  4457 leader_election.cc:290] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:32.669394  4305 tablet_service.cc:1511] Processing CreateTablet for tablet c6a4b9478f394578ba05a6d2c9402d7c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:32.670985  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a4b9478f394578ba05a6d2c9402d7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.685145  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:32.687872  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c157a34e361841ed97d83cab3e137e59" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:32.688848  4389 raft_consensus.cc:2393] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:32.693040  4441 consensus_queue.cc:1048] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:32.691092  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:32.690452  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c157a34e361841ed97d83cab3e137e59" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:32.688911  4129 leader_election.cc:343] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:32.708976  4278 consensus_peers.cc:597] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.728178  4378 tablet_service.cc:1511] Processing CreateTablet for tablet a9bbf2e5f1eb4b198b54c28a89a20bc9 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:32.731750  4443 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:32.732379  4443 ts_tablet_manager.cc:1403] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.303s	user 0.017s	sys 0.002s
W20260709 13:14:32.729696  4129 leader_election.cc:343] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.734226  4129 leader_election.cc:304] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:32.735061  4457 raft_consensus.cc:2749] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:32.731753  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bbf2e5f1eb4b198b54c28a89a20bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.736418  4129 leader_election.cc:304] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:32.741724  4443 raft_consensus.cc:359] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.742619  4443 raft_consensus.cc:385] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.742969  4443 raft_consensus.cc:740] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.743868  4443 consensus_queue.cc:260] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:32.746039  4435 ts_tablet_manager.cc:1434] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:14:32.746560  4457 raft_consensus.cc:3060] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.746364  4442 raft_consensus.cc:493] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.755388  4442 raft_consensus.cc:515] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.756595  4150 tablet_service.cc:1511] Processing CreateTablet for tablet a9bbf2e5f1eb4b198b54c28a89a20bc9 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:32.758145  4150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bbf2e5f1eb4b198b54c28a89a20bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.761509  4435 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:32.762477  4223 tablet_service.cc:1511] Processing CreateTablet for tablet a9bbf2e5f1eb4b198b54c28a89a20bc9 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:32.763947  4223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9bbf2e5f1eb4b198b54c28a89a20bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.766070  4442 leader_election.cc:290] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:32.767843  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400506e66b634f6fbfc45dcc033f64f2" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:32.770368  4278 leader_election.cc:343] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.770033  4379 tablet_service.cc:1511] Processing CreateTablet for tablet 41f0e5b41dc8442a8c42396f1323e8f7 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:32.781107  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400506e66b634f6fbfc45dcc033f64f2" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:32.782195  4241 raft_consensus.cc:2468] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:32.781216  4379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f0e5b41dc8442a8c42396f1323e8f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.784840  4229 tablet_service.cc:1511] Processing CreateTablet for tablet 1f31b1c5c2a1430fbb22163bc29c247f (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:32.786247  4229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f31b1c5c2a1430fbb22163bc29c247f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.782110  4153 tablet_service.cc:1511] Processing CreateTablet for tablet 41f0e5b41dc8442a8c42396f1323e8f7 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:32.771997  4298 tablet_service.cc:1511] Processing CreateTablet for tablet 41f0e5b41dc8442a8c42396f1323e8f7 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:32.788899  4457 raft_consensus.cc:2749] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:32.797673  4437 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:32.798321  4437 ts_tablet_manager.cc:1403] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.248s	user 0.026s	sys 0.038s
I20260709 13:14:32.799522  4443 ts_tablet_manager.cc:1434] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.067s	user 0.014s	sys 0.011s
I20260709 13:14:32.800453  4435 tablet_bootstrap.cc:654] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.794744  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f0e5b41dc8442a8c42396f1323e8f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.809044  4298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f0e5b41dc8442a8c42396f1323e8f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.812654  4443 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:32.805927  4434 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:32.817553  4434 ts_tablet_manager.cc:1403] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.367s	user 0.013s	sys 0.015s
I20260709 13:14:32.813679  4437 raft_consensus.cc:359] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.820195  4437 raft_consensus.cc:385] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.821962  4155 tablet_service.cc:1511] Processing CreateTablet for tablet 476b62391a0c41cba2d9c578b2e05b4e (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:32.823534  4155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476b62391a0c41cba2d9c578b2e05b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.820539  4437 raft_consensus.cc:740] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.805442  4278 leader_election.cc:304] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:32.825925  4442 raft_consensus.cc:2804] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:32.826323  4442 raft_consensus.cc:493] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.826696  4442 raft_consensus.cc:3060] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:32.826452  4374 tablet_service.cc:1511] Processing CreateTablet for tablet 1f31b1c5c2a1430fbb22163bc29c247f (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:32.827970  4374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f31b1c5c2a1430fbb22163bc29c247f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.823304  4230 tablet_service.cc:1511] Processing CreateTablet for tablet 476b62391a0c41cba2d9c578b2e05b4e (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:32.830353  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476b62391a0c41cba2d9c578b2e05b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.843784  4445 consensus_queue.cc:1048] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:32.856518  4498 raft_consensus.cc:493] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.854800  4437 consensus_queue.cc:260] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.857957  4498 raft_consensus.cc:515] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:32.860522  4498 leader_election.cc:290] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:32.861071  4441 consensus_queue.cc:1048] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:32.865080  4437 ts_tablet_manager.cc:1434] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:14:32.865072  4305 tablet_service.cc:1511] Processing CreateTablet for tablet 1f31b1c5c2a1430fbb22163bc29c247f (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:14:32.868952  4496 log.cc:927] Time spent T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:14:32.878567  4503 consensus_queue.cc:1048] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:32.879168  4302 tablet_service.cc:1511] Processing CreateTablet for tablet 476b62391a0c41cba2d9c578b2e05b4e (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:32.880527  4302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 476b62391a0c41cba2d9c578b2e05b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.881897  4437 tablet_bootstrap.cc:492] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:32.883459  4378 tablet_service.cc:1511] Processing CreateTablet for tablet e17a5871d73843d9867ab8076cbd10ac (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:32.891209  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17a5871d73843d9867ab8076cbd10ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.889537  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:32.889823  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:32.909459  4150 tablet_service.cc:1511] Processing CreateTablet for tablet e17a5871d73843d9867ab8076cbd10ac (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:32.910910  4150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17a5871d73843d9867ab8076cbd10ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.913297  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f31b1c5c2a1430fbb22163bc29c247f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:32.917153  4352 leader_election.cc:343] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.926290  4443 tablet_bootstrap.cc:654] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:32.926914  4377 tablet_service.cc:1511] Processing CreateTablet for tablet d79b38c9325e4a73a58f685c1a82a83c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:32.928277  4377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d79b38c9325e4a73a58f685c1a82a83c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:32.928658  4352 leader_election.cc:343] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:32.929147  4352 leader_election.cc:304] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:32.930879  4498 raft_consensus.cc:2749] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:32.932614  4304 tablet_service.cc:1511] Processing CreateTablet for tablet d79b38c9325e4a73a58f685c1a82a83c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:32.934103  4304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d79b38c9325e4a73a58f685c1a82a83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.938115  4148 tablet_service.cc:1511] Processing CreateTablet for tablet d79b38c9325e4a73a58f685c1a82a83c (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:32.930574  4225 tablet_service.cc:1511] Processing CreateTablet for tablet e17a5871d73843d9867ab8076cbd10ac (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:32.940106  4225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17a5871d73843d9867ab8076cbd10ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.951267  4148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d79b38c9325e4a73a58f685c1a82a83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:32.962967  4435 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:32.963594  4435 ts_tablet_manager.cc:1403] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.203s	user 0.022s	sys 0.014s
I20260709 13:14:32.968665  4435 raft_consensus.cc:359] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:32.969435  4435 raft_consensus.cc:385] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.969364  4434 raft_consensus.cc:359] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.969971  4435 raft_consensus.cc:740] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.970288  4434 raft_consensus.cc:385] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:32.970647  4434 raft_consensus.cc:740] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:32.970920  4435 consensus_queue.cc:260] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:32.971407  4434 consensus_queue.cc:260] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:32.973932  4435 ts_tablet_manager.cc:1434] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:14:32.975566  4435 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:33.016251  4374 tablet_service.cc:1511] Processing CreateTablet for tablet 54e3336557ec4724bcb643f2bb5728a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:33.017737  4374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e3336557ec4724bcb643f2bb5728a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.023916  4303 tablet_service.cc:1511] Processing CreateTablet for tablet 54e3336557ec4724bcb643f2bb5728a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:33.025862  4303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e3336557ec4724bcb643f2bb5728a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.038401  4442 raft_consensus.cc:515] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.042212  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400506e66b634f6fbfc45dcc033f64f2" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
W20260709 13:14:33.043805  4278 leader_election.cc:343] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.049180  4462 raft_consensus.cc:493] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.049909  4442 leader_election.cc:290] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:33.049803  4462 raft_consensus.cc:515] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.051065  4437 tablet_bootstrap.cc:654] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.052100  4462 leader_election.cc:290] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:33.060676  4435 tablet_bootstrap.cc:654] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:33.066035  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:33.075762  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:33.077612  4378 tablet_service.cc:1511] Processing CreateTablet for tablet 6ced5da688734c378b6fa628fca1e639 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:33.078879  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ced5da688734c378b6fa628fca1e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.067128  4462 raft_consensus.cc:493] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.072067  4442 raft_consensus.cc:493] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.082751  4462 raft_consensus.cc:515] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.094841  4154 tablet_service.cc:1511] Processing CreateTablet for tablet 6ced5da688734c378b6fa628fca1e639 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:33.095551  4462 leader_election.cc:290] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:33.087419  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:33.096410  4154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ced5da688734c378b6fa628fca1e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.086498  4442 raft_consensus.cc:515] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.102135  4153 tablet_service.cc:1511] Processing CreateTablet for tablet 7c54676fa8be4fbcb6132a795b560f53 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:33.108771  4304 tablet_service.cc:1511] Processing CreateTablet for tablet 7c54676fa8be4fbcb6132a795b560f53 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:33.110428  4304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c54676fa8be4fbcb6132a795b560f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.111353  4434 ts_tablet_manager.cc:1434] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.293s	user 0.008s	sys 0.002s
I20260709 13:14:33.112653  4434 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:33.119292  4379 tablet_service.cc:1511] Processing CreateTablet for tablet d8c9caf0b83f44a9bc3b6b2fd38789a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:33.120893  4379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c9caf0b83f44a9bc3b6b2fd38789a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.111156  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:33.088171  4352 leader_election.cc:343] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.122386  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c54676fa8be4fbcb6132a795b560f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.126520  4305 tablet_service.cc:1511] Processing CreateTablet for tablet d8c9caf0b83f44a9bc3b6b2fd38789a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:33.127842  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c9caf0b83f44a9bc3b6b2fd38789a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.128715  4166 raft_consensus.cc:2468] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:33.104838  4442 leader_election.cc:290] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:33.152786  4278 leader_election.cc:304] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:33.161350  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739d61d00a4f4a2688668ab2a87b2b44" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:33.162283  4166 raft_consensus.cc:2468] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:33.163102  4442 raft_consensus.cc:2804] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:33.166131  4443 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:33.164788  4297 tablet_service.cc:1511] Processing CreateTablet for tablet da6d778f3b244e66937e6d76ff2e1062 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:33.166874  4443 ts_tablet_manager.cc:1403] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.355s	user 0.019s	sys 0.019s
I20260709 13:14:33.167373  4297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6d778f3b244e66937e6d76ff2e1062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.165598  4442 raft_consensus.cc:493] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.171455  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739d61d00a4f4a2688668ab2a87b2b44" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:33.169714  4442 raft_consensus.cc:3060] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.175725  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400506e66b634f6fbfc45dcc033f64f2" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:33.176354  4241 raft_consensus.cc:3060] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.183204  4378 tablet_service.cc:1511] Processing CreateTablet for tablet da6d778f3b244e66937e6d76ff2e1062 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:33.184752  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6d778f3b244e66937e6d76ff2e1062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.191286  4443 raft_consensus.cc:359] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.192502  4443 raft_consensus.cc:385] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.196560  4153 tablet_service.cc:1511] Processing CreateTablet for tablet d8c9caf0b83f44a9bc3b6b2fd38789a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:33.197788  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c9caf0b83f44a9bc3b6b2fd38789a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:33.171849  4352 leader_election.cc:343] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.192912  4443 raft_consensus.cc:740] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.218099  4443 consensus_queue.cc:260] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.219002  4435 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:33.219589  4435 ts_tablet_manager.cc:1403] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.244s	user 0.015s	sys 0.003s
I20260709 13:14:33.220077  4443 ts_tablet_manager.cc:1434] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:14:33.221005  4443 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:33.221642  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:33.222364  4239 raft_consensus.cc:2468] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:33.222644  4435 raft_consensus.cc:359] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.223394  4435 raft_consensus.cc:385] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.223670  4435 raft_consensus.cc:740] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.226029  4155 tablet_service.cc:1511] Processing CreateTablet for tablet 842c1af88b9a449eaf38dadb53be5452 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:33.228060  4241 raft_consensus.cc:2468] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:33.229360  4155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842c1af88b9a449eaf38dadb53be5452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.232190  4443 tablet_bootstrap.cc:654] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.224408  4435 consensus_queue.cc:260] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.239316  4435 ts_tablet_manager.cc:1434] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:14:33.204349  4352 leader_election.cc:304] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:33.243800  4435 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:33.249172  4305 tablet_service.cc:1511] Processing CreateTablet for tablet 842c1af88b9a449eaf38dadb53be5452 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:33.249501  4225 tablet_service.cc:1511] Processing CreateTablet for tablet 54e3336557ec4724bcb643f2bb5728a6 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:33.249876  4223 tablet_service.cc:1511] Processing CreateTablet for tablet 7c54676fa8be4fbcb6132a795b560f53 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:33.250502  4305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842c1af88b9a449eaf38dadb53be5452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.250946  4231 tablet_service.cc:1511] Processing CreateTablet for tablet 842c1af88b9a449eaf38dadb53be5452 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:33.251286  4229 tablet_service.cc:1511] Processing CreateTablet for tablet 6ced5da688734c378b6fa628fca1e639 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:33.252971  4278 leader_election.cc:304] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:33.253865  4230 tablet_service.cc:1511] Processing CreateTablet for tablet da6d778f3b244e66937e6d76ff2e1062 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:33.254202  4503 raft_consensus.cc:2804] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.254703  4503 raft_consensus.cc:697] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:33.255595  4503 consensus_queue.cc:237] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.259652  4437 tablet_bootstrap.cc:492] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:33.260291  4437 ts_tablet_manager.cc:1403] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.385s	user 0.016s	sys 0.014s
I20260709 13:14:33.264358  4434 tablet_bootstrap.cc:654] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:33.269502  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 97720.9us
I20260709 13:14:33.269722  4462 raft_consensus.cc:2749] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.270364  4352 leader_election.cc:304] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:33.271276  4462 raft_consensus.cc:2804] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:33.271756  4462 raft_consensus.cc:493] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.272195  4462 raft_consensus.cc:3060] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:33.272735  4352 leader_election.cc:343] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.280778  4435 tablet_bootstrap.cc:654] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.284548  4225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e3336557ec4724bcb643f2bb5728a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.289872  4223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c54676fa8be4fbcb6132a795b560f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.243937  4442 raft_consensus.cc:515] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.292137  4442 leader_election.cc:290] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:33.293246  4231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842c1af88b9a449eaf38dadb53be5452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.312904  4230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6d778f3b244e66937e6d76ff2e1062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.318279  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:33.319075  4166 raft_consensus.cc:3060] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.319200  4148 tablet_service.cc:1511] Processing CreateTablet for tablet 53ab991adb234419a39cef0dd745b8fc (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:33.320576  4148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ab991adb234419a39cef0dd745b8fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:33.325908  4207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 54428.2us
I20260709 13:14:33.329304  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:33.330019  4240 raft_consensus.cc:3060] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.329802  4224 tablet_service.cc:1511] Processing CreateTablet for tablet 53ab991adb234419a39cef0dd745b8fc (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:33.330113  4378 tablet_service.cc:1511] Processing CreateTablet for tablet 53ab991adb234419a39cef0dd745b8fc (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:33.331156  4224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ab991adb234419a39cef0dd745b8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.331681  4378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53ab991adb234419a39cef0dd745b8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.336256  4517 consensus_queue.cc:1048] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:33.349726  4437 raft_consensus.cc:359] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.350497  4437 raft_consensus.cc:385] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.350785  4437 raft_consensus.cc:740] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.351737  4437 consensus_queue.cc:260] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.360499  4377 tablet_service.cc:1511] Processing CreateTablet for tablet bf28675179d3498593c326d198268cc9 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:33.362022  4377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf28675179d3498593c326d198268cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.364446  4153 tablet_service.cc:1511] Processing CreateTablet for tablet bf28675179d3498593c326d198268cc9 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:33.365865  4153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf28675179d3498593c326d198268cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.402143  4509 raft_consensus.cc:493] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.403007  4509 raft_consensus.cc:515] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.405356  4502 raft_consensus.cc:493] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.405964  4502 raft_consensus.cc:515] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.408210  4502 leader_election.cc:290] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:33.408587  4166 raft_consensus.cc:2468] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:33.410447  4443 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:33.410274  4278 leader_election.cc:304] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:33.410281  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:33.411166  4443 ts_tablet_manager.cc:1403] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.190s	user 0.042s	sys 0.057s
I20260709 13:14:33.411438  4503 raft_consensus.cc:2804] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.411926  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:33.412192  4352 leader_election.cc:343] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.412029  4503 raft_consensus.cc:697] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:33.413471  4503 consensus_queue.cc:237] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.414636  4443 raft_consensus.cc:359] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.415493  4443 raft_consensus.cc:385] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.415823  4443 raft_consensus.cc:740] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.416615  4443 consensus_queue.cc:260] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.418272  4437 ts_tablet_manager.cc:1434] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.158s	user 0.004s	sys 0.004s
I20260709 13:14:33.420462  4443 ts_tablet_manager.cc:1434] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:14:33.420887  4437 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:33.421588  4443 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:33.336742  4462 raft_consensus.cc:515] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.400112  4229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ced5da688734c378b6fa628fca1e639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.414726  4303 tablet_service.cc:1511] Processing CreateTablet for tablet bf28675179d3498593c326d198268cc9 (DEFAULT_TABLE table=test-workload [id=f2f3c8e8eb6f423ba08cc5e3e27879a3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:33.433369  4303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf28675179d3498593c326d198268cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.438715  4437 tablet_bootstrap.cc:654] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.438810  4462 leader_election.cc:290] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:33.445130  4434 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:33.445708  4434 ts_tablet_manager.cc:1403] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.333s	user 0.011s	sys 0.042s
W20260709 13:14:33.446496  4352 leader_election.cc:343] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.447248  4352 leader_election.cc:304] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:33.448650  4502 raft_consensus.cc:2749] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.448848  4434 raft_consensus.cc:359] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.449859  4434 raft_consensus.cc:385] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.450171  4434 raft_consensus.cc:740] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.450928  4434 consensus_queue.cc:260] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.453850  4434 ts_tablet_manager.cc:1434] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:33.455054  4434 tablet_bootstrap.cc:492] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:33.455506  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739d61d00a4f4a2688668ab2a87b2b44" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:33.457258  4435 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:33.457782  4435 ts_tablet_manager.cc:1403] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.011s
I20260709 13:14:33.461753  4509 leader_election.cc:290] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:33.462797  4435 raft_consensus.cc:359] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.463490  4435 raft_consensus.cc:385] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.463732  4435 raft_consensus.cc:740] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.464344  4435 consensus_queue.cc:260] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.470201  4435 ts_tablet_manager.cc:1434] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:14:33.471139  4435 tablet_bootstrap.cc:492] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:33.469851  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739d61d00a4f4a2688668ab2a87b2b44" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:33.472960  4166 raft_consensus.cc:3060] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.473712  4063 catalog_manager.cc:5697] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.466581  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
W20260709 13:14:33.478736  4204 leader_election.cc:343] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.482841  4240 raft_consensus.cc:2468] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:33.488252  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:33.489064  4389 raft_consensus.cc:2468] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
W20260709 13:14:33.488097  4352 leader_election.cc:343] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.461694  4434 tablet_bootstrap.cc:654] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.493409  4207 leader_election.cc:304] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:33.494729  4509 raft_consensus.cc:2804] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:33.495136  4509 raft_consensus.cc:493] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.495481  4509 raft_consensus.cc:3060] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.507894  4509 raft_consensus.cc:515] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.511663  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
W20260709 13:14:33.513298  4204 leader_election.cc:343] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.514810  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:33.516116  4435 tablet_bootstrap.cc:654] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.515515  4389 raft_consensus.cc:3060] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.520576  4434 tablet_bootstrap.cc:492] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:33.521257  4434 ts_tablet_manager.cc:1403] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.003s
I20260709 13:14:33.522651  4443 tablet_bootstrap.cc:654] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.520814  4166 raft_consensus.cc:2468] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:33.526151  4352 leader_election.cc:304] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:33.527638  4462 raft_consensus.cc:2804] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.528214  4462 raft_consensus.cc:697] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:33.529291  4462 consensus_queue.cc:237] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.530817  4389 raft_consensus.cc:2468] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:33.516058  4509 leader_election.cc:290] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:33.527628  4434 raft_consensus.cc:359] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.543174  4434 raft_consensus.cc:385] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.548064  4207 leader_election.cc:304] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:33.548558  4434 raft_consensus.cc:740] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.549641  4509 raft_consensus.cc:2804] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.550222  4509 raft_consensus.cc:697] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:33.551097  4509 consensus_queue.cc:237] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.553751  4437 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:33.551242  4434 consensus_queue.cc:260] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.554347  4437 ts_tablet_manager.cc:1403] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.134s	user 0.028s	sys 0.022s
I20260709 13:14:33.563580  4434 ts_tablet_manager.cc:1434] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:14:33.564739  4434 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:33.561832  4437 raft_consensus.cc:359] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.565416  4437 raft_consensus.cc:385] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.565864  4437 raft_consensus.cc:740] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.569948  4443 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:33.570804  4443 ts_tablet_manager.cc:1403] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.149s	user 0.030s	sys 0.008s
I20260709 13:14:33.571806  4437 consensus_queue.cc:260] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.574841  4064 catalog_manager.cc:5697] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.576788  4437 ts_tablet_manager.cc:1434] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:14:33.577613  4435 tablet_bootstrap.cc:492] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:33.579561  4435 ts_tablet_manager.cc:1403] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.008s
I20260709 13:14:33.580504  4443 raft_consensus.cc:359] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.581305  4443 raft_consensus.cc:385] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.581627  4443 raft_consensus.cc:740] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.582386  4443 consensus_queue.cc:260] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.582634  4435 raft_consensus.cc:359] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.582283  4062 catalog_manager.cc:5697] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.584926  4443 ts_tablet_manager.cc:1434] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:33.583359  4435 raft_consensus.cc:385] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.585508  4435 raft_consensus.cc:740] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.586369  4434 tablet_bootstrap.cc:654] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.586493  4435 consensus_queue.cc:260] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.589253  4435 ts_tablet_manager.cc:1434] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:14:33.590564  4443 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:33.590991  4437 tablet_bootstrap.cc:492] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:33.590692  4435 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:33.601800  4435 tablet_bootstrap.cc:654] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.602043  4443 tablet_bootstrap.cc:654] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.615208  4434 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:33.615921  4434 ts_tablet_manager.cc:1403] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.003s
I20260709 13:14:33.623395  4437 tablet_bootstrap.cc:654] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.629204  4462 raft_consensus.cc:493] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.630721  4462 raft_consensus.cc:515] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.637501  4503 raft_consensus.cc:493] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.638347  4503 raft_consensus.cc:515] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.643792  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:33.647446  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:33.648654  4389 raft_consensus.cc:2393] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44912ba11bc04ab383e985aa41ec5b38 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:33.648957  4457 raft_consensus.cc:493] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.649539  4457 raft_consensus.cc:515] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.651988  4457 leader_election.cc:290] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:33.652709  4278 leader_election.cc:304] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:33.653230  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:33.653918  4389 raft_consensus.cc:2468] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:33.654206  4442 raft_consensus.cc:3060] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.655362  4132 leader_election.cc:304] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:33.656409  4457 raft_consensus.cc:2804] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:33.656790  4457 raft_consensus.cc:493] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.657172  4457 raft_consensus.cc:3060] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.657539  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:33.658264  4314 raft_consensus.cc:2468] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:33.660880  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6775419b4ff84b9998e052bce5db37ef" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:33.663058  4352 leader_election.cc:343] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.665174  4457 raft_consensus.cc:515] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.666039  4503 leader_election.cc:290] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:33.666759  4462 leader_election.cc:290] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:33.667666  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6775419b4ff84b9998e052bce5db37ef" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:33.668435  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
W20260709 13:14:33.669202  4352 leader_election.cc:343] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.669835  4352 leader_election.cc:304] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:33.670802  4462 raft_consensus.cc:2749] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.672609  4442 raft_consensus.cc:2749] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.672995  4389 raft_consensus.cc:3060] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.673710  4434 raft_consensus.cc:359] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.674486  4435 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:33.675650  4434 raft_consensus.cc:385] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.675792  4435 ts_tablet_manager.cc:1403] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.085s	user 0.045s	sys 0.026s
I20260709 13:14:33.676586  4434 raft_consensus.cc:740] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.677883  4434 consensus_queue.cc:260] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.680325  4539 raft_consensus.cc:493] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.682171  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:33.685554  4314 raft_consensus.cc:3060] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.681988  4435 raft_consensus.cc:359] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.684530  4457 leader_election.cc:290] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:33.685987  4435 raft_consensus.cc:385] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.686301  4435 raft_consensus.cc:740] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.687433  4435 consensus_queue.cc:260] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.691421  4435 ts_tablet_manager.cc:1434] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:14:33.692417  4435 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:33.698576  4435 tablet_bootstrap.cc:654] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.702320  4437 tablet_bootstrap.cc:492] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:33.703120  4437 ts_tablet_manager.cc:1403] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.005s
I20260709 13:14:33.707581  4443 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:33.707597  4437 raft_consensus.cc:359] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.708314  4443 ts_tablet_manager.cc:1403] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.118s	user 0.019s	sys 0.059s
I20260709 13:14:33.708519  4437 raft_consensus.cc:385] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.708973  4437 raft_consensus.cc:740] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.709987  4437 consensus_queue.cc:260] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.711294  4443 raft_consensus.cc:359] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.712114  4443 raft_consensus.cc:385] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.712384  4443 raft_consensus.cc:740] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.713219  4443 consensus_queue.cc:260] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.702154  4063 catalog_manager.cc:5697] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.685189  4539 raft_consensus.cc:515] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.683151  4389 raft_consensus.cc:2468] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:33.719003  4132 leader_election.cc:304] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:33.719321  4539 leader_election.cc:290] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:33.719952  4457 raft_consensus.cc:2804] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.720489  4457 raft_consensus.cc:697] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:33.720575  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:33.720731  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:33.721487  4457 consensus_queue.cc:237] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.726686  4437 ts_tablet_manager.cc:1434] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 13:14:33.716820  4314 raft_consensus.cc:2468] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:33.726420  4129 leader_election.cc:304] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:33.730644  4437 tablet_bootstrap.cc:492] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:33.728924  4166 raft_consensus.cc:3060] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.715603  4443 ts_tablet_manager.cc:1434] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:14:33.733728  4443 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:33.684659  4434 ts_tablet_manager.cc:1434] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.004s
I20260709 13:14:33.736266  4434 tablet_bootstrap.cc:492] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:33.731029  4435 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:33.740149  4435 ts_tablet_manager.cc:1403] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.023s
I20260709 13:14:33.744374  4437 tablet_bootstrap.cc:654] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.748373  4443 tablet_bootstrap.cc:654] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.748395  4435 raft_consensus.cc:359] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.750895  4165 raft_consensus.cc:3060] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.751533  4462 raft_consensus.cc:493] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.759572  4435 raft_consensus.cc:385] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.760267  4435 raft_consensus.cc:740] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.761178  4435 consensus_queue.cc:260] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.764408  4435 ts_tablet_manager.cc:1434] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:14:33.765859  4435 tablet_bootstrap.cc:492] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:33.762321  4462 raft_consensus.cc:515] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.768671  4462 leader_election.cc:290] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:33.773427  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:33.775238  4064 catalog_manager.cc:5697] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.780783  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:33.782630  4352 leader_election.cc:343] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:33.783390  4352 leader_election.cc:343] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.783870  4352 leader_election.cc:304] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:33.776458  4434 tablet_bootstrap.cc:654] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.785596  4462 raft_consensus.cc:2749] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.786309  4509 raft_consensus.cc:493] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.788811  4509 raft_consensus.cc:515] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.791163  4509 leader_election.cc:290] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:33.787078  4442 consensus_queue.cc:1048] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:33.792133  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d172190094aa293e39aed636ea970" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:33.792836  4389 raft_consensus.cc:2468] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:33.792204  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d172190094aa293e39aed636ea970" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:33.795873  4165 raft_consensus.cc:2468] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:33.797259  4204 leader_election.cc:304] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:33.798255  4509 raft_consensus.cc:2804] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:33.798669  4509 raft_consensus.cc:493] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.798993  4509 raft_consensus.cc:3060] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.799643  4437 tablet_bootstrap.cc:492] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:33.800165  4437 ts_tablet_manager.cc:1403] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.018s
I20260709 13:14:33.804761  4437 raft_consensus.cc:359] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.805593  4437 raft_consensus.cc:385] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.805857  4437 raft_consensus.cc:740] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.806522  4437 consensus_queue.cc:260] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.808481  4437 ts_tablet_manager.cc:1434] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:33.808493  4539 raft_consensus.cc:2749] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.809528  4435 tablet_bootstrap.cc:654] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.811528  4437 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:33.819638  4437 tablet_bootstrap.cc:654] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.831065  4509 raft_consensus.cc:515] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.834558  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d172190094aa293e39aed636ea970" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:33.835482  4389 raft_consensus.cc:3060] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.838786  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d172190094aa293e39aed636ea970" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:33.839488  4166 raft_consensus.cc:3060] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.847360  4166 raft_consensus.cc:2468] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:33.847668  4389 raft_consensus.cc:2468] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:33.851676  4435 tablet_bootstrap.cc:492] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:33.857065  4434 tablet_bootstrap.cc:492] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:33.857254  4435 ts_tablet_manager.cc:1403] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.007s
I20260709 13:14:33.857594  4434 ts_tablet_manager.cc:1403] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.122s	user 0.023s	sys 0.017s
I20260709 13:14:33.857551  4207 leader_election.cc:304] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:33.859000  4513 raft_consensus.cc:2804] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.859503  4513 raft_consensus.cc:697] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:33.860193  4435 raft_consensus.cc:359] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.851681  4443 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:33.855818  4437 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:33.861445  4437 ts_tablet_manager.cc:1403] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.010s
I20260709 13:14:33.860955  4435 raft_consensus.cc:385] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.862087  4435 raft_consensus.cc:740] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.862874  4435 consensus_queue.cc:260] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.864434  4437 raft_consensus.cc:359] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.864995  4435 ts_tablet_manager.cc:1434] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:33.865192  4437 raft_consensus.cc:385] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.865479  4437 raft_consensus.cc:740] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.866124  4435 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:33.866194  4437 consensus_queue.cc:260] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.868351  4437 ts_tablet_manager.cc:1434] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:14:33.855743  4509 leader_election.cc:290] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:33.860321  4513 consensus_queue.cc:237] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.860544  4434 raft_consensus.cc:359] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.869738  4434 raft_consensus.cc:385] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.870093  4434 raft_consensus.cc:740] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.861450  4443 ts_tablet_manager.cc:1403] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.128s	user 0.016s	sys 0.013s
I20260709 13:14:33.870718  4434 consensus_queue.cc:260] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.872882  4435 tablet_bootstrap.cc:654] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.873090  4434 ts_tablet_manager.cc:1434] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:14:33.873238  4443 raft_consensus.cc:359] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.874019  4443 raft_consensus.cc:385] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.874212  4434 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:33.874320  4443 raft_consensus.cc:740] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.875221  4443 consensus_queue.cc:260] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.877511  4437 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:33.876878  4443 ts_tablet_manager.cc:1434] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:33.880604  4443 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:33.885098  4506 consensus_queue.cc:1048] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:33.890341  4434 tablet_bootstrap.cc:654] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.895807  4443 tablet_bootstrap.cc:654] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.896073  4437 tablet_bootstrap.cc:654] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.898873  4506 consensus_queue.cc:1048] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:33.901787  4509 raft_consensus.cc:493] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.902459  4509 raft_consensus.cc:515] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:33.905405  4509 leader_election.cc:290] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:33.905841  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739d61d00a4f4a2688668ab2a87b2b44" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:33.906672  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739d61d00a4f4a2688668ab2a87b2b44" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:33.907356  4435 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:33.907516  4164 raft_consensus.cc:2393] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate c3b8bb2dfba041dea91b3e6775c34505 in this term.
I20260709 13:14:33.907908  4435 ts_tablet_manager.cc:1403] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.009s
I20260709 13:14:33.909070  4204 leader_election.cc:304] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:33.910395  4509 raft_consensus.cc:3060] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.911196  4435 raft_consensus.cc:359] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.912011  4435 raft_consensus.cc:385] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.911283  4060 catalog_manager.cc:5697] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.912315  4435 raft_consensus.cc:740] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.913477  4435 consensus_queue.cc:260] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.914307  4462 raft_consensus.cc:493] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.914774  4462 raft_consensus.cc:515] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.917670  4435 ts_tablet_manager.cc:1434] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:14:33.918736  4435 tablet_bootstrap.cc:492] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:33.920362  4437 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:33.920866  4437 ts_tablet_manager.cc:1403] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.001s
I20260709 13:14:33.925462  4435 tablet_bootstrap.cc:654] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.927995  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:33.917721  4434 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:33.929337  4434 ts_tablet_manager.cc:1403] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.000s
W20260709 13:14:33.930055  4352 leader_election.cc:343] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.932438  4434 raft_consensus.cc:359] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.933262  4434 raft_consensus.cc:385] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.933627  4434 raft_consensus.cc:740] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.919157  4509 raft_consensus.cc:2749] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.935369  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:33.924839  4437 raft_consensus.cc:359] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.938311  4437 raft_consensus.cc:385] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.938723  4437 raft_consensus.cc:740] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.933691  4462 leader_election.cc:290] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:33.938628  4509 consensus_queue.cc:1048] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:33.938961  4352 leader_election.cc:343] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.939558  4434 consensus_queue.cc:260] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.941780  4352 leader_election.cc:304] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:33.943455  4502 raft_consensus.cc:2749] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:33.942551  4462 raft_consensus.cc:493] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.943734  4435 tablet_bootstrap.cc:492] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:33.944327  4435 ts_tablet_manager.cc:1403] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:14:33.945618  4462 raft_consensus.cc:515] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:33.954972  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3569c9c3631041cc8cd59b958fd9b9e5" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:33.955984  4314 raft_consensus.cc:2468] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:33.946751  4437 consensus_queue.cc:260] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:33.947124  4435 raft_consensus.cc:359] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.962296  4435 raft_consensus.cc:385] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.963016  4435 raft_consensus.cc:740] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.970413  4437 ts_tablet_manager.cc:1434] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:14:33.953321  4462 leader_election.cc:290] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:33.980068  4435 consensus_queue.cc:260] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:33.989704  4443 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:33.990495  4443 ts_tablet_manager.cc:1403] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.110s	user 0.005s	sys 0.007s
I20260709 13:14:33.982712  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3569c9c3631041cc8cd59b958fd9b9e5" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:33.994751  4352 leader_election.cc:304] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:34.000662  4502 raft_consensus.cc:2804] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.001147  4502 raft_consensus.cc:493] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.001471  4502 raft_consensus.cc:3060] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.003265  4437 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:33.998472  4462 consensus_queue.cc:1048] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:14:34.006059  4462 raft_consensus.cc:493] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.006578  4462 raft_consensus.cc:515] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.009346  4539 raft_consensus.cc:493] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.010123  4539 raft_consensus.cc:515] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.014526  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.014192  4443 raft_consensus.cc:359] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.015398  4443 raft_consensus.cc:385] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.015776  4443 raft_consensus.cc:740] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.015813  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
W20260709 13:14:34.016049  4129 leader_election.cc:343] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.024299  4435 ts_tablet_manager.cc:1434] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.003s
I20260709 13:14:34.016848  4443 consensus_queue.cc:260] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.008795  4462 leader_election.cc:290] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.029641  4435 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:34.016758  4388 raft_consensus.cc:2468] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:34.032912  4434 ts_tablet_manager.cc:1434] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.103s	user 0.023s	sys 0.030s
I20260709 13:14:34.014389  4539 leader_election.cc:290] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.040064  4434 tablet_bootstrap.cc:492] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:34.030191  4166 raft_consensus.cc:2468] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:34.043459  4132 leader_election.cc:304] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.048369  4435 tablet_bootstrap.cc:654] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.051038  4437 tablet_bootstrap.cc:654] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.038244  4442 consensus_queue.cc:1048] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:14:34.054726  4434 tablet_bootstrap.cc:654] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.055691  4539 raft_consensus.cc:2804] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.056638  4539 raft_consensus.cc:493] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.062492  4539 raft_consensus.cc:3060] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.065392  4502 raft_consensus.cc:515] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.081615  4509 raft_consensus.cc:493] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.082293  4509 raft_consensus.cc:515] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.086571  4509 leader_election.cc:290] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:34.095782  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6775419b4ff84b9998e052bce5db37ef" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.096635  4314 raft_consensus.cc:2468] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:34.098269  4204 leader_election.cc:304] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:34.099433  4509 raft_consensus.cc:2804] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.099900  4509 raft_consensus.cc:493] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.100311  4509 raft_consensus.cc:3060] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.106005  4443 ts_tablet_manager.cc:1434] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.115s	user 0.010s	sys 0.003s
I20260709 13:14:34.107120  4443 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:34.108556  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea9b5d28359489f94ce555295cfa1ed" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.111411  4457 consensus_queue.cc:1048] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:34.098346  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea9b5d28359489f94ce555295cfa1ed" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.120412  4443 tablet_bootstrap.cc:654] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:34.121860  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:34.112072  4539 raft_consensus.cc:515] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.123852  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6775419b4ff84b9998e052bce5db37ef" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:34.124764  4388 raft_consensus.cc:2468] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:34.126221  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:34.127055  4387 raft_consensus.cc:3060] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.138330  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3569c9c3631041cc8cd59b958fd9b9e5" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:34.140282  4539 leader_election.cc:290] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.173620  4435 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:34.183799  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:34.185743  4517 raft_consensus.cc:493] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:34.186586  4129 leader_election.cc:343] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.186363  4517 raft_consensus.cc:515] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.188995  4517 leader_election.cc:290] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:34.162206  4445 consensus_queue.cc:1048] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:14:34.191447  4435 ts_tablet_manager.cc:1403] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.164s	user 0.039s	sys 0.016s
I20260709 13:14:34.163192  4314 raft_consensus.cc:3060] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.193665  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e8c02c3d29423eb6b91bb28f5e7666" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.196828  4566 raft_consensus.cc:493] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.205506  4462 raft_consensus.cc:493] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.206141  4462 raft_consensus.cc:515] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.206063  4566 raft_consensus.cc:515] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
W20260709 13:14:34.207954  4204 leader_election.cc:343] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.208781  4462 leader_election.cc:290] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:34.209214  4566 leader_election.cc:290] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:34.208824  4539 consensus_queue.cc:1048] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:34.184247  4509 raft_consensus.cc:515] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.164549  4502 leader_election.cc:290] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:34.215020  4314 raft_consensus.cc:2468] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:34.222003  4509 leader_election.cc:290] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
W20260709 13:14:34.215943  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 53714.4us
I20260709 13:14:34.223167  4503 raft_consensus.cc:493] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:34.223523  4352 leader_election.cc:343] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.223888  4503 raft_consensus.cc:515] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.226239  4503 leader_election.cc:290] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.232789  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed5b6d47f14476bba3acb7086b321e" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.234054  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed5b6d47f14476bba3acb7086b321e" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:34.237087  4278 leader_election.cc:343] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.237694  4387 raft_consensus.cc:2468] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
W20260709 13:14:34.237824  4278 leader_election.cc:343] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.274030  4435 raft_consensus.cc:359] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.275125  4435 raft_consensus.cc:385] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.227005  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3569c9c3631041cc8cd59b958fd9b9e5" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:34.239995  4278 leader_election.cc:304] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.278273  4166 raft_consensus.cc:3060] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.228410  4312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e8c02c3d29423eb6b91bb28f5e7666" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.229732  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e8c02c3d29423eb6b91bb28f5e7666" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.280252  4240 raft_consensus.cc:2468] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:34.249789  4132 leader_election.cc:304] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.228950  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82fde8e022a4d05bc9940a384ce326a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.285745  4539 raft_consensus.cc:2804] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.286150  4503 raft_consensus.cc:2749] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.286557  4539 raft_consensus.cc:697] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:34.238860  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6775419b4ff84b9998e052bce5db37ef" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:34.287604  4314 raft_consensus.cc:3060] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.287806  4539 consensus_queue.cc:237] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.226891  4352 leader_election.cc:304] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
W20260709 13:14:34.289530  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 62736.7us
I20260709 13:14:34.229378  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82fde8e022a4d05bc9940a384ce326a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.289448  4437 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:34.291745  4437 ts_tablet_manager.cc:1403] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.289s	user 0.033s	sys 0.065s
I20260709 13:14:34.292929  4435 raft_consensus.cc:740] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.293840  4462 raft_consensus.cc:2804] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:34.303737  4352 leader_election.cc:343] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.304247  4352 leader_election.cc:304] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.304991  4509 consensus_queue.cc:1048] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:34.305281  4566 consensus_queue.cc:1048] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:34.306517  4566 raft_consensus.cc:2749] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.299679  4166 raft_consensus.cc:2468] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:34.301783  4434 tablet_bootstrap.cc:492] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:34.310914  4434 ts_tablet_manager.cc:1403] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.276s	user 0.106s	sys 0.081s
I20260709 13:14:34.302227  4435 consensus_queue.cc:260] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.311265  4437 raft_consensus.cc:359] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.313114  4437 raft_consensus.cc:385] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.313462  4437 raft_consensus.cc:740] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.314312  4437 consensus_queue.cc:260] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.317040  4509 raft_consensus.cc:493] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.317835  4437 ts_tablet_manager.cc:1434] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:14:34.317708  4509 raft_consensus.cc:515] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.318701  4437 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:34.323132  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.325332  4437 tablet_bootstrap.cc:654] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:34.325480  4204 leader_election.cc:343] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.310828  4462 raft_consensus.cc:697] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:34.326638  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.327207  4462 consensus_queue.cc:237] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:34.328176  4204 leader_election.cc:343] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.332544  4204 leader_election.cc:304] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:34.334192  4435 ts_tablet_manager.cc:1434] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.002s
I20260709 13:14:34.334779  4445 raft_consensus.cc:2749] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.336212  4314 raft_consensus.cc:2468] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:34.336925  4434 raft_consensus.cc:359] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.337728  4434 raft_consensus.cc:385] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.337981  4434 raft_consensus.cc:740] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.338523  4204 leader_election.cc:304] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:34.338714  4434 consensus_queue.cc:260] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.339439  4445 raft_consensus.cc:2804] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.339917  4445 raft_consensus.cc:697] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:34.320823  4509 leader_election.cc:290] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:34.340801  4434 ts_tablet_manager.cc:1434] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.000s
I20260709 13:14:34.347548  4434 tablet_bootstrap.cc:492] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:34.348277  4443 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:34.348824  4443 ts_tablet_manager.cc:1403] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.242s	user 0.019s	sys 0.018s
I20260709 13:14:34.351006  4435 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:34.356285  4352 leader_election.cc:304] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
W20260709 13:14:34.358040  4352 leader_election.cc:343] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.363726  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e8c02c3d29423eb6b91bb28f5e7666" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:34.362511  4502 raft_consensus.cc:2804] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.340765  4445 consensus_queue.cc:237] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.363242  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6775419b4ff84b9998e052bce5db37ef" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:34.368710  4502 raft_consensus.cc:493] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.376256  4389 raft_consensus.cc:3060] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.379245  4502 raft_consensus.cc:3060] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:34.380559  4352 leader_election.cc:343] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:34.382742  4352 leader_election.cc:343] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.383312  4352 leader_election.cc:304] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.386695  4437 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:34.387439  4437 ts_tablet_manager.cc:1403] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.069s	user 0.001s	sys 0.012s
I20260709 13:14:34.402859  4443 raft_consensus.cc:359] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.403523  4443 raft_consensus.cc:385] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.403760  4443 raft_consensus.cc:740] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.404639  4443 consensus_queue.cc:260] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.407192  4443 ts_tablet_manager.cc:1434] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:14:34.408591  4443 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:34.393496  4566 raft_consensus.cc:2749] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.415970  4513 consensus_queue.cc:1048] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:34.426040  4579 raft_consensus.cc:493] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.436710  4435 tablet_bootstrap.cc:654] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.438333  4389 raft_consensus.cc:2468] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:34.431092  4579 raft_consensus.cc:515] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.437701  4437 raft_consensus.cc:359] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.446208  4437 raft_consensus.cc:385] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.446676  4437 raft_consensus.cc:740] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.448203  4437 consensus_queue.cc:260] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.441372  4579 leader_election.cc:290] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.440623  4502 raft_consensus.cc:515] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.459286  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d3c8a715e14f2cb977c6ad59220712" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.459944  4388 raft_consensus.cc:2393] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate c3b8bb2dfba041dea91b3e6775c34505 in this term.
I20260709 13:14:34.460785  4502 leader_election.cc:290] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:34.452343  4437 ts_tablet_manager.cc:1434] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.001s
I20260709 13:14:34.451552  4060 catalog_manager.cc:5697] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.453670  4063 catalog_manager.cc:5697] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.455260  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d3c8a715e14f2cb977c6ad59220712" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.456467  4434 tablet_bootstrap.cc:654] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.462132  4437 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:34.470352  4437 tablet_bootstrap.cc:654] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.470793  4443 tablet_bootstrap.cc:654] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.476764  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e8c02c3d29423eb6b91bb28f5e7666" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:34.477578  4239 raft_consensus.cc:3060] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.481622  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e8c02c3d29423eb6b91bb28f5e7666" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:34.483383  4207 leader_election.cc:304] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505
W20260709 13:14:34.483430  4352 leader_election.cc:343] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.485399  4313 raft_consensus.cc:3060] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.500187  4539 raft_consensus.cc:493] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.502383  4539 raft_consensus.cc:515] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.506556  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.507854  4539 leader_election.cc:290] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:34.508162  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
W20260709 13:14:34.508544  4129 leader_election.cc:343] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.508927  4386 raft_consensus.cc:2468] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:34.513504  4435 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:34.514428  4435 ts_tablet_manager.cc:1403] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.165s	user 0.017s	sys 0.010s
I20260709 13:14:34.514778  4132 leader_election.cc:304] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:34.516615  4539 raft_consensus.cc:2804] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.517212  4539 raft_consensus.cc:493] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.517671  4539 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:34.524857  4352 leader_election.cc:343] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.525759  4352 leader_election.cc:304] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.526965  4579 raft_consensus.cc:2749] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.534199  4434 tablet_bootstrap.cc:492] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:34.534976  4434 ts_tablet_manager.cc:1403] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.004s
I20260709 13:14:34.538961  4434 raft_consensus.cc:359] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.539345  4435 raft_consensus.cc:359] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.539880  4434 raft_consensus.cc:385] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.540081  4435 raft_consensus.cc:385] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.540377  4434 raft_consensus.cc:740] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.540387  4435 raft_consensus.cc:740] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.542908  4434 consensus_queue.cc:260] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.539368  4313 raft_consensus.cc:2468] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:34.543458  4239 raft_consensus.cc:2468] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:34.544137  4445 raft_consensus.cc:2749] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.543591  4435 consensus_queue.cc:260] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.545194  4434 ts_tablet_manager.cc:1434] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:14:34.546200  4434 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:34.546662  4435 ts_tablet_manager.cc:1434] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:14:34.547703  4435 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:34.552480  4437 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:34.553052  4437 ts_tablet_manager.cc:1403] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.040s
I20260709 13:14:34.553615  4435 tablet_bootstrap.cc:654] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.554634  4352 leader_election.cc:304] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:34.556154  4437 raft_consensus.cc:359] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.557145  4437 raft_consensus.cc:385] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.557502  4437 raft_consensus.cc:740] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.559264  4061 catalog_manager.cc:5697] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.567127  4443 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:34.570137  4443 ts_tablet_manager.cc:1403] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.162s	user 0.020s	sys 0.038s
I20260709 13:14:34.573271  4579 raft_consensus.cc:2804] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.574123  4579 raft_consensus.cc:697] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:34.575350  4579 consensus_queue.cc:237] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.578572  4539 raft_consensus.cc:515] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.579574  4443 raft_consensus.cc:359] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.580415  4443 raft_consensus.cc:385] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.580760  4443 raft_consensus.cc:740] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.580821  4437 consensus_queue.cc:260] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.582155  4539 leader_election.cc:290] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:34.581727  4443 consensus_queue.cc:260] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.582022  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:34.583424  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:34.584036  4386 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.584408  4437 ts_tablet_manager.cc:1434] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
W20260709 13:14:34.584292  4129 leader_election.cc:343] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.585755  4437 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:34.584556  4443 ts_tablet_manager.cc:1434] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:34.587010  4443 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:34.587800  4445 raft_consensus.cc:493] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.588330  4445 raft_consensus.cc:515] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.590652  4445 leader_election.cc:290] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:34.591398  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed5b6d47f14476bba3acb7086b321e" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.573200  4434 tablet_bootstrap.cc:654] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.602916  4445 raft_consensus.cc:493] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.603474  4445 raft_consensus.cc:515] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.604743  4437 tablet_bootstrap.cc:654] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.605706  4445 leader_election.cc:290] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
W20260709 13:14:34.607731  4204 leader_election.cc:343] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.608052  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:34.608916  4389 raft_consensus.cc:2393] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
I20260709 13:14:34.609208  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.593420  4443 tablet_bootstrap.cc:654] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.593478  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed5b6d47f14476bba3acb7086b321e" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.611692  4313 raft_consensus.cc:2468] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:34.612239  4386 raft_consensus.cc:2468] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:34.595091  4435 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:34.613711  4435 ts_tablet_manager.cc:1403] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.016s
I20260709 13:14:34.614462  4207 leader_election.cc:304] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:34.615187  4445 raft_consensus.cc:3060] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.617512  4132 leader_election.cc:304] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:34.618642  4539 raft_consensus.cc:2804] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.619132  4539 raft_consensus.cc:697] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:34.619387  4204 leader_election.cc:304] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:34.620028  4539 consensus_queue.cc:237] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.622646  4513 raft_consensus.cc:2804] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.623065  4513 raft_consensus.cc:493] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.623415  4513 raft_consensus.cc:3060] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.620564  4435 raft_consensus.cc:359] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.624402  4435 raft_consensus.cc:385] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.624718  4435 raft_consensus.cc:740] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.625478  4435 consensus_queue.cc:260] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.627699  4435 ts_tablet_manager.cc:1434] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:34.628846  4435 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:34.629057  4434 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:34.629606  4434 ts_tablet_manager.cc:1403] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.004s
I20260709 13:14:34.632396  4434 raft_consensus.cc:359] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.633139  4434 raft_consensus.cc:385] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.633411  4434 raft_consensus.cc:740] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.634074  4434 consensus_queue.cc:260] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.637636  4443 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:34.638265  4443 ts_tablet_manager.cc:1403] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 13:14:34.641471  4434 ts_tablet_manager.cc:1434] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:14:34.642489  4434 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:34.642637  4061 catalog_manager.cc:5697] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.647411  4445 raft_consensus.cc:2749] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.647820  4513 raft_consensus.cc:515] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.652889  4542 raft_consensus.cc:493] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.653647  4542 raft_consensus.cc:515] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.664951  4445 raft_consensus.cc:493] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.665836  4445 raft_consensus.cc:515] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.673146  4435 tablet_bootstrap.cc:654] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.672933  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed5b6d47f14476bba3acb7086b321e" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:34.673906  4443 raft_consensus.cc:359] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.674693  4443 raft_consensus.cc:385] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.675010  4443 raft_consensus.cc:740] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
W20260709 13:14:34.675379  4204 leader_election.cc:343] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.675832  4443 consensus_queue.cc:260] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.685072  4434 tablet_bootstrap.cc:654] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.686141  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6fd7710f5714f70a0f2c2500729d68c" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.686703  4542 leader_election.cc:290] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:34.686548  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6fd7710f5714f70a0f2c2500729d68c" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.687670  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea9b5d28359489f94ce555295cfa1ed" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
W20260709 13:14:34.688419  4129 leader_election.cc:343] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.688928  4386 raft_consensus.cc:2468] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
W20260709 13:14:34.691237  4129 leader_election.cc:343] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.691926  4129 leader_election.cc:304] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.692636  4445 leader_election.cc:290] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:34.694061  4207 leader_election.cc:304] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:34.694837  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea9b5d28359489f94ce555295cfa1ed" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.695602  4445 raft_consensus.cc:2804] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.695993  4445 raft_consensus.cc:493] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.696125  4443 ts_tablet_manager.cc:1434] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.057s	user 0.025s	sys 0.007s
I20260709 13:14:34.696409  4445 raft_consensus.cc:3060] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:34.696610  4204 leader_election.cc:343] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.697691  4542 raft_consensus.cc:2749] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.698697  4443 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:34.701021  4434 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:34.701859  4434 ts_tablet_manager.cc:1403] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.013s
I20260709 13:14:34.705694  4567 raft_consensus.cc:493] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.706370  4513 leader_election.cc:290] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:34.706285  4567 raft_consensus.cc:515] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.707192  4443 tablet_bootstrap.cc:654] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.710157  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f6e00475941138b7b84fa7c833346" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:34.706286  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed5b6d47f14476bba3acb7086b321e" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:34.712412  4567 leader_election.cc:290] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:34.712324  4313 raft_consensus.cc:3060] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:34.712252  4281 leader_election.cc:343] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.715324  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f6e00475941138b7b84fa7c833346" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:34.717337  4278 leader_election.cc:343] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.717958  4278 leader_election.cc:304] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.718905  4435 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:34.718891  4567 raft_consensus.cc:2749] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.719973  4435 ts_tablet_manager.cc:1403] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.002s
I20260709 13:14:34.723767  4435 raft_consensus.cc:359] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.724452  4435 raft_consensus.cc:385] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.724716  4435 raft_consensus.cc:740] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.727790  4445 raft_consensus.cc:515] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.730047  4061 catalog_manager.cc:5697] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.731068  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea9b5d28359489f94ce555295cfa1ed" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:34.731201  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea9b5d28359489f94ce555295cfa1ed" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:34.731873  4386 raft_consensus.cc:3060] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:34.733100  4204 leader_election.cc:343] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.734169  4313 raft_consensus.cc:2468] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:34.736101  4204 leader_election.cc:304] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:34.737351  4513 raft_consensus.cc:2804] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.738819  4513 raft_consensus.cc:697] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:34.739840  4513 consensus_queue.cc:237] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.740723  4437 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:34.741551  4437 ts_tablet_manager.cc:1403] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.156s	user 0.033s	sys 0.011s
I20260709 13:14:34.744850  4434 raft_consensus.cc:359] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.745641  4434 raft_consensus.cc:385] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.746599  4386 raft_consensus.cc:2468] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:34.748301  4437 raft_consensus.cc:359] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.748618  4207 leader_election.cc:304] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:34.749323  4437 raft_consensus.cc:385] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.749768  4437 raft_consensus.cc:740] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.749991  4509 raft_consensus.cc:2804] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.750661  4509 raft_consensus.cc:697] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:34.751736  4509 consensus_queue.cc:237] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.753116  4434 raft_consensus.cc:740] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.754522  4434 consensus_queue.cc:260] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.755589  4567 raft_consensus.cc:493] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.731863  4435 consensus_queue.cc:260] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.756198  4567 raft_consensus.cc:515] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.763062  4567 leader_election.cc:290] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.764154  4435 ts_tablet_manager.cc:1434] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:14:34.764780  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43e14aafd634647aacab29418de8662" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.765264  4434 ts_tablet_manager.cc:1434] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:14:34.765950  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43e14aafd634647aacab29418de8662" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.771234  4443 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:34.750670  4437 consensus_queue.cc:260] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.771849  4443 ts_tablet_manager.cc:1403] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.074s	user 0.029s	sys 0.015s
I20260709 13:14:34.772146  4240 raft_consensus.cc:2468] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:34.768409  4539 consensus_queue.cc:1048] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:34.773533  4437 ts_tablet_manager.cc:1434] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
W20260709 13:14:34.768654  4278 leader_election.cc:343] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.774533  4437 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:34.774927  4443 raft_consensus.cc:359] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.767155  4445 leader_election.cc:290] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:34.776124  4443 raft_consensus.cc:385] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.776458  4443 raft_consensus.cc:740] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.765304  4435 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:34.777850  4278 leader_election.cc:304] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:34.779139  4503 raft_consensus.cc:2804] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.779521  4503 raft_consensus.cc:493] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.779857  4503 raft_consensus.cc:3060] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.782195  4434 tablet_bootstrap.cc:492] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:34.783985  4435 tablet_bootstrap.cc:654] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.785127  4443 consensus_queue.cc:260] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.787648  4443 ts_tablet_manager.cc:1434] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:14:34.788688  4434 tablet_bootstrap.cc:654] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.788997  4443 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:34.790349  4539 consensus_queue.cc:1048] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:34.795732  4437 tablet_bootstrap.cc:654] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.771270  4063 catalog_manager.cc:5697] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.799207  4502 raft_consensus.cc:493] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.800242  4443 tablet_bootstrap.cc:654] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.799814  4502 raft_consensus.cc:515] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.803440  4502 leader_election.cc:290] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.805394  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c201d492968497482b2b8432e5fbf37" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:34.807542  4352 leader_election.cc:343] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.795989  4579 consensus_queue.cc:1048] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:14:34.805394  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c201d492968497482b2b8432e5fbf37" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:34.814819  4352 leader_election.cc:343] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.815328  4352 leader_election.cc:304] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.816100  4579 raft_consensus.cc:2749] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.821672  4579 raft_consensus.cc:493] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.822183  4579 raft_consensus.cc:515] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.824388  4579 leader_election.cc:290] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:34.826332  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.826880  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
W20260709 13:14:34.827992  4352 leader_election.cc:343] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.833319  4434 tablet_bootstrap.cc:492] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:34.836262  4434 ts_tablet_manager.cc:1403] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.000s
W20260709 13:14:34.833365  4352 leader_election.cc:343] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.838104  4352 leader_election.cc:304] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:34.847026  4566 raft_consensus.cc:2749] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.851296  4435 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:34.851861  4435 ts_tablet_manager.cc:1403] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.007s
I20260709 13:14:34.854458  4434 raft_consensus.cc:359] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.849567  4437 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:34.857568  4435 raft_consensus.cc:359] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.846333  4503 raft_consensus.cc:515] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.859975  4435 raft_consensus.cc:385] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.860566  4437 ts_tablet_manager.cc:1403] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.007s
I20260709 13:14:34.861254  4435 raft_consensus.cc:740] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.859287  4434 raft_consensus.cc:385] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.862568  4435 consensus_queue.cc:260] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.863392  4434 raft_consensus.cc:740] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.863445  4443 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:34.864521  4435 ts_tablet_manager.cc:1434] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:14:34.864771  4443 ts_tablet_manager.cc:1403] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.031s
I20260709 13:14:34.865676  4435 tablet_bootstrap.cc:492] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:34.867935  4443 raft_consensus.cc:359] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.868734  4443 raft_consensus.cc:385] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.869081  4443 raft_consensus.cc:740] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.869904  4434 consensus_queue.cc:260] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.870837  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43e14aafd634647aacab29418de8662" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:34.871591  4503 leader_election.cc:290] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.872449  4434 ts_tablet_manager.cc:1434] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:14:34.872356  4566 raft_consensus.cc:493] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.872648  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43e14aafd634647aacab29418de8662" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
W20260709 13:14:34.873070  4278 leader_election.cc:343] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.873359  4240 raft_consensus.cc:3060] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.873647  4434 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:34.873092  4566 raft_consensus.cc:515] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.877606  4443 consensus_queue.cc:260] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.878163  4566 leader_election.cc:290] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:34.880208  4443 ts_tablet_manager.cc:1434] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:14:34.880240  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf1d07e3f84aad9c9bb382774c77a0" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.881124  4166 raft_consensus.cc:2468] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:34.882370  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf1d07e3f84aad9c9bb382774c77a0" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.868767  4437 raft_consensus.cc:359] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.884089  4437 raft_consensus.cc:385] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.881345  4240 raft_consensus.cc:2468] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:34.881418  4443 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:34.884532  4437 raft_consensus.cc:740] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.885537  4437 consensus_queue.cc:260] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.885789  4278 leader_election.cc:304] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:34.887131  4503 raft_consensus.cc:2804] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.887809  4503 raft_consensus.cc:697] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:34.887882  4437 ts_tablet_manager.cc:1434] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:14:34.884538  4434 tablet_bootstrap.cc:654] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.890007  4437 tablet_bootstrap.cc:492] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
W20260709 13:14:34.891341  4352 leader_election.cc:343] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.891918  4435 tablet_bootstrap.cc:654] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.892391  4443 tablet_bootstrap.cc:654] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.888693  4503 consensus_queue.cc:237] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.899097  4352 leader_election.cc:304] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:34.900357  4566 raft_consensus.cc:2804] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.900918  4566 raft_consensus.cc:493] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.901490  4566 raft_consensus.cc:3060] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.904976  4434 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:34.905602  4434 ts_tablet_manager.cc:1403] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 13:14:34.909128  4513 consensus_queue.cc:1048] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:34.909895  4434 raft_consensus.cc:359] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.910676  4586 consensus_queue.cc:1048] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:34.911634  4435 tablet_bootstrap.cc:492] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:34.910784  4061 catalog_manager.cc:5697] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.912132  4435 ts_tablet_manager.cc:1403] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.002s
I20260709 13:14:34.913419  4513 consensus_queue.cc:1048] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:34.915135  4435 raft_consensus.cc:359] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.916030  4435 raft_consensus.cc:385] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.916405  4435 raft_consensus.cc:740] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.918196  4443 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:34.918766  4443 ts_tablet_manager.cc:1403] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.004s
I20260709 13:14:34.917382  4435 consensus_queue.cc:260] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.923844  4566 raft_consensus.cc:515] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.928013  4586 raft_consensus.cc:493] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.932221  4437 tablet_bootstrap.cc:654] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.933640  4586 raft_consensus.cc:515] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:34.935984  4586 leader_election.cc:290] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:34.937868  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.938329  4603 raft_consensus.cc:493] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.938833  4603 raft_consensus.cc:515] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.939276  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.940887  4603 leader_election.cc:290] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:34.928826  4443 raft_consensus.cc:359] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.942669  4443 raft_consensus.cc:385] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.942960  4443 raft_consensus.cc:740] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.910688  4434 raft_consensus.cc:385] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.944911  4434 raft_consensus.cc:740] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
W20260709 13:14:34.943068  4352 leader_election.cc:343] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:34.946581  4352 leader_election.cc:343] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.945427  4443 consensus_queue.cc:260] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.947562  4567 raft_consensus.cc:493] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.948130  4352 leader_election.cc:304] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.944471  4566 leader_election.cc:290] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:34.948441  4567 raft_consensus.cc:515] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:34.949517  4586 raft_consensus.cc:2749] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.951010  4567 leader_election.cc:290] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:34.951726  4437 tablet_bootstrap.cc:492] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:34.952237  4437 ts_tablet_manager.cc:1403] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.008s
I20260709 13:14:34.953933  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:34.948246  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed5b6d47f14476bba3acb7086b321e" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:34.955394  4313 raft_consensus.cc:2393] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:34.955147  4437 raft_consensus.cc:359] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:34.955559  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf1d07e3f84aad9c9bb382774c77a0" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:34.955864  4437 raft_consensus.cc:385] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.956399  4437 raft_consensus.cc:740] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.957202  4437 consensus_queue.cc:260] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
W20260709 13:14:34.957466  4352 leader_election.cc:343] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.957840  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed5b6d47f14476bba3acb7086b321e" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:34.958325  4443 ts_tablet_manager.cc:1434] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:14:34.954818  4389 raft_consensus.cc:2393] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44912ba11bc04ab383e985aa41ec5b38 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
I20260709 13:14:34.959286  4437 ts_tablet_manager.cc:1434] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:14:34.960240  4437 tablet_bootstrap.cc:492] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:34.960172  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:34.947171  4434 consensus_queue.cc:260] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:34.962031  4278 leader_election.cc:304] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:34.963878  4434 ts_tablet_manager.cc:1434] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:14:34.965119  4129 leader_election.cc:304] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:34.966189  4603 raft_consensus.cc:3060] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.966420  4567 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.967751  4437 tablet_bootstrap.cc:654] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.975194  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf1d07e3f84aad9c9bb382774c77a0" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:34.976356  4166 raft_consensus.cc:3060] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.995800  4567 raft_consensus.cc:2749] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.997474  4435 ts_tablet_manager.cc:1434] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:14:35.003868  4435 tablet_bootstrap.cc:492] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:35.005694  4603 raft_consensus.cc:2749] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.959312  4443 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:34.965095  4434 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:35.018950  4435 tablet_bootstrap.cc:654] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.019778  4566 consensus_queue.cc:1048] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:35.033866  4434 tablet_bootstrap.cc:654] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.038499  4166 raft_consensus.cc:2468] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:35.039968  4352 leader_election.cc:304] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:35.040238  4443 tablet_bootstrap.cc:654] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.041075  4566 raft_consensus.cc:2804] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.041890  4566 raft_consensus.cc:697] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:35.042843  4566 consensus_queue.cc:237] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.045681  4061 catalog_manager.cc:5697] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.051945  4437 tablet_bootstrap.cc:492] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:35.052814  4437 ts_tablet_manager.cc:1403] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.093s	user 0.036s	sys 0.036s
I20260709 13:14:35.056017  4437 raft_consensus.cc:359] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.061465  4437 raft_consensus.cc:385] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.062139  4437 raft_consensus.cc:740] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.066100  4437 consensus_queue.cc:260] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.067903  4502 consensus_queue.cc:1048] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:35.069623  4435 tablet_bootstrap.cc:492] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:35.070204  4435 ts_tablet_manager.cc:1403] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.003s
I20260709 13:14:35.074683  4443 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:35.075280  4443 ts_tablet_manager.cc:1403] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.000s
I20260709 13:14:35.078081  4443 raft_consensus.cc:359] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.078765  4443 raft_consensus.cc:385] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.079084  4443 raft_consensus.cc:740] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.080799  4437 ts_tablet_manager.cc:1434] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.005s
I20260709 13:14:35.083612  4435 raft_consensus.cc:359] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.084389  4435 raft_consensus.cc:385] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.084661  4435 raft_consensus.cc:740] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.085403  4435 consensus_queue.cc:260] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.087517  4435 ts_tablet_manager.cc:1434] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:14:35.088505  4435 tablet_bootstrap.cc:492] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:35.089896  4443 consensus_queue.cc:260] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.092564  4064 catalog_manager.cc:5697] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.093725  4443 ts_tablet_manager.cc:1434] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:14:35.094730  4443 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:35.097147  4434 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:35.097707  4434 ts_tablet_manager.cc:1403] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.013s
I20260709 13:14:35.094792  4437 tablet_bootstrap.cc:492] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:35.104044  4603 consensus_queue.cc:1048] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.105240  4437 tablet_bootstrap.cc:654] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.106257  4435 tablet_bootstrap.cc:654] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.108722  4603 raft_consensus.cc:493] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.109470  4443 tablet_bootstrap.cc:654] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.109272  4603 raft_consensus.cc:515] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.112082  4434 raft_consensus.cc:359] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.113121  4434 raft_consensus.cc:385] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.113435  4434 raft_consensus.cc:740] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.113929  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.113287  4603 leader_election.cc:290] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:35.114725  4434 consensus_queue.cc:260] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.116441  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:35.117267  4386 raft_consensus.cc:2468] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:35.118013  4434 ts_tablet_manager.cc:1434] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:14:35.120757  4434 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:35.121107  4132 leader_election.cc:304] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:35.124363  4603 raft_consensus.cc:2804] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.124931  4603 raft_consensus.cc:493] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.125377  4603 raft_consensus.cc:3060] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.134685  4434 tablet_bootstrap.cc:654] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:35.137180  4129 leader_election.cc:343] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.150570  4457 consensus_queue.cc:1048] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.153672  4548 raft_consensus.cc:493] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.159181  4548 raft_consensus.cc:515] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.163792  4548 leader_election.cc:290] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:35.166873  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f6e00475941138b7b84fa7c833346" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.167773  4314 raft_consensus.cc:2468] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:35.169727  4204 leader_election.cc:304] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.173218  4548 raft_consensus.cc:2804] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.173636  4548 raft_consensus.cc:493] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.173979  4548 raft_consensus.cc:3060] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.137480  4566 raft_consensus.cc:493] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.193445  4509 raft_consensus.cc:493] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.193934  4502 raft_consensus.cc:493] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.198282  4509 raft_consensus.cc:515] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.198407  4502 raft_consensus.cc:515] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.203449  4445 raft_consensus.cc:493] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.203972  4445 raft_consensus.cc:515] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.204279  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f6e00475941138b7b84fa7c833346" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:35.204952  4388 raft_consensus.cc:2468] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:35.205202  4509 leader_election.cc:290] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.206068  4445 leader_election.cc:290] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:35.208122  4502 leader_election.cc:290] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.211912  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6fd7710f5714f70a0f2c2500729d68c" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:35.212641  4166 raft_consensus.cc:2468] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:35.213176  4443 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:35.213686  4443 ts_tablet_manager.cc:1403] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.119s	user 0.036s	sys 0.036s
I20260709 13:14:35.214099  4204 leader_election.cc:304] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.215073  4445 raft_consensus.cc:2804] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.215268  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6fd7710f5714f70a0f2c2500729d68c" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.216095  4314 raft_consensus.cc:2468] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:35.217178  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82fde8e022a4d05bc9940a384ce326a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.217885  4311 raft_consensus.cc:2468] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:35.199505  4548 raft_consensus.cc:515] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.221802  4204 leader_election.cc:304] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.222517  4548 leader_election.cc:290] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:35.223354  4548 raft_consensus.cc:2804] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.223817  4548 raft_consensus.cc:493] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.224270  4548 raft_consensus.cc:3060] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.225404  4435 tablet_bootstrap.cc:492] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:35.226104  4435 ts_tablet_manager.cc:1403] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.138s	user 0.046s	sys 0.036s
I20260709 13:14:35.215516  4445 raft_consensus.cc:493] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.228955  4445 raft_consensus.cc:3060] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.229964  4435 raft_consensus.cc:359] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.230998  4435 raft_consensus.cc:385] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.201932  4566 raft_consensus.cc:515] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.231583  4435 raft_consensus.cc:740] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.216837  4443 raft_consensus.cc:359] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.233548  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f6e00475941138b7b84fa7c833346" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:35.233865  4443 raft_consensus.cc:385] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.234237  4315 raft_consensus.cc:3060] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.234295  4443 raft_consensus.cc:740] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.235353  4443 consensus_queue.cc:260] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.237855  4445 raft_consensus.cc:515] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.238190  4443 ts_tablet_manager.cc:1434] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:14:35.242749  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6fd7710f5714f70a0f2c2500729d68c" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:35.243410  4166 raft_consensus.cc:3060] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.243636  4443 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:35.232524  4435 consensus_queue.cc:260] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.249966  4566 leader_election.cc:290] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.258260  4434 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:35.258385  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f6e00475941138b7b84fa7c833346" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:35.258837  4434 ts_tablet_manager.cc:1403] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.003s
I20260709 13:14:35.259106  4437 tablet_bootstrap.cc:492] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:35.259284  4240 raft_consensus.cc:2393] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3b8bb2dfba041dea91b3e6775c34505 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:35.259615  4437 ts_tablet_manager.cc:1403] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.165s	user 0.035s	sys 0.064s
I20260709 13:14:35.254334  4603 raft_consensus.cc:515] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.262756  4434 raft_consensus.cc:359] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.263588  4603 leader_election.cc:290] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:35.264108  4445 leader_election.cc:290] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.264716  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:35.266031  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:35.263520  4434 raft_consensus.cc:385] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.267418  4434 raft_consensus.cc:740] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.267990  4434 consensus_queue.cc:260] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.266669  4389 raft_consensus.cc:3060] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:35.266594  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:35.274372  4603 raft_consensus.cc:493] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.275364  4435 ts_tablet_manager.cc:1434] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 13:14:35.277537  4434 ts_tablet_manager.cc:1434] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:14:35.279963  4434 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:35.281232  4435 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:35.281158  4437 raft_consensus.cc:359] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.282016  4437 raft_consensus.cc:385] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.282277  4437 raft_consensus.cc:740] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.266708  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6fd7710f5714f70a0f2c2500729d68c" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:35.286978  4443 tablet_bootstrap.cc:654] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.274897  4313 raft_consensus.cc:3060] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.298821  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f6e00475941138b7b84fa7c833346" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.300007  4509 consensus_queue.cc:1048] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.288269  4311 raft_consensus.cc:3060] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.302525  4567 raft_consensus.cc:493] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.303331  4567 raft_consensus.cc:515] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.307389  4567 leader_election.cc:290] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:35.308380  4313 raft_consensus.cc:2468] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:35.310206  4437 consensus_queue.cc:260] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.310362  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:35.311468  4315 raft_consensus.cc:2468] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:35.311646  4129 leader_election.cc:304] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:35.313053  4457 raft_consensus.cc:2804] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.313755  4457 raft_consensus.cc:697] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:35.315054  4166 raft_consensus.cc:2468] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:35.314903  4457 consensus_queue.cc:237] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.316470  4389 raft_consensus.cc:2468] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:35.316875  4204 leader_election.cc:304] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.318564  4509 raft_consensus.cc:2804] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.319085  4509 raft_consensus.cc:697] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:35.319842  4204 leader_election.cc:304] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.321658  4445 raft_consensus.cc:2804] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.319931  4509 consensus_queue.cc:237] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.322516  4445 raft_consensus.cc:697] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:35.276010  4603 raft_consensus.cc:515] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
W20260709 13:14:35.329175  4278 leader_election.cc:343] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.337868  4166 raft_consensus.cc:3060] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.340361  4445 consensus_queue.cc:237] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.348806  4434 tablet_bootstrap.cc:654] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.349377  4513 consensus_queue.cc:1048] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.352100  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:35.352855  4240 raft_consensus.cc:2468] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:35.355937  4437 ts_tablet_manager.cc:1434] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.004s
I20260709 13:14:35.357599  4437 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:35.389664  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be46b7b34a104332852aedf71a934cb3" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:35.390401  4240 raft_consensus.cc:2468] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:35.390787  4457 raft_consensus.cc:493] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.391287  4457 raft_consensus.cc:515] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.393338  4457 leader_election.cc:290] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.394372  4548 raft_consensus.cc:515] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.388641  4278 leader_election.cc:304] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:35.412976  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82fde8e022a4d05bc9940a384ce326a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:35.413961  4389 raft_consensus.cc:2468] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:35.409968  4311 raft_consensus.cc:2468] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:35.424549  4641 consensus_queue.cc:1048] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.425328  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82fde8e022a4d05bc9940a384ce326a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:35.426225  4315 raft_consensus.cc:3060] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.421372  4567 raft_consensus.cc:2804] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.438124  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:35.441206  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f6e00475941138b7b84fa7c833346" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:35.442096  4389 raft_consensus.cc:3060] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.444619  4166 raft_consensus.cc:3060] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.446554  4442 consensus_queue.cc:1048] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:35.447340  4060 catalog_manager.cc:5697] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.448844  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82fde8e022a4d05bc9940a384ce326a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:35.449560  4386 raft_consensus.cc:3060] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.436534  4567 raft_consensus.cc:493] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.449263  4060 catalog_manager.cc:5697] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.450100  4567 raft_consensus.cc:3060] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.454062  4437 tablet_bootstrap.cc:654] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.429248  4548 leader_election.cc:290] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:35.475667  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43e14aafd634647aacab29418de8662" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:35.484802  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.487825  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be46b7b34a104332852aedf71a934cb3" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
W20260709 13:14:35.490002  4129 leader_election.cc:343] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.499508  4315 raft_consensus.cc:2468] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:35.500491  4603 leader_election.cc:290] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.503186  4435 tablet_bootstrap.cc:654] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.507969  4641 consensus_queue.cc:1048] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.509403  4502 raft_consensus.cc:493] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.510155  4352 leader_election.cc:304] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:35.510195  4502 raft_consensus.cc:515] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.511580  4352 leader_election.cc:304] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.513326  4502 leader_election.cc:290] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.521257  4386 raft_consensus.cc:2468] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:35.530609  4434 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:35.531157  4434 ts_tablet_manager.cc:1403] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.251s	user 0.015s	sys 0.000s
I20260709 13:14:35.527758  4586 raft_consensus.cc:2804] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:35.532622  4129 leader_election.cc:343] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.536144  4129 leader_election.cc:304] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:35.534818  4586 raft_consensus.cc:493] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.537427  4389 raft_consensus.cc:2468] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:35.537521  4586 raft_consensus.cc:3060] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.537729  4603 raft_consensus.cc:2749] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.540637  4063 catalog_manager.cc:5697] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.542481  4567 raft_consensus.cc:515] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.543295  4566 raft_consensus.cc:2749] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.544840  4567 leader_election.cc:290] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:35.558410  4204 leader_election.cc:304] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.560240  4513 raft_consensus.cc:2804] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.560957  4513 raft_consensus.cc:697] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:35.562681  4513 consensus_queue.cc:237] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.575336  4434 raft_consensus.cc:359] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.576406  4434 raft_consensus.cc:385] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.576679  4434 raft_consensus.cc:740] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.547166  4586 raft_consensus.cc:515] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.578547  4586 leader_election.cc:290] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.579385  4434 consensus_queue.cc:260] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.582211  4434 ts_tablet_manager.cc:1434] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
I20260709 13:14:35.612397  4434 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:35.622828  4434 tablet_bootstrap.cc:654] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.637964  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43e14aafd634647aacab29418de8662" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.644825  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:35.645833  4240 raft_consensus.cc:3060] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.660488  4443 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:35.660997  4443 ts_tablet_manager.cc:1403] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.418s	user 0.030s	sys 0.030s
W20260709 13:14:35.663863  4352 leader_election.cc:343] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.664146  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80801dd62bc4b0894771a460938aa71" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.666785  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80801dd62bc4b0894771a460938aa71" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:35.672771  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be46b7b34a104332852aedf71a934cb3" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:35.676095  4437 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:35.676643  4437 ts_tablet_manager.cc:1403] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.319s	user 0.054s	sys 0.064s
I20260709 13:14:35.676347  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be46b7b34a104332852aedf71a934cb3" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:35.677278  4239 raft_consensus.cc:3060] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.679543  4437 raft_consensus.cc:359] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.680239  4437 raft_consensus.cc:385] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.680491  4437 raft_consensus.cc:740] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.681195  4437 consensus_queue.cc:260] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.656428  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:35.685818  4437 ts_tablet_manager.cc:1434] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:35.686885  4437 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:35.686982  4443 raft_consensus.cc:359] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.688649  4443 raft_consensus.cc:385] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.689574  4443 raft_consensus.cc:740] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
W20260709 13:14:35.690604  4352 leader_election.cc:343] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.693789  4443 consensus_queue.cc:260] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.696543  4240 raft_consensus.cc:2468] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:35.692930  4437 tablet_bootstrap.cc:654] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.726438  4442 consensus_queue.cc:1048] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:35.697276  4352 leader_election.cc:343] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.728143  4352 leader_election.cc:304] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:35.729193  4579 raft_consensus.cc:2749] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.731974  4434 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:35.732523  4435 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:35.732702  4434 ts_tablet_manager.cc:1403] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.001s
I20260709 13:14:35.721910  4603 consensus_queue.cc:1048] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.747220  4239 raft_consensus.cc:2468] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:35.720054  4129 leader_election.cc:304] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:35.750370  4640 raft_consensus.cc:2749] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.749672  4060 catalog_manager.cc:5697] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.733152  4435 ts_tablet_manager.cc:1403] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.452s	user 0.062s	sys 0.093s
W20260709 13:14:35.736708  4352 consensus_peers.cc:597] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:35.739437  4641 raft_consensus.cc:493] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.756659  4641 raft_consensus.cc:515] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.757251  4434 raft_consensus.cc:359] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.758095  4434 raft_consensus.cc:385] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.758397  4434 raft_consensus.cc:740] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.758453  4435 raft_consensus.cc:359] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.759361  4641 leader_election.cc:290] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:35.759200  4434 consensus_queue.cc:260] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:35.756695  4352 leader_election.cc:343] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.760540  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c201d492968497482b2b8432e5fbf37" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:35.761520  4164 raft_consensus.cc:2468] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:35.762975  4204 leader_election.cc:304] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.759248  4435 raft_consensus.cc:385] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.764241  4435 raft_consensus.cc:740] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.764725  4641 raft_consensus.cc:2804] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.765264  4641 raft_consensus.cc:493] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.764945  4435 consensus_queue.cc:260] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.765826  4641 raft_consensus.cc:3060] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.767560  4435 ts_tablet_manager.cc:1434] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:14:35.768661  4435 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:35.771955  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c201d492968497482b2b8432e5fbf37" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:35.772774  4387 raft_consensus.cc:2468] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:35.773957  4352 leader_election.cc:304] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38
W20260709 13:14:35.732365  4278 leader_election.cc:343] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.735858  4443 ts_tablet_manager.cc:1434] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
W20260709 13:14:35.774868  4278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 44090.5us
I20260709 13:14:35.775638  4443 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:35.776424  4579 raft_consensus.cc:2804] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.777068  4579 raft_consensus.cc:697] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:35.778441  4434 ts_tablet_manager.cc:1434] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:14:35.778018  4579 consensus_queue.cc:237] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:35.779574  4434 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:35.783731  4443 tablet_bootstrap.cc:654] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.786367  4435 tablet_bootstrap.cc:654] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.793851  4442 raft_consensus.cc:493] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.794533  4442 raft_consensus.cc:515] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.797118  4641 raft_consensus.cc:515] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.798480  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:35.796878  4442 leader_election.cc:290] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:35.799376  4443 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:35.799281  4386 raft_consensus.cc:2468] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:35.799881  4443 ts_tablet_manager.cc:1403] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 13:14:35.800580  4281 leader_election.cc:304] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:35.801641  4442 raft_consensus.cc:2804] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.802160  4442 raft_consensus.cc:493] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.802624  4442 raft_consensus.cc:3060] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.802827  4443 raft_consensus.cc:359] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.803813  4443 raft_consensus.cc:385] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.803670  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c201d492968497482b2b8432e5fbf37" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:35.804184  4443 raft_consensus.cc:740] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.804390  4166 raft_consensus.cc:3060] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.805140  4278 leader_election.cc:304] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:35.804965  4443 consensus_queue.cc:260] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.807304  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c201d492968497482b2b8432e5fbf37" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:35.808144  4386 raft_consensus.cc:3060] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.809937  4652 raft_consensus.cc:2804] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.810536  4652 raft_consensus.cc:697] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:35.812080  4443 ts_tablet_manager.cc:1434] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:14:35.811676  4652 consensus_queue.cc:237] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.807384  4434 tablet_bootstrap.cc:654] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.817993  4166 raft_consensus.cc:2468] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:35.827560  4434 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:35.819332  4641 leader_election.cc:290] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:35.828449  4204 leader_election.cc:304] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:35.829382  4641 raft_consensus.cc:2804] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.829924  4641 raft_consensus.cc:697] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:35.820356  4435 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:35.830861  4435 ts_tablet_manager.cc:1403] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.008s
I20260709 13:14:35.830761  4641 consensus_queue.cc:237] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.822189  4443 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:35.828048  4434 ts_tablet_manager.cc:1403] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.006s
I20260709 13:14:35.843050  4579 raft_consensus.cc:493] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.843686  4579 raft_consensus.cc:515] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.822599  4442 raft_consensus.cc:515] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.846041  4434 raft_consensus.cc:359] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.846752  4434 raft_consensus.cc:385] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.847012  4434 raft_consensus.cc:740] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.847129  4442 leader_election.cc:290] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:35.826793  4566 consensus_queue.cc:1048] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:14:35.847710  4434 consensus_queue.cc:260] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.848562  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:35.849259  4389 raft_consensus.cc:3060] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.854329  4437 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:35.857839  4443 tablet_bootstrap.cc:654] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.868213  4437 ts_tablet_manager.cc:1403] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.182s	user 0.018s	sys 0.010s
I20260709 13:14:35.851704  4435 raft_consensus.cc:359] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.871109  4435 raft_consensus.cc:385] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.871484  4435 raft_consensus.cc:740] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.871205  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:35.849900  4434 ts_tablet_manager.cc:1434] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:35.872432  4435 consensus_queue.cc:260] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.873660  4434 tablet_bootstrap.cc:492] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:35.866513  4579 leader_election.cc:290] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:35.816993  4386 raft_consensus.cc:2468] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:35.875725  4435 ts_tablet_manager.cc:1434] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.010s
I20260709 13:14:35.876783  4435 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:35.882244  4443 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:35.882525  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:35.882975  4443 ts_tablet_manager.cc:1403] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.004s
I20260709 13:14:35.882892  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:35.871177  4437 raft_consensus.cc:359] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.887893  4437 raft_consensus.cc:385] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.888291  4437 raft_consensus.cc:740] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.890025  4437 consensus_queue.cc:260] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.891036  4435 tablet_bootstrap.cc:654] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.857445  4389 raft_consensus.cc:2468] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:35.893313  4434 tablet_bootstrap.cc:654] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.894217  4281 leader_election.cc:304] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:35.886032  4443 raft_consensus.cc:359] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.895148  4442 raft_consensus.cc:2804] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.895481  4443 raft_consensus.cc:385] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.895852  4443 raft_consensus.cc:740] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.896018  4442 raft_consensus.cc:697] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:35.896862  4443 consensus_queue.cc:260] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:35.896998  4442 consensus_queue.cc:237] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:35.898138  4603 raft_consensus.cc:493] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.898638  4603 raft_consensus.cc:515] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.902170  4603 leader_election.cc:290] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.903261  4160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:35.904455  4437 ts_tablet_manager.cc:1434] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:14:35.905500  4437 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:35.905661  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:35.905527  4443 ts_tablet_manager.cc:1434] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:14:35.906875  4239 raft_consensus.cc:2393] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:35.907728  4443 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:35.913620  4061 catalog_manager.cc:5697] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:35.915143  4352 leader_election.cc:343] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:35.915956  4352 leader_election.cc:343] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.916375  4352 leader_election.cc:304] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:35.926016  4513 consensus_queue.cc:1048] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.926033  4566 raft_consensus.cc:2749] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.930462  4603 consensus_queue.cc:1048] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.931994  4437 tablet_bootstrap.cc:654] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.948849  4443 tablet_bootstrap.cc:654] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.947547  4652 raft_consensus.cc:493] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.959786  4652 raft_consensus.cc:515] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.962109  4652 leader_election.cc:290] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:35.965847  4513 raft_consensus.cc:493] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.966620  4513 raft_consensus.cc:515] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:35.969075  4435 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:35.969750  4435 ts_tablet_manager.cc:1403] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.006s
W20260709 13:14:35.965855  4278 leader_election.cc:343] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:35.978415  4278 leader_election.cc:343] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.975672  4548 consensus_queue.cc:1048] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:35.985960  4061 catalog_manager.cc:5697] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.988065  4513 leader_election.cc:290] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:35.991523  4437 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:35.992093  4437 ts_tablet_manager.cc:1403] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.008s
I20260709 13:14:35.995613  4311 raft_consensus.cc:3060] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.998659  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:35.999667  4162 raft_consensus.cc:2468] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:36.000743  4586 raft_consensus.cc:493] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.998744  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:36.001619  4164 raft_consensus.cc:2468] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:36.001473  4586 raft_consensus.cc:515] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.008021  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:36.008847  4239 raft_consensus.cc:2468] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:36.012101  4204 leader_election.cc:304] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:36.013885  4513 raft_consensus.cc:2804] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.014294  4513 raft_consensus.cc:493] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.014616  4513 raft_consensus.cc:3060] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.022111  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:36.023254  4586 leader_election.cc:290] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:36.025748  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:36.025990  4437 raft_consensus.cc:359] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.026666  4437 raft_consensus.cc:385] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.026960  4437 raft_consensus.cc:740] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
W20260709 13:14:36.027349  4352 leader_election.cc:343] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:36.029429  4670 log.cc:927] Time spent T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:14:36.035418  4437 consensus_queue.cc:260] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.036108  4641 consensus_queue.cc:1048] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.037917  4437 ts_tablet_manager.cc:1434] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:14:36.039036  4437 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:36.038851  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:36.040884  4352 leader_election.cc:343] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.042203  4352 leader_election.cc:304] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:36.043007  4586 raft_consensus.cc:2749] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.042292  4435 raft_consensus.cc:359] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.043881  4435 raft_consensus.cc:385] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.044229  4435 raft_consensus.cc:740] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.044003  4641 consensus_queue.cc:1048] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.044955  4435 consensus_queue.cc:260] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.047833  4435 ts_tablet_manager.cc:1434] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.002s
I20260709 13:14:36.048867  4435 tablet_bootstrap.cc:492] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:36.049199  4434 tablet_bootstrap.cc:492] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:36.049762  4434 ts_tablet_manager.cc:1403] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.176s	user 0.017s	sys 0.008s
I20260709 13:14:36.050519  4129 leader_election.cc:304] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:36.052196  4603 raft_consensus.cc:3060] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.053448  4434 raft_consensus.cc:359] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.054258  4434 raft_consensus.cc:385] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.054698  4434 raft_consensus.cc:740] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.054179  4061 catalog_manager.cc:5697] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.057452  4586 raft_consensus.cc:493] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.058216  4586 raft_consensus.cc:515] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.058811  4278 leader_election.cc:304] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:36.055411  4434 consensus_queue.cc:260] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.060158  4652 raft_consensus.cc:2804] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.060702  4652 raft_consensus.cc:493] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.061745  4652 raft_consensus.cc:3060] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.062525  4586 leader_election.cc:290] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:36.056357  4061 catalog_manager.cc:5697] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.063581  4434 ts_tablet_manager.cc:1434] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:14:36.064648  4434 tablet_bootstrap.cc:492] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:36.071305  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d3c8a715e14f2cb977c6ad59220712" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:36.072326  4164 raft_consensus.cc:2468] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:36.077839  4352 leader_election.cc:304] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:36.078913  4586 raft_consensus.cc:2804] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.079463  4586 raft_consensus.cc:493] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.079917  4586 raft_consensus.cc:3060] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.084411  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d3c8a715e14f2cb977c6ad59220712" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:36.085444  4239 raft_consensus.cc:2468] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:36.086846  4434 tablet_bootstrap.cc:654] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.110697  4603 raft_consensus.cc:2749] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.112161  4443 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:36.116613  4443 ts_tablet_manager.cc:1403] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.209s	user 0.035s	sys 0.056s
I20260709 13:14:36.119498  4586 raft_consensus.cc:515] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.155409  4443 raft_consensus.cc:359] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.160622  4443 raft_consensus.cc:385] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.160954  4443 raft_consensus.cc:740] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.161115  4435 tablet_bootstrap.cc:654] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.154219  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:36.173293  4437 tablet_bootstrap.cc:654] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.175418  4443 consensus_queue.cc:260] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.176402  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d3c8a715e14f2cb977c6ad59220712" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:36.177464  4239 raft_consensus.cc:3060] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.158207  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d3c8a715e14f2cb977c6ad59220712" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:36.179096  4163 raft_consensus.cc:3060] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.182344  4443 ts_tablet_manager.cc:1434] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:14:36.183386  4443 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:36.192725  4502 raft_consensus.cc:493] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.197069  4502 raft_consensus.cc:515] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.202112  4641 consensus_queue.cc:1048] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.205773  4513 raft_consensus.cc:515] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:36.205996  4641 consensus_queue.cc:1048] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.209851  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:36.210616  4166 raft_consensus.cc:3060] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.148994  4586 leader_election.cc:290] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:36.212497  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:36.214026  4352 leader_election.cc:343] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.208657  4513 leader_election.cc:290] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:36.217201  4312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:36.210034  4502 leader_election.cc:290] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:36.224098  4166 raft_consensus.cc:2468] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:36.225524  4204 leader_election.cc:304] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
W20260709 13:14:36.228857  4352 leader_election.cc:343] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.229561  4352 leader_election.cc:304] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:36.196151  4652 raft_consensus.cc:515] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:36.232268  4502 raft_consensus.cc:2749] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.235872  4652 leader_election.cc:290] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:36.237532  4314 raft_consensus.cc:2393] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:36.253927  4239 raft_consensus.cc:2468] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:36.260268  4352 leader_election.cc:304] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:36.261189  4682 raft_consensus.cc:2804] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.262018  4682 raft_consensus.cc:697] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:36.262084  4502 raft_consensus.cc:2804] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.262900  4434 tablet_bootstrap.cc:492] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:36.263403  4434 ts_tablet_manager.cc:1403] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.199s	user 0.016s	sys 0.012s
I20260709 13:14:36.262744  4502 raft_consensus.cc:697] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:36.266378  4434 raft_consensus.cc:359] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.267107  4434 raft_consensus.cc:385] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.266760  4502 consensus_queue.cc:237] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.267379  4434 raft_consensus.cc:740] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.268101  4434 consensus_queue.cc:260] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.269735  4434 ts_tablet_manager.cc:1434] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:36.270673  4434 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:36.276340  4641 consensus_queue.cc:1048] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.277423  4434 tablet_bootstrap.cc:654] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.242828  4163 raft_consensus.cc:2468] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:36.299244  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:36.299738  4435 tablet_bootstrap.cc:492] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:36.300223  4311 raft_consensus.cc:2393] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:36.300252  4435 ts_tablet_manager.cc:1403] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.252s	user 0.024s	sys 0.008s
I20260709 13:14:36.304047  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:36.304875  4166 raft_consensus.cc:2393] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44912ba11bc04ab383e985aa41ec5b38 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:36.304991  4443 tablet_bootstrap.cc:654] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.306597  4435 raft_consensus.cc:359] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.307487  4435 raft_consensus.cc:385] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.307899  4435 raft_consensus.cc:740] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.308573  4435 consensus_queue.cc:260] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.315442  4311 raft_consensus.cc:3060] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.263566  4682 consensus_queue.cc:237] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:36.322041  4437 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:36.322696  4437 ts_tablet_manager.cc:1403] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.284s	user 0.012s	sys 0.008s
I20260709 13:14:36.327739  4435 ts_tablet_manager.cc:1434] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 13:14:36.328619  4435 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:36.326979  4586 consensus_queue.cc:1048] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:14:36.335210  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ebbec07a3541cbada5d5e7bbb65f60" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:36.336436  4437 raft_consensus.cc:359] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.336813  4567 consensus_queue.cc:1048] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:36.341216  4437 raft_consensus.cc:385] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.342123  4437 raft_consensus.cc:740] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.341575  4641 consensus_queue.cc:1048] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:36.359829  4437 consensus_queue.cc:260] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.381248  4435 tablet_bootstrap.cc:654] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.382055  4437 ts_tablet_manager.cc:1434] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260709 13:14:36.383692  4437 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:36.370142  4603 raft_consensus.cc:493] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.398641  4434 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:36.399268  4434 ts_tablet_manager.cc:1403] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.005s
I20260709 13:14:36.414101  4060 catalog_manager.cc:5697] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.422936  4567 consensus_queue.cc:1048] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.405432  4603 raft_consensus.cc:515] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.425210  4579 consensus_queue.cc:1048] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.429498  4278 leader_election.cc:304] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:36.433164  4652 raft_consensus.cc:2749] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.466312  4603 leader_election.cc:290] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:36.475611  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:36.476438  4386 raft_consensus.cc:2468] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:36.485606  4061 catalog_manager.cc:5697] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.487648  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:36.488546  4239 raft_consensus.cc:2468] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:36.491837  4132 leader_election.cc:304] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:36.495940  4640 raft_consensus.cc:2804] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.496469  4640 raft_consensus.cc:493] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.496878  4640 raft_consensus.cc:3060] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.508139  4434 raft_consensus.cc:359] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.554067  4434 raft_consensus.cc:385] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.554579  4434 raft_consensus.cc:740] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.533895  4579 raft_consensus.cc:493] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.556950  4579 raft_consensus.cc:515] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.559345  4579 leader_election.cc:290] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:36.559988  4434 consensus_queue.cc:260] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.561053  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:36.562717  4434 ts_tablet_manager.cc:1434] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.163s	user 0.011s	sys 0.000s
I20260709 13:14:36.563587  4437 tablet_bootstrap.cc:654] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:36.565757  4352 leader_election.cc:343] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.563814  4434 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:36.576386  4640 raft_consensus.cc:515] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.604231  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:36.607591  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:36.608619  4388 raft_consensus.cc:3060] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:36.613641  4352 leader_election.cc:343] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.614378  4443 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:36.614949  4443 ts_tablet_manager.cc:1403] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.432s	user 0.015s	sys 0.020s
I20260709 13:14:36.618495  4434 tablet_bootstrap.cc:654] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.619154  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:36.619904  4240 raft_consensus.cc:3060] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:36.627439  4278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 196435us
I20260709 13:14:36.627688  4443 raft_consensus.cc:359] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.628429  4443 raft_consensus.cc:385] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.628739  4443 raft_consensus.cc:740] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.613253  4640 leader_election.cc:290] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:36.614367  4352 leader_election.cc:304] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:36.635569  4586 raft_consensus.cc:2749] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.642516  4443 consensus_queue.cc:260] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.632740  4388 raft_consensus.cc:2468] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:36.650810  4699 consensus_queue.cc:1048] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:14:36.655143  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:36.661521  4435 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:36.662199  4435 ts_tablet_manager.cc:1403] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.334s	user 0.012s	sys 0.065s
I20260709 13:14:36.665261  4435 raft_consensus.cc:359] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.666049  4435 raft_consensus.cc:385] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.666344  4435 raft_consensus.cc:740] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.670257  4132 leader_election.cc:304] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:36.671785  4640 raft_consensus.cc:2804] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.672729  4640 raft_consensus.cc:697] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:36.668880  4665 raft_consensus.cc:493] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.675436  4665 raft_consensus.cc:515] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.677681  4665 leader_election.cc:290] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:36.682650  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80801dd62bc4b0894771a460938aa71" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:36.684423  4386 raft_consensus.cc:2468] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:36.686408  4281 leader_election.cc:304] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:36.695578  4435 consensus_queue.cc:260] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
W20260709 13:14:36.700672  4278 consensus_peers.cc:597] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.696979  4699 raft_consensus.cc:2804] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.703154  4443 ts_tablet_manager.cc:1434] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:14:36.706525  4238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80801dd62bc4b0894771a460938aa71" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:36.709736  4278 leader_election.cc:343] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.712045  4443 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:36.696779  4640 consensus_queue.cc:237] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.704586  4699 raft_consensus.cc:493] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.717279  4699 raft_consensus.cc:3060] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.718812  4434 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:36.719415  4434 ts_tablet_manager.cc:1403] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.156s	user 0.009s	sys 0.010s
I20260709 13:14:36.722856  4437 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:36.723452  4437 ts_tablet_manager.cc:1403] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.340s	user 0.033s	sys 0.029s
I20260709 13:14:36.728137  4435 ts_tablet_manager.cc:1434] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.066s	user 0.011s	sys 0.000s
I20260709 13:14:36.731642  4434 raft_consensus.cc:359] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.732560  4434 raft_consensus.cc:385] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.734686  4437 raft_consensus.cc:359] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.735535  4437 raft_consensus.cc:385] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.735857  4437 raft_consensus.cc:740] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.732880  4434 raft_consensus.cc:740] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.738058  4434 consensus_queue.cc:260] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.747571  4437 consensus_queue.cc:260] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.749487  4434 ts_tablet_manager.cc:1434] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 13:14:36.750702  4434 tablet_bootstrap.cc:492] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:36.751214  4699 raft_consensus.cc:515] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.755198  4603 raft_consensus.cc:493] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.755844  4603 raft_consensus.cc:515] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.758342  4603 leader_election.cc:290] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:36.760804  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:36.761737  4386 raft_consensus.cc:2468] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:36.763213  4132 leader_election.cc:304] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:36.764556  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:36.764945  4238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80801dd62bc4b0894771a460938aa71" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:36.765319  4314 raft_consensus.cc:2468] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:36.776155  4437 ts_tablet_manager.cc:1434] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.003s
I20260709 13:14:36.781876  4435 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:36.787119  4437 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:36.767836  4699 leader_election.cc:290] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:36.774012  4640 raft_consensus.cc:2804] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.793987  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80801dd62bc4b0894771a460938aa71" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:36.794775  4386 raft_consensus.cc:3060] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:36.800710  4278 leader_election.cc:343] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.806708  4443 tablet_bootstrap.cc:654] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.815059  4434 tablet_bootstrap.cc:654] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.812613  4063 catalog_manager.cc:5697] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.773528  4240 raft_consensus.cc:2468] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:36.817916  4640 raft_consensus.cc:493] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.832222  4437 tablet_bootstrap.cc:654] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.830367  4445 raft_consensus.cc:493] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.837878  4445 raft_consensus.cc:515] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.842557  4548 consensus_queue.cc:1048] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.832474  4640 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.863436  4445 leader_election.cc:290] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:36.866258  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:36.867278  4388 raft_consensus.cc:2468] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:36.869041  4207 leader_election.cc:304] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:36.870173  4445 raft_consensus.cc:2804] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.870635  4445 raft_consensus.cc:493] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.870997  4445 raft_consensus.cc:3060] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.872622  4502 consensus_queue.cc:1048] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:36.877637  4386 raft_consensus.cc:2468] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:36.877744  4579 consensus_queue.cc:1048] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.879395  4281 leader_election.cc:304] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:36.863516  4640 raft_consensus.cc:515] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.880961  4699 raft_consensus.cc:2804] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.881503  4699 raft_consensus.cc:697] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:36.884398  4699 consensus_queue.cc:237] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.887269  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:36.889101  4682 consensus_queue.cc:1048] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.892545  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:36.893272  4314 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:36.893594  4204 leader_election.cc:343] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.897264  4579 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.898368  4579 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.900501  4579 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:36.905820  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:36.908800  4352 leader_election.cc:343] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.897470  4443 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:36.910390  4443 ts_tablet_manager.cc:1403] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.201s	user 0.017s	sys 0.022s
I20260709 13:14:36.911757  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:36.915057  4443 raft_consensus.cc:359] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:36.922165  4352 leader_election.cc:343] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.942224  4443 raft_consensus.cc:385] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.942355  4352 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:36.942621  4443 raft_consensus.cc:740] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.943266  4579 raft_consensus.cc:2749] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.943545  4443 consensus_queue.cc:260] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.946051  4443 ts_tablet_manager.cc:1434] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 13:14:36.946986  4443 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:36.925109  4314 raft_consensus.cc:2468] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:36.925805  4640 leader_election.cc:290] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:36.928179  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:36.950184  4386 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.952262  4163 raft_consensus.cc:3060] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.930045  4435 tablet_bootstrap.cc:654] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.930106  4434 tablet_bootstrap.cc:492] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:36.957518  4129 leader_election.cc:304] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:36.959798  4640 raft_consensus.cc:2804] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.960315  4640 raft_consensus.cc:697] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:36.961194  4640 consensus_queue.cc:237] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:36.963723  4434 ts_tablet_manager.cc:1403] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.213s	user 0.006s	sys 0.010s
I20260709 13:14:36.932786  4437 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:36.908911  4445 raft_consensus.cc:515] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:36.938218  4060 catalog_manager.cc:5697] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.979157  4386 raft_consensus.cc:2468] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:36.983716  4445 leader_election.cc:290] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:36.966058  4437 ts_tablet_manager.cc:1403] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.179s	user 0.011s	sys 0.001s
I20260709 13:14:36.985317  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:36.985616  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:36.986061  4388 raft_consensus.cc:3060] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.987720  4437 raft_consensus.cc:359] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
W20260709 13:14:36.987895  4204 leader_election.cc:343] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.990949  4434 raft_consensus.cc:359] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:36.991684  4434 raft_consensus.cc:385] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.991967  4434 raft_consensus.cc:740] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.003335  4388 raft_consensus.cc:2468] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:37.005687  4207 leader_election.cc:304] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:37.006800  4445 raft_consensus.cc:2804] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.007469  4445 raft_consensus.cc:697] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:37.008312  4445 consensus_queue.cc:237] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.019052  4443 tablet_bootstrap.cc:654] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.988482  4437 raft_consensus.cc:385] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.992703  4434 consensus_queue.cc:260] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.020428  4437 raft_consensus.cc:740] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.023386  4437 consensus_queue.cc:260] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.036943  4437 ts_tablet_manager.cc:1434] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:14:37.039220  4437 tablet_bootstrap.cc:492] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:37.050211  4435 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:37.051101  4435 ts_tablet_manager.cc:1403] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.273s	user 0.036s	sys 0.033s
I20260709 13:14:37.053031  4434 ts_tablet_manager.cc:1434] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:14:37.055949  4434 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:37.057852  4435 raft_consensus.cc:359] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.065045  4435 raft_consensus.cc:385] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.065424  4435 raft_consensus.cc:740] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.066220  4435 consensus_queue.cc:260] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.072929  4435 ts_tablet_manager.cc:1434] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:14:37.074069  4435 tablet_bootstrap.cc:492] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:37.074569  4443 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:37.075174  4443 ts_tablet_manager.cc:1403] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.000s
I20260709 13:14:37.064394  4437 tablet_bootstrap.cc:654] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.063624  4063 catalog_manager.cc:5697] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.084169  4443 raft_consensus.cc:359] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.084969  4443 raft_consensus.cc:385] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.085280  4443 raft_consensus.cc:740] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.086122  4434 tablet_bootstrap.cc:654] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.087420  4443 consensus_queue.cc:260] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.088346  4640 raft_consensus.cc:493] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.088858  4640 raft_consensus.cc:515] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.093827  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:37.094578  4443 ts_tablet_manager.cc:1434] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:14:37.094673  4388 raft_consensus.cc:2393] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:37.095309  4665 raft_consensus.cc:493] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.095830  4665 raft_consensus.cc:515] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.097337  4443 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:37.098112  4665 leader_election.cc:290] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:37.100137  4566 raft_consensus.cc:493] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.100649  4566 raft_consensus.cc:515] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.101469  4641 raft_consensus.cc:493] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.103291  4566 leader_election.cc:290] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:37.102079  4641 raft_consensus.cc:515] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.104588  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55eb9f8d154841ba534af714307367" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:37.104596  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55eb9f8d154841ba534af714307367" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:37.106443  4352 leader_election.cc:343] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.106761  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:37.109525  4388 raft_consensus.cc:2468] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
W20260709 13:14:37.107162  4352 leader_election.cc:343] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.110550  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:37.110968  4281 leader_election.cc:304] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:37.111042  4352 leader_election.cc:304] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:37.112033  4665 raft_consensus.cc:2804] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:37.112478  4278 leader_election.cc:343] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.107288  4640 leader_election.cc:290] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:37.110626  4435 tablet_bootstrap.cc:654] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.113356  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:37.112471  4665 raft_consensus.cc:493] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.114132  4665 raft_consensus.cc:3060] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.106729  4641 leader_election.cc:290] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:37.116238  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.108465  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:37.118175  4129 leader_election.cc:304] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:37.119917  4640 raft_consensus.cc:3060] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.112624  4566 raft_consensus.cc:2749] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.122655  4665 raft_consensus.cc:515] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.124935  4443 tablet_bootstrap.cc:654] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.125726  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:37.126430  4386 raft_consensus.cc:3060] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:37.127552  4204 leader_election.cc:343] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.127591  4435 tablet_bootstrap.cc:492] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:37.129618  4434 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:37.134193  4434 ts_tablet_manager.cc:1403] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.000s
W20260709 13:14:37.134333  4204 leader_election.cc:343] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.135638  4204 leader_election.cc:304] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:37.136570  4445 raft_consensus.cc:2749] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.138234  4386 raft_consensus.cc:2468] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:37.138108  4434 raft_consensus.cc:359] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.143824  4434 raft_consensus.cc:385] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.144220  4434 raft_consensus.cc:740] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.144411  4281 leader_election.cc:304] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:37.145361  4699 raft_consensus.cc:2804] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.145107  4434 consensus_queue.cc:260] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.145738  4665 leader_election.cc:290] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:37.145236  4060 catalog_manager.cc:5697] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.145956  4699 raft_consensus.cc:697] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:37.146416  4435 ts_tablet_manager.cc:1403] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.003s
I20260709 13:14:37.147146  4699 consensus_queue.cc:237] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.149389  4706 raft_consensus.cc:493] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.149690  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:37.150058  4706 raft_consensus.cc:515] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
W20260709 13:14:37.151377  4278 leader_election.cc:343] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.154930  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762ce0ab18a64b88be473be55dedb1a6" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.152755  4706 leader_election.cc:290] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
W20260709 13:14:37.156666  4278 leader_election.cc:343] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.157403  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762ce0ab18a64b88be473be55dedb1a6" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
W20260709 13:14:37.158731  4281 leader_election.cc:343] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.159206  4281 leader_election.cc:304] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:37.159368  4434 ts_tablet_manager.cc:1434] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:14:37.160447  4706 raft_consensus.cc:2749] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.160567  4434 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:37.162828  4435 raft_consensus.cc:359] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.163611  4435 raft_consensus.cc:385] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.163944  4435 raft_consensus.cc:740] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.165292  4443 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:37.165872  4443 ts_tablet_manager.cc:1403] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.009s
I20260709 13:14:37.168867  4443 raft_consensus.cc:359] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.169800  4437 tablet_bootstrap.cc:492] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:37.171307  4640 raft_consensus.cc:2749] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.182561  4437 ts_tablet_manager.cc:1403] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.014s
I20260709 13:14:37.185108  4437 raft_consensus.cc:359] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.176869  4435 consensus_queue.cc:260] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.186041  4437 raft_consensus.cc:385] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.186404  4437 raft_consensus.cc:740] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.187290  4437 consensus_queue.cc:260] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.190814  4434 tablet_bootstrap.cc:654] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.181286  4060 catalog_manager.cc:5697] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.191511  4435 ts_tablet_manager.cc:1434] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:14:37.193068  4435 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:37.202715  4435 tablet_bootstrap.cc:654] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.204126  4443 raft_consensus.cc:385] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.204694  4443 raft_consensus.cc:740] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.205660  4443 consensus_queue.cc:260] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.218145  4443 ts_tablet_manager.cc:1434] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 13:14:37.219311  4443 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:37.225833  4443 tablet_bootstrap.cc:654] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.245116  4434 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:37.245699  4434 ts_tablet_manager.cc:1403] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.009s
I20260709 13:14:37.248805  4434 raft_consensus.cc:359] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.250198  4434 raft_consensus.cc:385] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.250589  4434 raft_consensus.cc:740] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.251544  4434 consensus_queue.cc:260] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.253854  4434 ts_tablet_manager.cc:1434] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:37.255023  4434 tablet_bootstrap.cc:492] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:37.265645  4437 ts_tablet_manager.cc:1434] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260709 13:14:37.269178  4434 tablet_bootstrap.cc:654] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.273041  4640 consensus_queue.cc:1048] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:37.277361  4437 tablet_bootstrap.cc:492] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:37.289073  4435 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:37.290092  4435 ts_tablet_manager.cc:1403] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.025s
I20260709 13:14:37.297928  4435 raft_consensus.cc:359] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.299070  4435 raft_consensus.cc:385] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.299751  4435 raft_consensus.cc:740] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.300915  4435 consensus_queue.cc:260] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.315124  4437 tablet_bootstrap.cc:654] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.322889  4640 consensus_queue.cc:1048] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:37.319979  4435 ts_tablet_manager.cc:1434] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:14:37.333843  4435 tablet_bootstrap.cc:492] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:37.340070  4435 tablet_bootstrap.cc:654] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.355929  4706 raft_consensus.cc:493] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.356513  4706 raft_consensus.cc:515] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.358825  4706 leader_election.cc:290] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:37.361212  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55eb9f8d154841ba534af714307367" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:37.360980  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55eb9f8d154841ba534af714307367" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:37.362593  4443 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:37.363125  4443 ts_tablet_manager.cc:1403] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.144s	user 0.036s	sys 0.045s
I20260709 13:14:37.353998  4699 consensus_queue.cc:1048] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:14:37.366001  4443 raft_consensus.cc:359] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.366744  4443 raft_consensus.cc:385] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.367132  4443 raft_consensus.cc:740] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.368106  4443 consensus_queue.cc:260] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:37.370677  4278 leader_election.cc:343] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.353684  4641 raft_consensus.cc:493] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.373409  4641 raft_consensus.cc:515] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.376266  4641 leader_election.cc:290] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:37.377931  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:37.361864  4386 raft_consensus.cc:2468] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:37.380089  4281 leader_election.cc:304] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:37.381171  4699 raft_consensus.cc:2804] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.381572  4699 raft_consensus.cc:493] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.381958  4699 raft_consensus.cc:3060] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:37.382840  4278 consensus_peers.cc:597] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:37.385993  4204 leader_election.cc:343] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.389640  4437 tablet_bootstrap.cc:492] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:37.390210  4437 ts_tablet_manager.cc:1403] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.004s
I20260709 13:14:37.394323  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:37.394639  4434 tablet_bootstrap.cc:492] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:37.395314  4434 ts_tablet_manager.cc:1403] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.013s
I20260709 13:14:37.395190  4387 raft_consensus.cc:2468] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:37.401516  4207 leader_election.cc:304] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:37.402269  4434 raft_consensus.cc:359] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.403086  4443 ts_tablet_manager.cc:1434] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:14:37.403226  4434 raft_consensus.cc:385] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.403621  4434 raft_consensus.cc:740] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.404461  4443 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:37.404359  4434 consensus_queue.cc:260] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.406577  4434 ts_tablet_manager.cc:1434] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:14:37.407502  4434 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:37.409149  4445 raft_consensus.cc:2804] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.409582  4445 raft_consensus.cc:493] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.409927  4445 raft_consensus.cc:3060] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.435537  4579 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.446214  4579 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.447701  4699 raft_consensus.cc:515] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.449851  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.450587  4699 leader_election.cc:290] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:37.451116  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55eb9f8d154841ba534af714307367" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:37.451570  4387 raft_consensus.cc:3060] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.448732  4579 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:37.454563  4437 raft_consensus.cc:359] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.455353  4437 raft_consensus.cc:385] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.455648  4437 raft_consensus.cc:740] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.456660  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:37.458397  4352 leader_election.cc:343] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.459969  4445 raft_consensus.cc:515] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.461683  4640 consensus_queue.cc:1048] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.462276  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa55eb9f8d154841ba534af714307367" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:37.462998  4435 tablet_bootstrap.cc:492] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:37.463599  4435 ts_tablet_manager.cc:1403] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.132s	user 0.018s	sys 0.029s
W20260709 13:14:37.463828  4278 leader_election.cc:343] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:37.466843  4352 leader_election.cc:343] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.467326  4352 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:37.468634  4434 tablet_bootstrap.cc:654] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.466495  4435 raft_consensus.cc:359] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.469641  4435 raft_consensus.cc:385] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.469950  4435 raft_consensus.cc:740] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.469985  4437 consensus_queue.cc:260] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.472656  4445 leader_election.cc:290] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:37.473686  4437 ts_tablet_manager.cc:1434] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.001s
I20260709 13:14:37.474514  4435 consensus_queue.cc:260] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.475404  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:37.476176  4314 raft_consensus.cc:3060] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.477290  4443 tablet_bootstrap.cc:654] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.482681  4579 raft_consensus.cc:2749] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.486160  4387 raft_consensus.cc:2468] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:37.488865  4314 raft_consensus.cc:2468] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:37.493033  4204 leader_election.cc:304] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:37.494621  4437 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:37.507234  4281 leader_election.cc:304] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:37.509176  4567 raft_consensus.cc:493] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.509943  4567 raft_consensus.cc:515] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.512734  4567 leader_election.cc:290] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:37.513561  4567 raft_consensus.cc:2804] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.514029  4567 raft_consensus.cc:697] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:37.515285  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:37.515115  4567 consensus_queue.cc:237] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.516314  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.517522  4239 raft_consensus.cc:2468] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:37.519544  4278 leader_election.cc:304] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:37.520714  4699 raft_consensus.cc:2804] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.521345  4699 raft_consensus.cc:493] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.521915  4699 raft_consensus.cc:3060] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.505286  4548 raft_consensus.cc:2804] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.504556  4640 raft_consensus.cc:493] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.536024  4435 ts_tablet_manager.cc:1434] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.001s
I20260709 13:14:37.529332  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:37.537472  4389 raft_consensus.cc:3060] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.541184  4437 tablet_bootstrap.cc:654] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.546221  4443 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:37.546941  4443 ts_tablet_manager.cc:1403] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.006s
I20260709 13:14:37.554607  4435 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:37.548662  4640 raft_consensus.cc:515] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.573880  4640 leader_election.cc:290] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:37.577461  4163 raft_consensus.cc:2468] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:37.579464  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.549250  4548 raft_consensus.cc:697] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:37.580200  4239 raft_consensus.cc:2468] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:37.579802  4434 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:37.583086  4434 ts_tablet_manager.cc:1403] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.176s	user 0.032s	sys 0.021s
I20260709 13:14:37.584830  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:37.585254  4548 consensus_queue.cc:237] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.588599  4129 leader_election.cc:304] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:37.589924  4707 raft_consensus.cc:2804] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.590307  4707 raft_consensus.cc:493] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.590615  4707 raft_consensus.cc:3060] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.605093  4566 raft_consensus.cc:493] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.606037  4434 raft_consensus.cc:359] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.606845  4434 raft_consensus.cc:385] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.607432  4434 raft_consensus.cc:740] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.608281  4434 consensus_queue.cc:260] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.611220  4443 raft_consensus.cc:359] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.612046  4443 raft_consensus.cc:385] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.612325  4443 raft_consensus.cc:740] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.605891  4566 raft_consensus.cc:515] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.615926  4064 catalog_manager.cc:5697] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.636884  4435 tablet_bootstrap.cc:654] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.620618  4434 ts_tablet_manager.cc:1434] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:14:37.618932  4640 consensus_queue.cc:1048] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:14:37.633570  4742 raft_consensus.cc:493] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.638614  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762ce0ab18a64b88be473be55dedb1a6" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:37.624692  4163 raft_consensus.cc:3060] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.621145  4443 consensus_queue.cc:260] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.643245  4434 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:37.636802  4566 leader_election.cc:290] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:37.646394  4389 raft_consensus.cc:2468] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:37.644486  4742 raft_consensus.cc:515] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.648132  4310 raft_consensus.cc:2468] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:37.620244  4641 consensus_queue.cc:1048] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:14:37.665751  4352 leader_election.cc:304] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:37.661469  4437 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:37.667179  4437 ts_tablet_manager.cc:1403] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.003s
I20260709 13:14:37.648625  4707 raft_consensus.cc:515] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.688705  4443 ts_tablet_manager.cc:1434] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.141s	user 0.006s	sys 0.006s
I20260709 13:14:37.672004  4566 raft_consensus.cc:2804] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.680365  4603 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.692605  4566 raft_consensus.cc:493] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.707952  4434 tablet_bootstrap.cc:654] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.717649  4707 leader_election.cc:290] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:37.718155  4437 raft_consensus.cc:359] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.718921  4437 raft_consensus.cc:385] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.719573  4437 raft_consensus.cc:740] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.720506  4437 consensus_queue.cc:260] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.717059  4566 raft_consensus.cc:3060] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.696888  4603 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.718881  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:37.739442  4437 ts_tablet_manager.cc:1434] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:14:37.711495  4699 raft_consensus.cc:515] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
W20260709 13:14:37.716717  4207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 58769.4us
I20260709 13:14:37.756968  4603 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:37.759298  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:37.759601  4747 consensus_queue.cc:1048] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:37.761386  4747 consensus_queue.cc:1048] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.767817  4443 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:37.752115  4742 leader_election.cc:290] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:37.780548  4699 leader_election.cc:290] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:37.788664  4313 raft_consensus.cc:2393] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:37.790575  4239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:37.791307  4239 raft_consensus.cc:3060] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.793603  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:37.794739  4162 raft_consensus.cc:2393] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44912ba11bc04ab383e985aa41ec5b38 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
W20260709 13:14:37.772809  4204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 127287us
W20260709 13:14:37.773887  4281 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 48292.6us
I20260709 13:14:37.805123  4707 raft_consensus.cc:493] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44912ba11bc04ab383e985aa41ec5b38)
I20260709 13:14:37.805821  4707 raft_consensus.cc:515] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.807291  4435 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:37.808092  4435 ts_tablet_manager.cc:1403] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.254s	user 0.018s	sys 0.022s
I20260709 13:14:37.809119  4238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762ce0ab18a64b88be473be55dedb1a6" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:37.810933  4352 leader_election.cc:343] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.815598  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.816569  4238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
W20260709 13:14:37.821976  4129 leader_election.cc:343] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.821866  4754 consensus_queue.cc:1048] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:37.823057  4129 leader_election.cc:304] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:37.825080  4640 raft_consensus.cc:2749] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.828876  4579 raft_consensus.cc:493] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.829562  4579 raft_consensus.cc:515] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.830180  4389 raft_consensus.cc:2468] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:37.831019  4443 tablet_bootstrap.cc:654] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.831619  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80801dd62bc4b0894771a460938aa71" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:37.834720  4437 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:37.840169  4434 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:37.840731  4434 ts_tablet_manager.cc:1403] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.012s
I20260709 13:14:37.833339  4579 leader_election.cc:290] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:37.847925  4238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb55c5197494054ac66ee0284bc1234" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.836880  4707 leader_election.cc:290] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:37.854013  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:37.854399  4239 raft_consensus.cc:2468] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:37.856027  4238 raft_consensus.cc:3060] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.856273  4278 leader_election.cc:304] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:37.857753  4752 raft_consensus.cc:2804] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.858281  4752 raft_consensus.cc:697] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:37.859300  4752 consensus_queue.cc:237] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.859859  4435 raft_consensus.cc:359] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.860661  4435 raft_consensus.cc:385] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.860949  4435 raft_consensus.cc:740] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.866539  4132 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:37.868386  4603 raft_consensus.cc:2804] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.868772  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb55c5197494054ac66ee0284bc1234" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:37.869246  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:37.868827  4603 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.870217  4603 raft_consensus.cc:3060] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.871428  4434 raft_consensus.cc:359] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:37.871454  4352 leader_election.cc:343] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.880191  4755 raft_consensus.cc:493] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.879999  4603 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.880847  4755 raft_consensus.cc:515] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:37.883419  4755 leader_election.cc:290] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:37.885860  4566 raft_consensus.cc:515] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:37.872180  4434 raft_consensus.cc:385] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.890553  4434 raft_consensus.cc:740] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
W20260709 13:14:37.892004  4352 leader_election.cc:343] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.892776  4352 leader_election.cc:304] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:37.893793  4586 raft_consensus.cc:2749] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.885783  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e836aa87f0415ab357635172010986" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.891292  4434 consensus_queue.cc:260] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:37.897346  4437 tablet_bootstrap.cc:654] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.903687  4435 consensus_queue.cc:260] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.949047  4434 ts_tablet_manager.cc:1434] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.006s
I20260709 13:14:37.953918  4434 tablet_bootstrap.cc:492] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:37.959142  4435 ts_tablet_manager.cc:1434] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.151s	user 0.008s	sys 0.015s
I20260709 13:14:37.960623  4435 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:37.969885  4603 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:37.970999  4129 leader_election.cc:304] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:37.910003  4240 raft_consensus.cc:2468] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:37.957641  4502 raft_consensus.cc:493] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.969907  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80801dd62bc4b0894771a460938aa71" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:37.979974  4502 raft_consensus.cc:515] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:37.987342  4502 leader_election.cc:290] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:37.989558  4434 tablet_bootstrap.cc:654] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.989833  4237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:37.990810  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762ce0ab18a64b88be473be55dedb1a6" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:37.992677  4443 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:37.995258  4443 ts_tablet_manager.cc:1403] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.230s	user 0.020s	sys 0.011s
I20260709 13:14:37.997573  4204 leader_election.cc:304] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505
W20260709 13:14:38.000722  4352 leader_election.cc:343] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:38.009583  4352 leader_election.cc:343] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.009130  4278 leader_election.cc:304] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:38.011752  4706 raft_consensus.cc:2804] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.012162  4706 raft_consensus.cc:493] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.012521  4706 raft_consensus.cc:3060] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.013854  4754 raft_consensus.cc:2749] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.014750  4435 tablet_bootstrap.cc:654] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.019840  4566 leader_election.cc:290] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:38.033499  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762ce0ab18a64b88be473be55dedb1a6" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:38.034216  4310 raft_consensus.cc:3060] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.038461  4706 raft_consensus.cc:515] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
W20260709 13:14:38.044950  4129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 74064us
I20260709 13:14:38.047219  4063 catalog_manager.cc:5697] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:38.050208  4132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 45305.6us
I20260709 13:14:38.051592  4443 raft_consensus.cc:359] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:38.052508  4443 raft_consensus.cc:385] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.052781  4443 raft_consensus.cc:740] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.039145  4747 consensus_queue.cc:1048] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.053437  4443 consensus_queue.cc:260] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:38.062855  4238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:38.063551  4443 ts_tablet_manager.cc:1434] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.068s	user 0.001s	sys 0.005s
I20260709 13:14:38.064556  4443 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:38.067068  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:38.067749  4387 raft_consensus.cc:3060] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.072468  4443 tablet_bootstrap.cc:654] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.072755  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e836aa87f0415ab357635172010986" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:38.083385  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:38.089162  4352 leader_election.cc:343] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:38.090845  4278 leader_election.cc:343] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.090890  4352 leader_election.cc:304] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:38.097313  4437 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:38.098088  4437 ts_tablet_manager.cc:1403] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.264s	user 0.021s	sys 0.019s
I20260709 13:14:38.094887  4502 raft_consensus.cc:2749] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:38.109987  4129 leader_election.cc:343] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.121824  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e836aa87f0415ab357635172010986" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
W20260709 13:14:38.124974  4278 leader_election.cc:343] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.119238  4603 raft_consensus.cc:2749] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:38.138628  4437 raft_consensus.cc:359] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.139395  4437 raft_consensus.cc:385] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.139678  4437 raft_consensus.cc:740] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.140316  4437 consensus_queue.cc:260] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.141781  4060 catalog_manager.cc:5697] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.150799  4706 leader_election.cc:290] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:38.151662  4437 ts_tablet_manager.cc:1434] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:14:38.155715  4310 raft_consensus.cc:2468] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:38.157622  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e836aa87f0415ab357635172010986" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:38.158443  4240 raft_consensus.cc:3060] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.162701  4437 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:38.168550  4434 tablet_bootstrap.cc:492] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:38.169203  4434 ts_tablet_manager.cc:1403] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.218s	user 0.031s	sys 0.038s
I20260709 13:14:38.172317  4434 raft_consensus.cc:359] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.175357  4434 raft_consensus.cc:385] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.175427  4352 leader_election.cc:304] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:38.174562  4387 raft_consensus.cc:2468] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
W20260709 13:14:38.176787  4278 consensus_peers.cc:597] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:38.175743  4434 raft_consensus.cc:740] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.182672  4434 consensus_queue.cc:260] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.193784  4434 ts_tablet_manager.cc:1434] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:14:38.190712  4579 raft_consensus.cc:2804] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.207357  4132 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
W20260709 13:14:38.205677  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:38.226385  4434 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:38.242157  4443 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:38.242803  4443 ts_tablet_manager.cc:1403] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.178s	user 0.022s	sys 0.002s
I20260709 13:14:38.245122  4752 raft_consensus.cc:493] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.245914  4752 raft_consensus.cc:515] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:38.248935  4752 leader_election.cc:290] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:38.230187  4603 raft_consensus.cc:2804] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.250600  4435 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:38.251956  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e41d162a7f742a0b613d0a3e9ebaeb2" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:38.263479  4435 ts_tablet_manager.cc:1403] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.303s	user 0.020s	sys 0.008s
I20260709 13:14:38.262540  4603 raft_consensus.cc:697] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:38.265839  4603 consensus_queue.cc:237] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.257387  4443 raft_consensus.cc:359] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.266458  4435 raft_consensus.cc:359] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:38.267511  4281 leader_election.cc:343] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.251096  4437 tablet_bootstrap.cc:654] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.268981  4443 raft_consensus.cc:385] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.277575  4443 raft_consensus.cc:740] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
W20260709 13:14:38.277762  4204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 180139us
I20260709 13:14:38.271057  4435 raft_consensus.cc:385] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.279765  4435 raft_consensus.cc:740] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.273341  4579 raft_consensus.cc:697] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:38.281031  4579 consensus_queue.cc:237] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.283411  4435 consensus_queue.cc:260] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:38.286243  4443 consensus_queue.cc:260] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.294379  4434 tablet_bootstrap.cc:654] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.297564  4443 ts_tablet_manager.cc:1434] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.005s
I20260709 13:14:38.298756  4443 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:38.294466  4742 consensus_queue.cc:1048] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:14:38.308919  4240 raft_consensus.cc:2468] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:38.313321  4435 ts_tablet_manager.cc:1434] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.003s
I20260709 13:14:38.318161  4435 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:38.319465  4699 raft_consensus.cc:493] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.273701  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e41d162a7f742a0b613d0a3e9ebaeb2" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:38.322369  4166 raft_consensus.cc:2468] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:38.327047  4437 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:38.327827  4437 ts_tablet_manager.cc:1403] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.000s
I20260709 13:14:38.327049  4278 leader_election.cc:304] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:38.321357  4699 raft_consensus.cc:515] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.332288  4752 raft_consensus.cc:2804] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.332749  4752 raft_consensus.cc:493] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.333266  4752 raft_consensus.cc:3060] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.338627  4278 leader_election.cc:304] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:38.341842  4706 raft_consensus.cc:2804] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.342780  4706 raft_consensus.cc:697] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:38.342279  4437 raft_consensus.cc:359] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.343863  4437 raft_consensus.cc:385] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.344213  4437 raft_consensus.cc:740] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.344970  4706 consensus_queue.cc:237] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.351738  4443 tablet_bootstrap.cc:654] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.351511  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb55c5197494054ac66ee0284bc1234" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:38.375206  4386 raft_consensus.cc:2468] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:38.353698  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb55c5197494054ac66ee0284bc1234" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:38.352810  4699 leader_election.cc:290] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:38.357157  4567 consensus_queue.cc:1048] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.360184  4752 raft_consensus.cc:515] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:38.376646  4281 leader_election.cc:304] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:38.377835  4752 leader_election.cc:290] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:38.378468  4752 raft_consensus.cc:2804] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.378822  4752 raft_consensus.cc:493] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.379005  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e41d162a7f742a0b613d0a3e9ebaeb2" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:38.379211  4752 raft_consensus.cc:3060] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.379733  4388 raft_consensus.cc:3060] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:38.360520  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 90940.9us
I20260709 13:14:38.373312  4434 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:38.382403  4434 ts_tablet_manager.cc:1403] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.000s
I20260709 13:14:38.385506  4434 raft_consensus.cc:359] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.386273  4434 raft_consensus.cc:385] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.386590  4434 raft_consensus.cc:740] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.387368  4434 consensus_queue.cc:260] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.389894  4445 consensus_queue.cc:1048] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.396420  4388 raft_consensus.cc:2468] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:38.398519  4281 leader_election.cc:304] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:38.374550  4435 tablet_bootstrap.cc:654] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.405709  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e41d162a7f742a0b613d0a3e9ebaeb2" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:38.406618  4163 raft_consensus.cc:3060] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.407229  4064 catalog_manager.cc:5697] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.345165  4437 consensus_queue.cc:260] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.409883  4742 raft_consensus.cc:493] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.410341  4742 raft_consensus.cc:515] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.415129  4706 raft_consensus.cc:2804] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.417641  4706 raft_consensus.cc:697] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:38.421252  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:38.420159  4434 ts_tablet_manager.cc:1434] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:14:38.421916  4706 consensus_queue.cc:237] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:38.422888  4204 leader_election.cc:343] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.423998  4434 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:38.430970  4437 ts_tablet_manager.cc:1434] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
W20260709 13:14:38.421315  4278 leader_election.cc:343] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.424233  4742 leader_election.cc:290] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:38.427402  4163 raft_consensus.cc:2468] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:38.428112  4752 raft_consensus.cc:515] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.444059  4752 leader_election.cc:290] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:38.449424  4437 tablet_bootstrap.cc:492] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:38.450896  4747 consensus_queue.cc:1048] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.452482  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:38.455710  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb55c5197494054ac66ee0284bc1234" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:38.456498  4388 raft_consensus.cc:3060] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.457960  4311 raft_consensus.cc:2468] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:38.463828  4437 tablet_bootstrap.cc:654] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.464191  4443 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:38.464751  4443 ts_tablet_manager.cc:1403] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.014s
I20260709 13:14:38.467849  4443 raft_consensus.cc:359] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:38.468649  4443 raft_consensus.cc:385] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.468954  4443 raft_consensus.cc:740] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.469990  4443 consensus_queue.cc:260] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:38.473362  4443 ts_tablet_manager.cc:1434] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:38.474440  4443 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:38.475543  4204 leader_election.cc:304] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:38.476444  4445 raft_consensus.cc:2804] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.476845  4445 raft_consensus.cc:493] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.477200  4445 raft_consensus.cc:3060] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.474073  4063 catalog_manager.cc:5697] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.485359  4434 tablet_bootstrap.cc:654] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.503894  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb55c5197494054ac66ee0284bc1234" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
W20260709 13:14:38.515599  4278 leader_election.cc:343] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.517112  4445 raft_consensus.cc:515] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.518576  4435 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:38.519125  4435 ts_tablet_manager.cc:1403] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.013s
I20260709 13:14:38.521945  4435 raft_consensus.cc:359] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:38.522657  4435 raft_consensus.cc:385] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.522717  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:38.522994  4435 raft_consensus.cc:740] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.523866  4435 consensus_queue.cc:260] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:38.524260  4204 leader_election.cc:343] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.526037  4435 ts_tablet_manager.cc:1434] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:38.526943  4435 tablet_bootstrap.cc:492] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:38.528258  4640 raft_consensus.cc:493] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.528820  4640 raft_consensus.cc:515] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.531065  4640 leader_election.cc:290] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:38.533255  4435 tablet_bootstrap.cc:654] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.558259  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e836aa87f0415ab357635172010986" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:38.559206  4240 raft_consensus.cc:2393] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:38.560565  4437 tablet_bootstrap.cc:492] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:38.561156  4437 ts_tablet_manager.cc:1403] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.122s	user 0.022s	sys 0.010s
I20260709 13:14:38.561272  4445 leader_election.cc:290] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:38.562237  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e836aa87f0415ab357635172010986" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:38.564139  4437 raft_consensus.cc:359] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.565078  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:38.565770  4310 raft_consensus.cc:3060] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.565866  4129 leader_election.cc:304] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:38.564895  4437 raft_consensus.cc:385] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.568869  4437 raft_consensus.cc:740] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.570173  4640 raft_consensus.cc:3060] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.573628  4443 tablet_bootstrap.cc:654] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.570677  4437 consensus_queue.cc:260] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.583552  4640 raft_consensus.cc:2749] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.570017  4064 catalog_manager.cc:5697] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.587206  4437 ts_tablet_manager.cc:1434] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:14:38.591817  4437 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:38.591753  4388 raft_consensus.cc:2468] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:38.584707  4310 raft_consensus.cc:2468] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:38.594862  4434 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:38.596140  4434 ts_tablet_manager.cc:1403] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.008s
I20260709 13:14:38.597397  4281 leader_election.cc:304] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:38.600126  4706 raft_consensus.cc:2804] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.600656  4706 raft_consensus.cc:697] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:38.601624  4706 consensus_queue.cc:237] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.609241  4434 raft_consensus.cc:359] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.610391  4434 raft_consensus.cc:385] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.610781  4434 raft_consensus.cc:740] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.611732  4434 consensus_queue.cc:260] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.614291  4434 ts_tablet_manager.cc:1434] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:14:38.618218  4166 raft_consensus.cc:3060] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.629575  4434 tablet_bootstrap.cc:492] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:38.643919  4204 leader_election.cc:304] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:38.659401  4063 catalog_manager.cc:5697] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.673076  4443 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:38.673689  4443 ts_tablet_manager.cc:1403] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.199s	user 0.021s	sys 0.008s
I20260709 13:14:38.664669  4774 raft_consensus.cc:2804] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.680233  4774 raft_consensus.cc:697] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:38.709203  4548 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.716526  4548 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.719149  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:38.719758  4548 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:38.720024  4388 raft_consensus.cc:2393] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
I20260709 13:14:38.681046  4774 consensus_queue.cc:237] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.720644  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:38.725693  4204 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:38.732576  4445 raft_consensus.cc:3060] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.733367  4437 tablet_bootstrap.cc:654] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.743607  4445 raft_consensus.cc:2749] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.747916  4435 tablet_bootstrap.cc:492] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:38.748524  4435 ts_tablet_manager.cc:1403] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.222s	user 0.026s	sys 0.046s
I20260709 13:14:38.740114  4443 raft_consensus.cc:359] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.753418  4443 raft_consensus.cc:385] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.753741  4443 raft_consensus.cc:740] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.754482  4443 consensus_queue.cc:260] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.757149  4063 catalog_manager.cc:5697] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.763437  4443 ts_tablet_manager.cc:1434] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.003s
I20260709 13:14:38.764549  4443 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:38.785938  4579 consensus_queue.cc:1048] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.789513  4443 tablet_bootstrap.cc:654] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.796290  4437 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:38.796970  4437 ts_tablet_manager.cc:1403] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.207s	user 0.011s	sys 0.003s
I20260709 13:14:38.800174  4437 raft_consensus.cc:359] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.800835  4437 raft_consensus.cc:385] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.801122  4437 raft_consensus.cc:740] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.801800  4437 consensus_queue.cc:260] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.803962  4437 ts_tablet_manager.cc:1434] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:38.804852  4443 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:38.805552  4443 ts_tablet_manager.cc:1403] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.002s
I20260709 13:14:38.804957  4437 tablet_bootstrap.cc:492] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:38.808540  4443 raft_consensus.cc:359] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.809415  4443 raft_consensus.cc:385] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.809719  4443 raft_consensus.cc:740] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.810580  4443 consensus_queue.cc:260] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:38.759151  4434 tablet_bootstrap.cc:654] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.759328  4435 raft_consensus.cc:359] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.813271  4435 raft_consensus.cc:385] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.813375  4443 ts_tablet_manager.cc:1434] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:38.813614  4435 raft_consensus.cc:740] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.814651  4443 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:38.814486  4435 consensus_queue.cc:260] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.816339  4435 ts_tablet_manager.cc:1434] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.068s	user 0.001s	sys 0.005s
I20260709 13:14:38.816864  4437 tablet_bootstrap.cc:654] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.819861  4435 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:38.822546  4443 tablet_bootstrap.cc:654] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.827852  4706 consensus_queue.cc:1048] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.833722  4435 tablet_bootstrap.cc:654] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.843083  4434 tablet_bootstrap.cc:492] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:38.843614  4434 ts_tablet_manager.cc:1403] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.214s	user 0.010s	sys 0.002s
I20260709 13:14:38.842694  4064 catalog_manager.cc:5697] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.852702  4443 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:38.856731  4443 ts_tablet_manager.cc:1403] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.004s
I20260709 13:14:38.856336  4640 consensus_queue.cc:1048] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.859625  4443 raft_consensus.cc:359] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.860383  4443 raft_consensus.cc:385] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.860667  4443 raft_consensus.cc:740] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.861342  4443 consensus_queue.cc:260] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.863410  4443 ts_tablet_manager.cc:1434] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:38.864336  4443 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:38.848330  4434 raft_consensus.cc:359] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.865473  4434 raft_consensus.cc:385] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.866278  4434 raft_consensus.cc:740] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.867067  4434 consensus_queue.cc:260] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.870359  4443 tablet_bootstrap.cc:654] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.870486  4699 raft_consensus.cc:493] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.870975  4747 consensus_queue.cc:1048] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.871042  4699 raft_consensus.cc:515] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.873528  4699 leader_election.cc:290] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:38.875928  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f31b1c5c2a1430fbb22163bc29c247f" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:38.878352  4388 raft_consensus.cc:2468] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:38.880630  4579 raft_consensus.cc:493] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.881045  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f31b1c5c2a1430fbb22163bc29c247f" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:38.881435  4579 raft_consensus.cc:515] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:38.882894  4278 leader_election.cc:343] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.884334  4579 leader_election.cc:290] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:38.888345  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:38.889482  4281 leader_election.cc:304] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:38.891847  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:38.892140  4699 raft_consensus.cc:2804] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.892679  4699 raft_consensus.cc:493] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.893054  4699 raft_consensus.cc:3060] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:38.894634  4352 leader_election.cc:343] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:38.897914  4352 leader_election.cc:343] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.898849  4352 leader_election.cc:304] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:38.856354  4437 tablet_bootstrap.cc:492] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:38.904066  4437 ts_tablet_manager.cc:1403] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.023s
I20260709 13:14:38.905807  4777 raft_consensus.cc:2749] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.910321  4603 consensus_queue.cc:1048] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.911965  4437 raft_consensus.cc:359] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.914856  4437 raft_consensus.cc:385] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.915902  4437 raft_consensus.cc:740] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.916576  4752 consensus_queue.cc:1048] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:38.916369  4798 log.cc:927] Time spent T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:14:38.921028  4238 raft_consensus.cc:3060] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.921461  4437 consensus_queue.cc:260] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.925613  4437 ts_tablet_manager.cc:1434] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:14:38.929631  4437 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:38.942514  4579 consensus_queue.cc:1048] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.961608  4435 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:38.969177  4774 raft_consensus.cc:493] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.969725  4435 ts_tablet_manager.cc:1403] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.004s
I20260709 13:14:38.967319  4567 consensus_queue.cc:1048] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.969794  4774 raft_consensus.cc:515] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.972106  4774 leader_election.cc:290] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:38.973806  4548 raft_consensus.cc:493] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.974288  4435 raft_consensus.cc:359] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.975149  4435 raft_consensus.cc:385] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.975495  4435 raft_consensus.cc:740] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.974351  4548 raft_consensus.cc:515] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:38.976727  4435 consensus_queue.cc:260] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.977486  4443 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:38.978417  4443 ts_tablet_manager.cc:1403] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.114s	user 0.043s	sys 0.043s
I20260709 13:14:38.982152  4443 raft_consensus.cc:359] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.983280  4443 raft_consensus.cc:385] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.985817  4443 raft_consensus.cc:740] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.986625  4443 consensus_queue.cc:260] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:38.989068  4443 ts_tablet_manager.cc:1434] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:38.985477  4435 ts_tablet_manager.cc:1434] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:14:38.991997  4435 tablet_bootstrap.cc:492] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:38.996062  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb55c5197494054ac66ee0284bc1234" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:38.997583  4443 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:38.997438  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762ce0ab18a64b88be473be55dedb1a6" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:39.001314  4548 leader_election.cc:290] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:39.005812  4443 tablet_bootstrap.cc:654] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.008126  4435 tablet_bootstrap.cc:654] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.016911  4752 raft_consensus.cc:493] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.017879  4752 raft_consensus.cc:515] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:39.020147  4437 tablet_bootstrap.cc:654] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.024700  4752 leader_election.cc:290] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:39.026083  4434 ts_tablet_manager.cc:1434] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.182s	user 0.007s	sys 0.002s
I20260709 13:14:39.027114  4434 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:39.027737  4435 tablet_bootstrap.cc:492] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:39.028264  4435 ts_tablet_manager.cc:1403] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.012s
I20260709 13:14:39.033947  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a4b9478f394578ba05a6d2c9402d7c" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:39.034834  4240 raft_consensus.cc:2468] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
W20260709 13:14:39.047353  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 89618.4us
I20260709 13:14:39.048697  4699 raft_consensus.cc:515] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:39.057222  4435 raft_consensus.cc:359] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:39.058027  4435 raft_consensus.cc:385] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.058295  4435 raft_consensus.cc:740] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.058316  4278 leader_election.cc:304] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:39.059036  4435 consensus_queue.cc:260] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:39.070317  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a4b9478f394578ba05a6d2c9402d7c" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:39.071135  4166 raft_consensus.cc:2468] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:39.073845  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb55c5197494054ac66ee0284bc1234" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:39.074829  4387 raft_consensus.cc:2393] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:39.075148  4443 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:39.070921  4752 raft_consensus.cc:2804] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.075714  4443 ts_tablet_manager.cc:1403] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.000s
I20260709 13:14:39.072489  4579 raft_consensus.cc:493] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.075721  4752 raft_consensus.cc:493] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.093802  4435 ts_tablet_manager.cc:1434] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.007s
I20260709 13:14:39.096081  4435 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:39.079630  4767 raft_consensus.cc:493] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.090616  4752 raft_consensus.cc:3060] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.120838  4437 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:39.121770  4437 ts_tablet_manager.cc:1403] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.192s	user 0.034s	sys 0.002s
I20260709 13:14:39.129091  4816 raft_consensus.cc:493] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.130074  4816 raft_consensus.cc:515] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
W20260709 13:14:39.134657  4132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 52150.2us
I20260709 13:14:39.090260  4579 raft_consensus.cc:515] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.138314  4699 leader_election.cc:290] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:39.139532  4819 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.140079  4819 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.140956  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f31b1c5c2a1430fbb22163bc29c247f" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:39.141628  4386 raft_consensus.cc:3060] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.142696  4434 tablet_bootstrap.cc:654] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.144057  4437 raft_consensus.cc:359] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.144790  4437 raft_consensus.cc:385] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.145174  4437 raft_consensus.cc:740] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.145929  4437 consensus_queue.cc:260] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.149791  4579 leader_election.cc:290] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:39.150686  4437 ts_tablet_manager.cc:1434] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:14:39.154346  4437 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:39.109506  4767 raft_consensus.cc:515] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:39.166013  4767 leader_election.cc:290] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:39.166953  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "762ce0ab18a64b88be473be55dedb1a6" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:39.167865  4437 tablet_bootstrap.cc:654] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.170317  4238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:39.170456  4443 raft_consensus.cc:359] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:39.171316  4443 raft_consensus.cc:385] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.171595  4443 raft_consensus.cc:740] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.172178  4443 consensus_queue.cc:260] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:39.173434  4435 tablet_bootstrap.cc:654] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.176012  4567 consensus_queue.cc:1048] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.150916  4386 raft_consensus.cc:2468] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:39.198704  4443 ts_tablet_manager.cc:1434] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.002s
I20260709 13:14:39.200150  4443 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:39.195843  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:39.211297  4278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 98619.3us
I20260709 13:14:39.220595  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a4b9478f394578ba05a6d2c9402d7c" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:39.212205  4816 leader_election.cc:290] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
W20260709 13:14:39.240523  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 44924.2us
I20260709 13:14:39.219712  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:39.236090  4767 raft_consensus.cc:493] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.216109  4207 leader_election.cc:304] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505
W20260709 13:14:39.247931  4352 leader_election.cc:343] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.280727  4752 raft_consensus.cc:515] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:39.285719  4752 leader_election.cc:290] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:39.285889  4314 raft_consensus.cc:2393] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:39.286334  4281 leader_election.cc:304] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:39.287256  4310 raft_consensus.cc:2393] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:39.287791  4752 raft_consensus.cc:2804] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:39.288329  4752 raft_consensus.cc:697] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:39.268558  4238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:39.305169  4434 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:39.308418  4434 ts_tablet_manager.cc:1403] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.282s	user 0.023s	sys 0.002s
I20260709 13:14:39.306480  4129 leader_election.cc:304] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:39.314759  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a4b9478f394578ba05a6d2c9402d7c" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:39.315693  4166 raft_consensus.cc:3060] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.329924  4166 raft_consensus.cc:2468] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:39.291575  4767 raft_consensus.cc:515] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.332373  4278 leader_election.cc:304] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:39.309659  4774 raft_consensus.cc:3060] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:39.340533  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 56807.3us
I20260709 13:14:39.328703  4818 raft_consensus.cc:3060] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:39.310935  4207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 100331us
I20260709 13:14:39.378113  4207 leader_election.cc:304] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:39.379866  4548 raft_consensus.cc:2749] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:39.379976  4817 raft_consensus.cc:2804] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:39.383287  4767 leader_election.cc:290] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:39.334250  4752 consensus_queue.cc:237] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:39.336987  4385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:39.408442  4767 raft_consensus.cc:493] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.409322  4767 raft_consensus.cc:515] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:39.413905  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a4b9478f394578ba05a6d2c9402d7c" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:39.430420  4240 raft_consensus.cc:3060] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.426497  4435 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:39.431447  4435 ts_tablet_manager.cc:1403] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.336s	user 0.020s	sys 0.009s
I20260709 13:14:39.363976  4237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f31b1c5c2a1430fbb22163bc29c247f" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
W20260709 13:14:39.446856  4278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 55029.2us
I20260709 13:14:39.453306  4434 raft_consensus.cc:359] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:39.454547  4434 raft_consensus.cc:385] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.454892  4434 raft_consensus.cc:740] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
W20260709 13:14:39.480814  4352 leader_election.cc:343] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.482443  4352 leader_election.cc:304] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:39.486065  4434 consensus_queue.cc:260] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:39.411342  4817 raft_consensus.cc:697] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:39.431324  4385 raft_consensus.cc:2468] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
W20260709 13:14:39.499408  4204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 125081us
I20260709 13:14:39.509214  4443 tablet_bootstrap.cc:654] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.537485  4437 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:39.538249  4437 ts_tablet_manager.cc:1403] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.386s	user 0.018s	sys 0.017s
I20260709 13:14:39.541893  4836 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.542490  4836 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.543314  4579 raft_consensus.cc:2749] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.531487  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:39.543241  4774 raft_consensus.cc:2749] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.543785  4826 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:39.559288  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 78518.3us
I20260709 13:14:39.566129  4434 ts_tablet_manager.cc:1434] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.257s	user 0.007s	sys 0.013s
I20260709 13:14:39.567301  4434 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:39.551179  4767 leader_election.cc:290] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:39.552647  4237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a4b9478f394578ba05a6d2c9402d7c" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:39.576046  4278 leader_election.cc:343] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.579721  4836 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:39.581574  4818 raft_consensus.cc:2749] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.561414  4241 raft_consensus.cc:2468] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:39.597050  4435 raft_consensus.cc:359] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.597828  4435 raft_consensus.cc:385] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.598115  4435 raft_consensus.cc:740] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.598557  4434 tablet_bootstrap.cc:654] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.598790  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:39.599661  4384 raft_consensus.cc:2468] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:39.606022  4165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:39.606844  4165 raft_consensus.cc:2468] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:39.608947  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:39.606113  4234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:39.615303  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:39.615926  4132 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:39.616492  4443 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:39.616370  4381 raft_consensus.cc:2468] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:39.616843  4132 leader_election.cc:304] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:39.617702  4816 raft_consensus.cc:2804] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.618058  4816 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.618403  4816 raft_consensus.cc:3060] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.619568  4132 leader_election.cc:304] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:39.621188  4767 raft_consensus.cc:2804] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.621604  4767 raft_consensus.cc:493] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.621945  4767 raft_consensus.cc:3060] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.562542  4826 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.626704  4822 raft_consensus.cc:2804] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.627211  4822 raft_consensus.cc:493] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.627545  4822 raft_consensus.cc:3060] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.639745  4819 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:39.549577  4817 consensus_queue.cc:237] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:39.643653  4443 ts_tablet_manager.cc:1403] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.417s	user 0.010s	sys 0.009s
W20260709 13:14:39.651682  4129 leader_election.cc:343] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.659775  4831 raft_consensus.cc:493] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.660413  4831 raft_consensus.cc:515] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:39.657923  4437 raft_consensus.cc:359] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:39.662640  4437 raft_consensus.cc:385] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.663175  4437 raft_consensus.cc:740] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.672302  4437 consensus_queue.cc:260] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:39.683610  4831 leader_election.cc:290] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:39.703935  4437 ts_tablet_manager.cc:1434] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.165s	user 0.008s	sys 0.003s
I20260709 13:14:39.707827  4437 tablet_bootstrap.cc:492] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:39.733255  4240 raft_consensus.cc:2468] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:39.740279  4204 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
W20260709 13:14:39.748318  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 93334.4us
I20260709 13:14:39.749541  4443 raft_consensus.cc:359] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.750702  4443 raft_consensus.cc:385] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.716841  4752 consensus_queue.cc:1048] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:14:39.751034  4443 raft_consensus.cc:740] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.749914  4836 raft_consensus.cc:2804] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.761211  4836 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.761636  4836 raft_consensus.cc:3060] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.770181  4434 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:39.770747  4434 ts_tablet_manager.cc:1403] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.204s	user 0.010s	sys 0.038s
I20260709 13:14:39.774058  4435 consensus_queue.cc:260] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.776262  4437 tablet_bootstrap.cc:654] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.776283  4443 consensus_queue.cc:260] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.781157  4435 ts_tablet_manager.cc:1434] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.349s	user 0.010s	sys 0.000s
I20260709 13:14:39.790679  4434 raft_consensus.cc:359] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:39.791565  4434 raft_consensus.cc:385] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.791884  4434 raft_consensus.cc:740] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.792588  4434 consensus_queue.cc:260] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:39.799232  4826 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:39.800199  4443 ts_tablet_manager.cc:1434] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.156s	user 0.005s	sys 0.003s
I20260709 13:14:39.834120  4767 raft_consensus.cc:515] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.845319  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:39.846586  4281 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 56579.6us
I20260709 13:14:39.850718  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e3336557ec4724bcb643f2bb5728a6" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:39.846797  4383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:39.854725  4383 raft_consensus.cc:2468] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:39.855621  4826 raft_consensus.cc:493] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.860721  4826 raft_consensus.cc:515] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:39.863332  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e3336557ec4724bcb643f2bb5728a6" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:39.863692  4826 leader_election.cc:290] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
W20260709 13:14:39.871230  4278 consensus_peers.cc:597] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:39.875543  4352 leader_election.cc:343] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:39.897794  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:39.904089  4443 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:39.905658  4352 leader_election.cc:343] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:39.906000  4129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 109630us
W20260709 13:14:39.907280  4204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 157032us
I20260709 13:14:39.908200  4352 leader_election.cc:304] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:39.915818  4434 ts_tablet_manager.cc:1434] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.000s
I20260709 13:14:39.919697  4434 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:39.832487  4822 raft_consensus.cc:515] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:39.915122  4826 raft_consensus.cc:2749] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.915289  4767 leader_election.cc:290] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
W20260709 13:14:39.924721  4207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 167876us
I20260709 13:14:39.936745  4845 consensus_queue.cc:1048] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:14:39.937391  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ced5da688734c378b6fa628fca1e639" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:39.941852  4443 tablet_bootstrap.cc:654] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.943753  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:39.962828  4382 raft_consensus.cc:3060] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.962446  4548 consensus_queue.cc:1048] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.972168  4435 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
W20260709 13:14:40.013888  4132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 65544.2us
I20260709 13:14:40.020205  4822 leader_election.cc:290] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:40.022049  4161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:40.022060  4382 raft_consensus.cc:2468] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:40.023528  4817 consensus_queue.cc:1048] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:40.022641  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ced5da688734c378b6fa628fca1e639" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:39.992467  4816 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.055424  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:40.056272  4314 raft_consensus.cc:3060] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:40.031124  4352 leader_election.cc:343] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:40.062776  4204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 133965us
I20260709 13:14:40.061092  4132 leader_election.cc:304] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
W20260709 13:14:40.073617  4129 leader_election.cc:343] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.075632  4129 leader_election.cc:304] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.085107  4849 raft_consensus.cc:493] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.085709  4849 raft_consensus.cc:515] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.067500  4836 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.087774  4849 leader_election.cc:290] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:40.068588  4767 raft_consensus.cc:2804] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:40.089758  4352 leader_election.cc:343] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.094015  4836 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:40.094535  4860 raft_consensus.cc:2749] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.098515  4435 tablet_bootstrap.cc:654] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.079689  4161 raft_consensus.cc:2393] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3b8bb2dfba041dea91b3e6775c34505 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
I20260709 13:14:40.105980  4314 raft_consensus.cc:2468] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:40.107342  4434 tablet_bootstrap.cc:654] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.101698  4352 leader_election.cc:304] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.119336  4129 leader_election.cc:304] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
W20260709 13:14:40.133679  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 43946.9us
I20260709 13:14:40.117897  4767 raft_consensus.cc:697] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:40.140169  4236 raft_consensus.cc:2393] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3b8bb2dfba041dea91b3e6775c34505 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:40.138361  4603 raft_consensus.cc:2804] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.175638  4437 tablet_bootstrap.cc:492] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:40.176466  4437 ts_tablet_manager.cc:1403] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.471s	user 0.040s	sys 0.053s
I20260709 13:14:40.177649  4603 raft_consensus.cc:697] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:40.178628  4603 consensus_queue.cc:237] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.139542  4579 raft_consensus.cc:2749] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.181732  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:40.182408  4386 raft_consensus.cc:3060] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.156533  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:40.180908  4437 raft_consensus.cc:359] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.191198  4437 raft_consensus.cc:385] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.191578  4437 raft_consensus.cc:740] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.191558  4386 raft_consensus.cc:2468] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:40.193562  4443 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:40.194028  4443 ts_tablet_manager.cc:1403] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.290s	user 0.027s	sys 0.032s
W20260709 13:14:40.192847  4207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 123427us
I20260709 13:14:40.195115  4848 raft_consensus.cc:493] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.195806  4384 raft_consensus.cc:3060] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.246029  4860 raft_consensus.cc:493] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.291916  4443 raft_consensus.cc:359] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.292819  4443 raft_consensus.cc:385] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.295717  4443 raft_consensus.cc:740] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.297390  4443 consensus_queue.cc:260] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.210150  4767 consensus_queue.cc:237] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.254618  4848 raft_consensus.cc:515] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.308813  4843 raft_consensus.cc:493] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ecb7bdee23254ebbb5be4faa5795e657)
I20260709 13:14:40.317732  4843 raft_consensus.cc:515] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.319219  4848 leader_election.cc:290] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:40.284924  4860 raft_consensus.cc:515] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.340942  4443 ts_tablet_manager.cc:1434] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.147s	user 0.007s	sys 0.001s
I20260709 13:14:40.361863  4435 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:40.362424  4435 ts_tablet_manager.cc:1403] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.391s	user 0.013s	sys 0.008s
I20260709 13:14:40.358664  4237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:40.365986  4816 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:40.371754  4860 leader_election.cc:290] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:40.376289  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:40.377055  4383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:40.377957  4383 raft_consensus.cc:2393] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
I20260709 13:14:40.388087  4237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:40.390113  4443 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:40.391347  4435 raft_consensus.cc:359] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.391954  4435 raft_consensus.cc:385] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.392179  4435 raft_consensus.cc:740] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.392786  4435 consensus_queue.cc:260] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.394583  4435 ts_tablet_manager.cc:1434] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
W20260709 13:14:40.394752  4129 leader_election.cc:343] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.395630  4435 tablet_bootstrap.cc:492] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:40.395854  4443 tablet_bootstrap.cc:654] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.399765  4064 catalog_manager.cc:5697] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:40.400946  4129 leader_election.cc:343] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.403578  4435 tablet_bootstrap.cc:654] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.404081  4384 raft_consensus.cc:2468] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:40.408489  4437 consensus_queue.cc:260] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.428432  4437 ts_tablet_manager.cc:1434] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.252s	user 0.016s	sys 0.003s
I20260709 13:14:40.412024  4843 leader_election.cc:290] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:40.430768  4437 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:40.438529  4437 tablet_bootstrap.cc:654] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.441346  4818 raft_consensus.cc:493] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.442049  4818 raft_consensus.cc:515] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.442665  4387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:40.443404  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d79b38c9325e4a73a58f685c1a82a83c" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:40.443737  4387 raft_consensus.cc:2468] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:40.444121  4386 raft_consensus.cc:2468] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:40.444437  4818 leader_election.cc:290] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:40.445672  4859 raft_consensus.cc:493] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.446237  4859 raft_consensus.cc:515] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.451116  4435 tablet_bootstrap.cc:492] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:40.451715  4435 ts_tablet_manager.cc:1403] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.008s
I20260709 13:14:40.412220  4434 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:40.412361  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:40.455351  4434 ts_tablet_manager.cc:1403] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.536s	user 0.015s	sys 0.015s
I20260709 13:14:40.456894  4435 raft_consensus.cc:359] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.459051  4435 raft_consensus.cc:385] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.459491  4435 raft_consensus.cc:740] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.458683  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:40.460737  4435 consensus_queue.cc:260] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.456200  4352 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.465258  4826 raft_consensus.cc:2749] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.466387  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d79b38c9325e4a73a58f685c1a82a83c" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:40.467468  4435 ts_tablet_manager.cc:1434] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:14:40.468727  4435 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
W20260709 13:14:40.475303  4129 leader_election.cc:343] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.414237  4064 catalog_manager.cc:5697] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.478946  4435 tablet_bootstrap.cc:654] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.479507  4437 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:40.480109  4437 ts_tablet_manager.cc:1403] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.002s
I20260709 13:14:40.480171  4859 leader_election.cc:290] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:40.483680  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f31b1c5c2a1430fbb22163bc29c247f" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:40.485172  4281 leader_election.cc:304] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:40.486173  4437 raft_consensus.cc:359] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.487114  4437 raft_consensus.cc:385] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.487531  4437 raft_consensus.cc:740] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.486603  4838 raft_consensus.cc:2804] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.488322  4132 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.488502  4838 raft_consensus.cc:493] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.489244  4818 raft_consensus.cc:2804] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.489642  4838 raft_consensus.cc:3060] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.489998  4818 raft_consensus.cc:697] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:40.491044  4818 consensus_queue.cc:237] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.492056  4434 raft_consensus.cc:359] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.492753  4434 raft_consensus.cc:385] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:40.493106  4278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 71609.1us
I20260709 13:14:40.494370  4435 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:40.493044  4437 consensus_queue.cc:260] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.494485  4434 raft_consensus.cc:740] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.495357  4435 ts_tablet_manager.cc:1403] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.004s
I20260709 13:14:40.497161  4437 ts_tablet_manager.cc:1434] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:14:40.498193  4434 consensus_queue.cc:260] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.499187  4435 raft_consensus.cc:359] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.499871  4435 raft_consensus.cc:385] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.500141  4435 raft_consensus.cc:740] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.500471  4434 ts_tablet_manager.cc:1434] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:14:40.500793  4435 consensus_queue.cc:260] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.502807  4435 ts_tablet_manager.cc:1434] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:40.503075  4437 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:40.503876  4435 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
I20260709 13:14:40.507166  4132 leader_election.cc:304] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.508021  4816 raft_consensus.cc:2804] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.508450  4816 raft_consensus.cc:493] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.508823  4816 raft_consensus.cc:3060] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.512626  4435 tablet_bootstrap.cc:654] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.515141  4838 raft_consensus.cc:515] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.517644  4838 leader_election.cc:290] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:40.520193  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d79b38c9325e4a73a58f685c1a82a83c" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:40.520758  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:40.521027  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:40.521138  4382 raft_consensus.cc:3060] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.520696  4816 raft_consensus.cc:515] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.524010  4434 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:40.524144  4816 leader_election.cc:290] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:40.527263  4437 tablet_bootstrap.cc:654] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.535893  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:40.542330  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:40.548554  4204 leader_election.cc:343] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.549552  4204 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:40.552040  4863 raft_consensus.cc:2749] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.554445  4388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:40.557183  4388 raft_consensus.cc:3060] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.559219  4435 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:40.559823  4435 ts_tablet_manager.cc:1403] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.001s
I20260709 13:14:40.560988  4848 consensus_queue.cc:1048] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:40.561483  4204 leader_election.cc:343] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.562605  4204 leader_election.cc:304] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:40.562777  4435 raft_consensus.cc:359] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.563421  4548 raft_consensus.cc:2749] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.563647  4435 raft_consensus.cc:385] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.564031  4435 raft_consensus.cc:740] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.565066  4435 consensus_queue.cc:260] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.566365  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:40.569079  4435 ts_tablet_manager.cc:1434] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:14:40.570369  4435 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505: Bootstrap starting.
W20260709 13:14:40.553788  4129 leader_election.cc:343] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.571147  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d79b38c9325e4a73a58f685c1a82a83c" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
W20260709 13:14:40.573720  4278 leader_election.cc:343] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.576201  4382 raft_consensus.cc:2468] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:40.570403  4434 tablet_bootstrap.cc:654] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.568709  4443 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:40.577709  4281 leader_election.cc:304] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:40.577513  4435 tablet_bootstrap.cc:654] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.582572  4437 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:40.583074  4437 ts_tablet_manager.cc:1403] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.017s
I20260709 13:14:40.579648  4443 ts_tablet_manager.cc:1403] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.190s	user 0.008s	sys 0.005s
I20260709 13:14:40.582849  4848 raft_consensus.cc:2804] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:40.583983  4278 leader_election.cc:343] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.584954  4848 raft_consensus.cc:697] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:40.585904  4848 consensus_queue.cc:237] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.586796  4443 raft_consensus.cc:359] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.587882  4443 raft_consensus.cc:385] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.588171  4443 raft_consensus.cc:740] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.590169  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:40.599447  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f31b1c5c2a1430fbb22163bc29c247f" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:40.588831  4443 consensus_queue.cc:260] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
W20260709 13:14:40.612367  4129 leader_election.cc:343] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.601397  4388 raft_consensus.cc:2468] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:40.620404  4443 ts_tablet_manager.cc:1434] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:14:40.621521  4443 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:40.623540  4132 leader_election.cc:304] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.612988  4129 leader_election.cc:304] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.624534  4816 raft_consensus.cc:2804] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.624846  4767 raft_consensus.cc:2749] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.625111  4816 raft_consensus.cc:697] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:40.626868  4816 consensus_queue.cc:237] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.613361  4437 raft_consensus.cc:359] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.629761  4437 raft_consensus.cc:385] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.630138  4437 raft_consensus.cc:740] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.631479  4434 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:40.632077  4434 ts_tablet_manager.cc:1403] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.009s
I20260709 13:14:40.643620  4699 consensus_queue.cc:1048] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:40.644786  4443 tablet_bootstrap.cc:654] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.647452  4437 consensus_queue.cc:260] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.647377  4434 raft_consensus.cc:359] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.639828  4278 leader_election.cc:304] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.650350  4434 raft_consensus.cc:385] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.651085  4434 raft_consensus.cc:740] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.652251  4434 consensus_queue.cc:260] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.656270  4437 ts_tablet_manager.cc:1434] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.002s
I20260709 13:14:40.659173  4437 tablet_bootstrap.cc:492] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:40.659168  4204 leader_election.cc:304] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:40.671728  4834 raft_consensus.cc:493] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.657739  4699 raft_consensus.cc:2749] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:40.673887  4863 raft_consensus.cc:2749] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.687979  4434 ts_tablet_manager.cc:1434] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.056s	user 0.013s	sys 0.001s
I20260709 13:14:40.690105  4434 tablet_bootstrap.cc:492] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:40.672336  4834 raft_consensus.cc:515] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.726233  4443 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:40.726859  4443 ts_tablet_manager.cc:1403] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.015s
I20260709 13:14:40.727644  4847 raft_consensus.cc:493] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.728042  4437 tablet_bootstrap.cc:654] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.728221  4847 raft_consensus.cc:515] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:40.732779  4847 leader_election.cc:290] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:40.734176  4834 leader_election.cc:290] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:40.734395  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab991adb234419a39cef0dd745b8fc" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:40.735975  4434 tablet_bootstrap.cc:654] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.736497  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab991adb234419a39cef0dd745b8fc" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:40.736693  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c9caf0b83f44a9bc3b6b2fd38789a6" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
W20260709 13:14:40.737286  4352 leader_election.cc:343] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.737740  4382 raft_consensus.cc:2468] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:40.729871  4443 raft_consensus.cc:359] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.738408  4443 raft_consensus.cc:385] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:40.738785  4352 leader_election.cc:343] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.739555  4443 raft_consensus.cc:740] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.740312  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c9caf0b83f44a9bc3b6b2fd38789a6" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:40.740427  4443 consensus_queue.cc:260] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.744011  4281 leader_election.cc:304] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:40.739727  4352 leader_election.cc:304] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:40.749255  4848 raft_consensus.cc:2804] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.749656  4848 raft_consensus.cc:493] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.749840  4847 raft_consensus.cc:2749] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.750015  4848 raft_consensus.cc:3060] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.751503  4237 raft_consensus.cc:3060] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.754330  4157 raft_consensus.cc:2468] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 0.
I20260709 13:14:40.756600  4435 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505: No bootstrap required, opened a new log
I20260709 13:14:40.757200  4435 ts_tablet_manager.cc:1403] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505: Time spent bootstrapping tablet: real 0.187s	user 0.021s	sys 0.021s
I20260709 13:14:40.756600  4443 ts_tablet_manager.cc:1434] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:14:40.758685  4443 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:40.766710  4848 raft_consensus.cc:515] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.768153  4767 raft_consensus.cc:493] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.768584  4818 consensus_queue.cc:1048] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:40.768671  4767 raft_consensus.cc:515] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.770922  4767 leader_election.cc:290] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:40.771409  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c9caf0b83f44a9bc3b6b2fd38789a6" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:40.772171  4157 raft_consensus.cc:3060] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.775225  4848 leader_election.cc:290] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:40.779376  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
W20260709 13:14:40.781044  4129 leader_election.cc:343] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.762400  4816 consensus_queue.cc:1048] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:14:40.784286  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c9caf0b83f44a9bc3b6b2fd38789a6" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:40.785113  4382 raft_consensus.cc:3060] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.787088  4443 tablet_bootstrap.cc:654] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.787039  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:40.787866  4240 raft_consensus.cc:2468] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:40.789139  4129 leader_election.cc:304] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:40.790326  4816 raft_consensus.cc:2804] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.790957  4816 raft_consensus.cc:493] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.791512  4816 raft_consensus.cc:3060] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.792969  4435 raft_consensus.cc:359] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.797935  4435 raft_consensus.cc:385] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.798259  4435 raft_consensus.cc:740] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.798935  4435 consensus_queue.cc:260] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.799247  4826 raft_consensus.cc:493] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.799971  4826 raft_consensus.cc:515] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.801425  4434 tablet_bootstrap.cc:492] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:40.802016  4434 ts_tablet_manager.cc:1403] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.008s
I20260709 13:14:40.802292  4826 leader_election.cc:290] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:40.806960  4816 raft_consensus.cc:515] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:40.808096  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6d778f3b244e66937e6d76ff2e1062" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:40.811002  4816 leader_election.cc:290] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:40.813119  4061 catalog_manager.cc:5697] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:40.811179  4434 raft_consensus.cc:359] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.821755  4434 raft_consensus.cc:385] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.822052  4434 raft_consensus.cc:740] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.822736  4434 consensus_queue.cc:260] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.824347  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:40.825439  4236 raft_consensus.cc:3060] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.827481  4434 ts_tablet_manager.cc:1434] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:14:40.830765  4437 tablet_bootstrap.cc:492] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:40.831336  4437 ts_tablet_manager.cc:1403] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.172s	user 0.011s	sys 0.006s
I20260709 13:14:40.816771  4382 raft_consensus.cc:2468] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:40.816632  4061 catalog_manager.cc:5697] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.837028  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
W20260709 13:14:40.838538  4129 leader_election.cc:343] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.841421  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6d778f3b244e66937e6d76ff2e1062" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:40.842272  4310 raft_consensus.cc:2468] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:40.833667  4281 leader_election.cc:304] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:40.844316  4834 raft_consensus.cc:2804] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.845299  4834 raft_consensus.cc:697] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:40.849674  4434 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:40.852255  4834 consensus_queue.cc:237] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:40.857654  4434 tablet_bootstrap.cc:654] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.858742  4435 ts_tablet_manager.cc:1434] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.000s
I20260709 13:14:40.863014  4816 consensus_queue.cc:1048] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:40.868196  4157 raft_consensus.cc:2468] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:40.860179  4352 leader_election.cc:304] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:40.860507  4437 raft_consensus.cc:359] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:40.884982  4237 raft_consensus.cc:3060] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.885207  4437 raft_consensus.cc:385] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.908367  4767 consensus_queue.cc:1048] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:40.930605  4437 raft_consensus.cc:740] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.872460  4579 raft_consensus.cc:2804] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.936069  4437 consensus_queue.cc:260] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
W20260709 13:14:40.873288  4352 leader_election.cc:343] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:40.941884  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 68651.7us
I20260709 13:14:40.937934  4579 raft_consensus.cc:493] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.949129  4061 catalog_manager.cc:5697] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:40.936959  4236 raft_consensus.cc:2468] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:40.960947  4437 ts_tablet_manager.cc:1434] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.003s
I20260709 13:14:40.947851  4848 raft_consensus.cc:493] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.955848  4579 raft_consensus.cc:3060] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:40.988013  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:40.982486  4434 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:40.992868  4434 ts_tablet_manager.cc:1403] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.143s	user 0.024s	sys 0.026s
I20260709 13:14:40.993580  4061 catalog_manager.cc:5697] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:40.997123  4443 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:40.997737  4443 ts_tablet_manager.cc:1403] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.239s	user 0.033s	sys 0.033s
I20260709 13:14:41.012212  4129 leader_election.cc:304] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:41.012737  4437 tablet_bootstrap.cc:492] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:40.984678  4848 raft_consensus.cc:515] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.023964  4579 raft_consensus.cc:515] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:41.016171  4767 raft_consensus.cc:2804] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.038518  4848 leader_election.cc:290] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:41.041798  4434 raft_consensus.cc:359] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.042702  4434 raft_consensus.cc:385] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.043004  4434 raft_consensus.cc:740] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.043737  4434 consensus_queue.cc:260] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.046020  4437 tablet_bootstrap.cc:654] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.046212  4434 ts_tablet_manager.cc:1434] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:14:41.047307  4434 tablet_bootstrap.cc:492] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:41.049497  4848 consensus_queue.cc:1048] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.055392  4434 tablet_bootstrap.cc:654] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.060536  4579 leader_election.cc:290] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:41.061038  4437 tablet_bootstrap.cc:492] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:41.061705  4437 ts_tablet_manager.cc:1403] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.006s
I20260709 13:14:41.117231  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6d778f3b244e66937e6d76ff2e1062" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:41.118199  4237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:41.117331  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6d778f3b244e66937e6d76ff2e1062" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:41.134166  4241 raft_consensus.cc:3060] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.132858  4579 raft_consensus.cc:493] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.149718  4579 raft_consensus.cc:515] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:41.130411  4311 raft_consensus.cc:3060] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.126499  4437 raft_consensus.cc:359] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:41.162536  4822 consensus_queue.cc:1048] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.132454  4548 raft_consensus.cc:493] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.165846  4548 raft_consensus.cc:515] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.155719  4437 raft_consensus.cc:385] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.175781  4437 raft_consensus.cc:740] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
W20260709 13:14:41.189332  4278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 54450.4us
I20260709 13:14:41.195760  4443 raft_consensus.cc:359] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:41.196854  4443 raft_consensus.cc:385] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.197199  4443 raft_consensus.cc:740] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.198140  4443 consensus_queue.cc:260] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:41.203102  4443 ts_tablet_manager.cc:1434] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.205s	user 0.008s	sys 0.002s
I20260709 13:14:41.224478  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf28675179d3498593c326d198268cc9" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:41.224220  4548 leader_election.cc:290] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:41.237452  4579 leader_election.cc:290] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:41.259764  4437 consensus_queue.cc:260] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:41.269695  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf28675179d3498593c326d198268cc9" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
W20260709 13:14:41.272035  4278 leader_election.cc:343] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.283501  4752 raft_consensus.cc:493] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.272349  4163 raft_consensus.cc:3060] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.284421  4752 raft_consensus.cc:515] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.286039  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:41.306735  4437 ts_tablet_manager.cc:1434] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.245s	user 0.010s	sys 0.003s
I20260709 13:14:41.262396  4767 raft_consensus.cc:697] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
W20260709 13:14:41.318822  4207 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 47207.4us
W20260709 13:14:41.318858  4352 leader_election.cc:343] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.307304  4752 leader_election.cc:290] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:41.334616  4767 consensus_queue.cc:237] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.340356  4443 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:41.349041  4437 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
W20260709 13:14:41.361316  4352 leader_election.cc:343] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.361068  4910 consensus_queue.cc:1048] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:14:41.361970  4352 leader_election.cc:304] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:41.363032  4826 raft_consensus.cc:2749] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.365842  4064 catalog_manager.cc:5697] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.388230  4311 raft_consensus.cc:2468] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:41.408843  4237 raft_consensus.cc:3060] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.421386  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:41.424552  4386 raft_consensus.cc:2393] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
I20260709 13:14:41.420631  4064 catalog_manager.cc:5697] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.430527  4434 tablet_bootstrap.cc:492] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:41.431484  4434 ts_tablet_manager.cc:1403] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.384s	user 0.016s	sys 0.007s
I20260709 13:14:41.416910  4241 raft_consensus.cc:2468] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:41.448506  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:41.449704  4241 raft_consensus.cc:2393] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44912ba11bc04ab383e985aa41ec5b38 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
I20260709 13:14:41.461813  4352 leader_election.cc:304] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:41.462634  4443 tablet_bootstrap.cc:654] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.464048  4852 raft_consensus.cc:2804] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.464745  4852 raft_consensus.cc:697] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:41.466048  4852 consensus_queue.cc:237] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
W20260709 13:14:41.469977  4129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 48856.6us
I20260709 13:14:41.489681  4061 catalog_manager.cc:5697] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.494026  4434 raft_consensus.cc:359] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:41.495111  4434 raft_consensus.cc:385] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.457870  4437 tablet_bootstrap.cc:654] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.495441  4434 raft_consensus.cc:740] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
W20260709 13:14:41.492815  4132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 92681.1us
W20260709 13:14:41.496266  4278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 46935.4us
I20260709 13:14:41.509647  4822 consensus_queue.cc:1048] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:41.510702  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:41.522105  4434 consensus_queue.cc:260] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:41.524010  4434 ts_tablet_manager.cc:1434] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.000s
I20260709 13:14:41.537418  4443 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:41.538340  4443 ts_tablet_manager.cc:1403] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.198s	user 0.015s	sys 0.009s
I20260709 13:14:41.540050  4437 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:41.540728  4437 ts_tablet_manager.cc:1403] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.192s	user 0.014s	sys 0.000s
I20260709 13:14:41.541450  4921 consensus_queue.cc:1048] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.542877  4443 raft_consensus.cc:359] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.544250  4443 raft_consensus.cc:385] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.544755  4443 raft_consensus.cc:740] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.545853  4443 consensus_queue.cc:260] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.548116  4443 ts_tablet_manager.cc:1434] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:14:41.549784  4443 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:41.555992  4204 leader_election.cc:304] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:41.557881  4434 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:41.557736  4848 consensus_queue.cc:1048] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.559321  4443 tablet_bootstrap.cc:654] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.576763  4863 raft_consensus.cc:2749] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.577550  4443 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:41.578161  4443 ts_tablet_manager.cc:1403] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 13:14:41.581213  4443 raft_consensus.cc:359] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:41.582127  4443 raft_consensus.cc:385] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.582479  4443 raft_consensus.cc:740] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.583197  4443 consensus_queue.cc:260] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:41.584762  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:41.585896  4443 ts_tablet_manager.cc:1434] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:14:41.597424  4278 leader_election.cc:343] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.598026  4278 leader_election.cc:304] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:41.603823  4443 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:41.604620  4437 raft_consensus.cc:359] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.605428  4437 raft_consensus.cc:385] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.605692  4437 raft_consensus.cc:740] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.611294  4443 tablet_bootstrap.cc:654] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.632654  4443 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:41.633278  4443 ts_tablet_manager.cc:1403] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.006s
I20260709 13:14:41.633559  4752 raft_consensus.cc:2749] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.636610  4443 raft_consensus.cc:359] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.638288  4443 raft_consensus.cc:385] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.638571  4443 raft_consensus.cc:740] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.635680  4437 consensus_queue.cc:260] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.640488  4848 consensus_queue.cc:1048] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.646396  4443 consensus_queue.cc:260] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.647039  4859 raft_consensus.cc:493] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.647708  4859 raft_consensus.cc:515] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.649078  4443 ts_tablet_manager.cc:1434] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:14:41.650161  4443 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:41.650162  4859 leader_election.cc:290] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:41.657858  4434 tablet_bootstrap.cc:654] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.662408  4437 ts_tablet_manager.cc:1434] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.002s
I20260709 13:14:41.663352  4278 leader_election.cc:304] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:41.663676  4437 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:41.668020  4443 tablet_bootstrap.cc:654] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.672089  4161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:41.672964  4161 raft_consensus.cc:2468] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:41.677415  4204 leader_election.cc:304] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:41.678659  4863 raft_consensus.cc:2804] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:41.679122  4863 raft_consensus.cc:493] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.679486  4863 raft_consensus.cc:3060] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.680099  4443 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: No bootstrap required, opened a new log
I20260709 13:14:41.680694  4443 ts_tablet_manager.cc:1403] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.003s
I20260709 13:14:41.681968  4064 catalog_manager.cc:5697] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.683032  4817 raft_consensus.cc:3060] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.683800  4443 raft_consensus.cc:359] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.684571  4443 raft_consensus.cc:385] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.684880  4443 raft_consensus.cc:740] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.685774  4443 consensus_queue.cc:260] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.688470  4443 ts_tablet_manager.cc:1434] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:41.689399  4863 raft_consensus.cc:515] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.691845  4863 leader_election.cc:290] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:41.695586  4437 tablet_bootstrap.cc:654] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.701678  4843 consensus_queue.cc:1048] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.693430  4817 raft_consensus.cc:2749] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.711535  4161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:41.712414  4161 raft_consensus.cc:3060] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.719362  4434 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:41.719950  4434 ts_tablet_manager.cc:1403] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.001s
I20260709 13:14:41.722690  4434 raft_consensus.cc:359] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.723475  4434 raft_consensus.cc:385] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.730270  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:41.730854  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:41.734362  4437 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:41.734937  4437 ts_tablet_manager.cc:1403] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.003s
I20260709 13:14:41.740231  4437 raft_consensus.cc:359] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.730336  4434 raft_consensus.cc:740] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.743173  4863 raft_consensus.cc:493] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.743820  4863 raft_consensus.cc:515] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:41.743016  4434 consensus_queue.cc:260] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.746050  4310 raft_consensus.cc:2468] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:41.746994  4863 leader_election.cc:290] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:41.753616  4434 ts_tablet_manager.cc:1434] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.002s
I20260709 13:14:41.740962  4437 raft_consensus.cc:385] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.758967  4437 raft_consensus.cc:740] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.759972  4434 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38: Bootstrap starting.
I20260709 13:14:41.759763  4437 consensus_queue.cc:260] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.761528  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e3336557ec4724bcb643f2bb5728a6" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:41.762264  4382 raft_consensus.cc:2468] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:41.757088  4161 raft_consensus.cc:2468] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:41.765789  4437 ts_tablet_manager.cc:1434] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:14:41.772660  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e3336557ec4724bcb643f2bb5728a6" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:41.773394  4309 raft_consensus.cc:2468] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:41.772680  4204 leader_election.cc:304] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:14:41.775023  4917 raft_consensus.cc:2804] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.775576  4917 raft_consensus.cc:697] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:41.772073  4437 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:41.776467  4917 consensus_queue.cc:237] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:41.784900  4204 leader_election.cc:304] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:41.788331  4863 raft_consensus.cc:2804] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:41.788770  4863 raft_consensus.cc:493] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.789143  4863 raft_consensus.cc:3060] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.802670  4863 raft_consensus.cc:515] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:41.809494  4863 leader_election.cc:290] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:41.815724  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e3336557ec4724bcb643f2bb5728a6" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:41.816468  4434 tablet_bootstrap.cc:654] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.816516  4384 raft_consensus.cc:3060] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.820714  4437 tablet_bootstrap.cc:654] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.822861  4434 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38: No bootstrap required, opened a new log
I20260709 13:14:41.823513  4434 ts_tablet_manager.cc:1403] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.002s
I20260709 13:14:41.829663  4384 raft_consensus.cc:2468] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:41.830652  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e3336557ec4724bcb643f2bb5728a6" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:41.831352  4309 raft_consensus.cc:3060] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.833303  4434 raft_consensus.cc:359] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:41.834467  4434 raft_consensus.cc:385] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.833591  4437 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:41.843838  4437 ts_tablet_manager.cc:1403] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.000s
I20260709 13:14:41.844146  4434 raft_consensus.cc:740] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.845726  4434 consensus_queue.cc:260] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:41.846961  4921 consensus_queue.cc:1048] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:41.848773  4437 raft_consensus.cc:359] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.849849  4437 raft_consensus.cc:385] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.850219  4437 raft_consensus.cc:740] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.851166  4434 ts_tablet_manager.cc:1434] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:14:41.851349  4437 consensus_queue.cc:260] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.853878  4437 ts_tablet_manager.cc:1434] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:41.855087  4437 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657: Bootstrap starting.
I20260709 13:14:41.865415  4207 leader_election.cc:304] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:41.866586  4859 raft_consensus.cc:2804] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.867122  4859 raft_consensus.cc:697] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:41.867970  4859 consensus_queue.cc:237] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:41.868801  4309 raft_consensus.cc:2468] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:41.871678  4064 catalog_manager.cc:5697] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.875015  4852 raft_consensus.cc:493] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.875763  4852 raft_consensus.cc:515] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.883797  4437 tablet_bootstrap.cc:654] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.884855  4852 leader_election.cc:290] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:41.886598  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ced5da688734c378b6fa628fca1e639" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:41.890558  4241 raft_consensus.cc:2468] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:41.887076  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ced5da688734c378b6fa628fca1e639" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:41.891872  4157 raft_consensus.cc:2468] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 0.
I20260709 13:14:41.902069  4818 consensus_queue.cc:1048] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.903015  4352 leader_election.cc:304] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:41.904071  4852 raft_consensus.cc:2804] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:41.904505  4852 raft_consensus.cc:493] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.904881  4852 raft_consensus.cc:3060] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.912218  4437 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657: No bootstrap required, opened a new log
I20260709 13:14:41.912932  4437 ts_tablet_manager.cc:1403] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.003s
I20260709 13:14:41.914547  4852 raft_consensus.cc:515] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.916317  4437 raft_consensus.cc:359] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.917199  4437 raft_consensus.cc:385] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.917560  4437 raft_consensus.cc:740] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.918370  4437 consensus_queue.cc:260] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.919929  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ced5da688734c378b6fa628fca1e639" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:41.920680  4241 raft_consensus.cc:3060] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.921149  4437 ts_tablet_manager.cc:1434] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:41.922103  4852 leader_election.cc:290] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:41.923276  4162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ced5da688734c378b6fa628fca1e639" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:41.924088  4162 raft_consensus.cc:3060] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.928808  4064 catalog_manager.cc:5697] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.933099  4162 raft_consensus.cc:2468] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:41.934909  4352 leader_election.cc:304] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:41.938997  4852 raft_consensus.cc:2804] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.939628  4852 raft_consensus.cc:697] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:41.939688  4241 raft_consensus.cc:2468] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:41.940763  4852 consensus_queue.cc:237] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:41.956482  4064 catalog_manager.cc:5697] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 1 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.982527  4852 consensus_queue.cc:1048] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:41.995529  4852 consensus_queue.cc:1048] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.054128  4918 raft_consensus.cc:493] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.054737  4918 raft_consensus.cc:515] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:42.057061  4918 leader_election.cc:290] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:42.058876  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf28675179d3498593c326d198268cc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:42.060662  4384 raft_consensus.cc:2468] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:42.064015  4132 leader_election.cc:304] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:42.062374  4918 raft_consensus.cc:493] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.065088  4918 raft_consensus.cc:515] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:42.065894  4921 raft_consensus.cc:2804] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.066785  4921 raft_consensus.cc:493] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.067121  4921 raft_consensus.cc:3060] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.103554  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf28675179d3498593c326d198268cc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:42.104368  4309 raft_consensus.cc:2468] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:42.105512  4918 leader_election.cc:290] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:42.122757  4921 raft_consensus.cc:515] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:42.125531  4921 leader_election.cc:290] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:42.137952  4863 raft_consensus.cc:493] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.138629  4863 raft_consensus.cc:515] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:42.142931  4863 leader_election.cc:290] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:42.305809  4946 raft_consensus.cc:493] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.306661  4946 raft_consensus.cc:515] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:42.309924  4946 leader_election.cc:290] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:42.367944  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:42.368728  4235 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:42.369994  4129 leader_election.cc:304] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:42.370740  4946 raft_consensus.cc:2804] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.372088  4946 raft_consensus.cc:493] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.372622  4946 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.383850  4946 raft_consensus.cc:515] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:42.385846  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:42.387394  4163 raft_consensus.cc:2393] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 1: Already voted for candidate 5579adc264d4484692d94b04f0b4f974 in this term.
I20260709 13:14:42.389834  4946 leader_election.cc:290] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:42.392560  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:42.393365  4235 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.402112  4235 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:42.403188  4129 leader_election.cc:304] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:42.405277  4946 raft_consensus.cc:2804] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.406454  4850 consensus_queue.cc:1048] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.407151  4946 raft_consensus.cc:697] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:42.417383  4863 raft_consensus.cc:493] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.425467  4863 raft_consensus.cc:515] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:42.428231  4863 leader_election.cc:290] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:42.408169  4946 consensus_queue.cc:237] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:42.431389  4166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab991adb234419a39cef0dd745b8fc" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974" is_pre_election: true
I20260709 13:14:42.432185  4166 raft_consensus.cc:2468] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:42.433216  4204 leader_election.cc:304] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:42.434305  4949 raft_consensus.cc:2804] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.434736  4949 raft_consensus.cc:493] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.435082  4949 raft_consensus.cc:3060] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.444533  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab991adb234419a39cef0dd745b8fc" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:42.445396  4384 raft_consensus.cc:2468] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:42.453536  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab991adb234419a39cef0dd745b8fc" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:42.454303  4389 raft_consensus.cc:2468] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
I20260709 13:14:42.482039  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab991adb234419a39cef0dd745b8fc" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:42.487313  4112 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:42.488179  4064 catalog_manager.cc:5697] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.489051  4852 consensus_queue.cc:1048] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.481104  4949 raft_consensus.cc:515] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:42.491840  4241 raft_consensus.cc:2393] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5579adc264d4484692d94b04f0b4f974 in current term 1: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:42.492920  4949 leader_election.cc:290] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:42.516057  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf28675179d3498593c326d198268cc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:42.516813  4384 raft_consensus.cc:3060] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.548810  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab991adb234419a39cef0dd745b8fc" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5579adc264d4484692d94b04f0b4f974"
I20260709 13:14:42.549852  4163 raft_consensus.cc:3060] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.564782  4311 raft_consensus.cc:3060] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.565155  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:42.566105  4309 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 0.
W20260709 13:14:42.569046  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 80633.8us
I20260709 13:14:42.578413  4163 raft_consensus.cc:2468] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:42.580825  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:42.581686  4313 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 0.
I20260709 13:14:42.581664  4311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf28675179d3498593c326d198268cc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:42.583263  4311 raft_consensus.cc:3060] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.584055  4204 leader_election.cc:304] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:42.584962  4548 raft_consensus.cc:2804] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.585482  4548 raft_consensus.cc:697] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:42.586782  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:42.587419  4314 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.595881  4311 raft_consensus.cc:2468] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:42.596804  4204 leader_election.cc:304] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:42.597829  4863 raft_consensus.cc:2764] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:14:42.599602  4850 consensus_queue.cc:1048] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.604496  4850 consensus_queue.cc:1048] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.595845  4314 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:42.608709  4384 raft_consensus.cc:2468] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 1.
I20260709 13:14:42.609534  4132 leader_election.cc:304] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:42.586848  4548 consensus_queue.cc:237] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:42.610355  4818 raft_consensus.cc:2764] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:14:42.617741  4948 consensus_queue.cc:1048] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.641775  4952 consensus_queue.cc:1048] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.643446  4064 catalog_manager.cc:5697] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:42.645709  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53ab991adb234419a39cef0dd745b8fc" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:42.646715  4384 raft_consensus.cc:3060] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.658983  4384 raft_consensus.cc:2468] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:42.666977  4132 leader_election.cc:304] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
W20260709 13:14:42.669775  4281 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 57790.6us
I20260709 13:14:42.686026  4918 raft_consensus.cc:2804] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.687042  4918 raft_consensus.cc:697] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:42.688308  4918 consensus_queue.cc:237] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:42.724047  4061 catalog_manager.cc:5697] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:43.007615  4818 consensus_queue.cc:1048] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.027390  4818 consensus_queue.cc:1048] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.099715  4850 consensus_queue.cc:1048] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:43.117759  4949 consensus_queue.cc:1048] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.192817 27432 tablet_server.cc:179] TabletServer@127.26.202.1:0 shutting down...
W20260709 13:14:43.205914  4278 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 407 similar messages]
W20260709 13:14:43.210465  4278 consensus_peers.cc:597] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.242960  4818 consensus_queue.cc:1048] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:43.243408 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:43.245214 27432 tablet_replica.cc:333] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.246395 27432 raft_consensus.cc:2243] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.247463 27432 raft_consensus.cc:2272] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.250646 27432 tablet_replica.cc:333] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.251557 27432 raft_consensus.cc:2243] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.253044 27432 raft_consensus.cc:2272] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.256711 27432 tablet_replica.cc:333] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.257699 27432 raft_consensus.cc:2243] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.258262 27432 raft_consensus.cc:2272] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.259123  4278 consensus_peers.cc:597] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.261607 27432 tablet_replica.cc:333] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.262606 27432 raft_consensus.cc:2243] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.263586 27432 raft_consensus.cc:2272] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.263957  4095 debug-util.cc:398] Leaking SignalData structure 0x7b0800096420 after lost signal to thread 27435
W20260709 13:14:43.264577  4278 consensus_peers.cc:597] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.265206  4095 debug-util.cc:398] Leaking SignalData structure 0x7b080028baa0 after lost signal to thread 4098
I20260709 13:14:43.266672 27432 tablet_replica.cc:333] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
W20260709 13:14:43.266804  4095 debug-util.cc:398] Leaking SignalData structure 0x7b08002905e0 after lost signal to thread 4190
I20260709 13:14:43.267594 27432 raft_consensus.cc:2243] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:43.268029  4095 debug-util.cc:398] Leaking SignalData structure 0x7b08002247a0 after lost signal to thread 4265
I20260709 13:14:43.268229 27432 raft_consensus.cc:2272] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.271521  4095 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9680 after lost signal to thread 4339
I20260709 13:14:43.272321 27432 tablet_replica.cc:333] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
W20260709 13:14:43.272861  4095 debug-util.cc:398] Leaking SignalData structure 0x7b080031b9a0 after lost signal to thread 4413
I20260709 13:14:43.273524 27432 raft_consensus.cc:2243] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.274163 27432 raft_consensus.cc:2272] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.278079 27432 tablet_replica.cc:333] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.279060 27432 raft_consensus.cc:2243] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.280128 27432 raft_consensus.cc:2272] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.283473 27432 tablet_replica.cc:333] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.284456 27432 raft_consensus.cc:2243] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.285729 27432 raft_consensus.cc:2272] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.289403 27432 tablet_replica.cc:333] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.290479 27432 raft_consensus.cc:2243] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.291772 27432 raft_consensus.cc:2272] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.295177 27432 tablet_replica.cc:333] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.296303 27432 raft_consensus.cc:2243] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.297317 27432 raft_consensus.cc:2272] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.300994 27432 tablet_replica.cc:333] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.302302 27432 raft_consensus.cc:2243] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.302983 27432 raft_consensus.cc:2272] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.306056  4278 consensus_peers.cc:597] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.306453 27432 tablet_replica.cc:333] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
W20260709 13:14:43.307439  4204 consensus_peers.cc:597] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.307569 27432 raft_consensus.cc:2243] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.308991 27432 raft_consensus.cc:2272] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.312652 27432 tablet_replica.cc:333] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
W20260709 13:14:43.313547  4278 consensus_peers.cc:597] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.313751 27432 raft_consensus.cc:2243] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.314713 27432 raft_consensus.cc:2272] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.318336 27432 tablet_replica.cc:333] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.319319 27432 raft_consensus.cc:2243] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.319976 27432 raft_consensus.cc:2272] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.320267  4204 consensus_peers.cc:597] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.323565 27432 tablet_replica.cc:333] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.324713 27432 raft_consensus.cc:2243] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.326126 27432 raft_consensus.cc:2272] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.329754 27432 tablet_replica.cc:333] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.330709 27432 raft_consensus.cc:2243] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.331351 27432 raft_consensus.cc:2272] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.334827 27432 tablet_replica.cc:333] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.335865 27432 raft_consensus.cc:2243] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.336499 27432 raft_consensus.cc:2272] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.339814 27432 tablet_replica.cc:333] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.340763 27432 raft_consensus.cc:2243] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.342110 27432 raft_consensus.cc:2272] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.345314 27432 tablet_replica.cc:333] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.346264 27432 raft_consensus.cc:2243] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.346859 27432 raft_consensus.cc:2272] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.349882  4204 consensus_peers.cc:597] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.349959 27432 tablet_replica.cc:333] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.351468 27432 raft_consensus.cc:2243] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.352159 27432 raft_consensus.cc:2272] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.356200 27432 tablet_replica.cc:333] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.357230 27432 raft_consensus.cc:2243] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.357797 27432 raft_consensus.cc:2272] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.361032 27432 tablet_replica.cc:333] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.362195 27432 raft_consensus.cc:2243] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.363680 27432 raft_consensus.cc:2272] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.371511 27432 tablet_replica.cc:333] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.372501 27432 raft_consensus.cc:2243] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.374480 27432 raft_consensus.cc:2272] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.378722 27432 tablet_replica.cc:333] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.379663 27432 raft_consensus.cc:2243] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.380360 27432 raft_consensus.cc:2272] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.385583 27432 tablet_replica.cc:333] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.386549 27432 raft_consensus.cc:2243] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.387218 27432 raft_consensus.cc:2272] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.396117  4278 consensus_peers.cc:597] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.407462  4204 consensus_peers.cc:597] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.409478  4204 consensus_peers.cc:597] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.409991  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:35785, user_credentials={real_user=slave}} blocked reactor thread for 80486.2us
W20260709 13:14:43.412881  4204 consensus_peers.cc:597] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.417737  4352 consensus_peers.cc:597] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.409950 27432 tablet_replica.cc:333] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.419891 27432 raft_consensus.cc:2243] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.420548 27432 raft_consensus.cc:2272] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.421483  4352 consensus_peers.cc:597] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.423866 27432 tablet_replica.cc:333] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.424953 27432 raft_consensus.cc:2243] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.425860 27432 raft_consensus.cc:2272] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.429458 27432 tablet_replica.cc:333] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.430480 27432 raft_consensus.cc:2243] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.431147 27432 raft_consensus.cc:2272] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.434667 27432 tablet_replica.cc:333] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.435607 27432 raft_consensus.cc:2243] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.436296 27432 raft_consensus.cc:2272] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.439778 27432 tablet_replica.cc:333] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.440706 27432 raft_consensus.cc:2243] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:43.440960  4278 consensus_peers.cc:597] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.441406 27432 raft_consensus.cc:2272] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.445626 27432 tablet_replica.cc:333] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.446641 27432 raft_consensus.cc:2243] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.447966 27432 raft_consensus.cc:2272] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.451267 27432 tablet_replica.cc:333] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.452196 27432 raft_consensus.cc:2243] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.452920 27432 raft_consensus.cc:2272] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.454380  4204 consensus_peers.cc:597] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.456316 27432 tablet_replica.cc:333] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.457333 27432 raft_consensus.cc:2243] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.457907 27432 raft_consensus.cc:2272] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.460877  4352 consensus_peers.cc:597] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.461347 27432 tablet_replica.cc:333] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
W20260709 13:14:43.460135  4278 consensus_peers.cc:597] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.462308 27432 raft_consensus.cc:2243] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.462997 27432 raft_consensus.cc:2272] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.466254 27432 tablet_replica.cc:333] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.467149 27432 raft_consensus.cc:2243] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.467757 27432 raft_consensus.cc:2272] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.471024 27432 tablet_replica.cc:333] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.471927 27432 raft_consensus.cc:2243] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:43.473148 27432 raft_consensus.cc:2272] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.476320 27432 tablet_replica.cc:333] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.477228 27432 raft_consensus.cc:2243] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.477900 27432 raft_consensus.cc:2272] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.481783 27432 tablet_replica.cc:333] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.482687 27432 raft_consensus.cc:2243] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.483285 27432 raft_consensus.cc:2272] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.486291 27432 tablet_replica.cc:333] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.487149 27432 raft_consensus.cc:2243] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.487794 27432 raft_consensus.cc:2272] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.490754 27432 tablet_replica.cc:333] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.491523 27432 raft_consensus.cc:2243] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.492079 27432 raft_consensus.cc:2272] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.495254 27432 tablet_replica.cc:333] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.496104 27432 raft_consensus.cc:2243] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.496703 27432 raft_consensus.cc:2272] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.500100 27432 tablet_replica.cc:333] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.500877 27432 raft_consensus.cc:2243] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.501533 27432 raft_consensus.cc:2272] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.501933  4278 consensus_peers.cc:597] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.504482 27432 tablet_replica.cc:333] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.505415 27432 raft_consensus.cc:2243] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:14:43.505497  4278 consensus_peers.cc:597] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.506233  4278 consensus_peers.cc:597] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.506764 27432 raft_consensus.cc:2272] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.510239 27432 tablet_replica.cc:333] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.511174 27432 raft_consensus.cc:2243] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.511904 27432 raft_consensus.cc:2272] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:43.514894 27432 tablet_replica.cc:333] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: stopping tablet replica
I20260709 13:14:43.515616 27432 raft_consensus.cc:2243] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:43.516251 27432 raft_consensus.cc:2272] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:43.549755  4204 consensus_peers.cc:597] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.567888  4204 consensus_peers.cc:597] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.592775  4204 consensus_peers.cc:597] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.598039  4352 consensus_peers.cc:597] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.621639  4278 consensus_peers.cc:597] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.626348 27432 tablet_server.cc:196] TabletServer@127.26.202.1:0 shutdown complete.
W20260709 13:14:43.632386  4352 consensus_peers.cc:597] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.684800  4352 consensus_peers.cc:597] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.729521  4278 consensus_peers.cc:597] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.732618  4204 consensus_peers.cc:597] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:43.757193 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:43.781699  4278 consensus_peers.cc:597] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:43.782507  4986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:43.784695  4987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:43.793668  4989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:43.794133 27432 server_base.cc:1061] running on GCE node
I20260709 13:14:43.796038 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:43.796339 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:43.796579 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602883796553 us; error 0 us; skew 500 ppm
I20260709 13:14:43.797580 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:43.801335 27432 webserver.cc:533] Webserver started at http://127.26.202.1:34903/ using document root <none> and password file <none>
I20260709 13:14:43.801939 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:43.802168 27432 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:14:43.810110 27432 fs_manager.cc:714] Time spent opening directory manager: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:14:43.824131  4994 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:43.825984 27432 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:14:43.826517 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "5579adc264d4484692d94b04f0b4f974"
format_stamp: "Formatted at 2026-07-09 13:14:29 on dist-test-slave-008w"
I20260709 13:14:43.827205 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:43.905138 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:43.906868 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:43.908780 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:43.915462  5001 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:14:44.284942  4980 raft_consensus.cc:493] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.285683  4980 raft_consensus.cc:515] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.288065  4980 leader_election.cc:290] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.292043  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
W20260709 13:14:44.301945  4278 leader_election.cc:336] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.302469  4278 leader_election.cc:304] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:44.306722  4980 raft_consensus.cc:2749] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.353062 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:14:44.353556 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.440s	user 0.009s	sys 0.000s
I20260709 13:14:44.353960 27432 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:14:44.359589  4952 raft_consensus.cc:493] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.360262  4952 raft_consensus.cc:515] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.362553  4952 leader_election.cc:290] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.363466  5001 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:44.370057  4352 leader_election.cc:336] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.371969  4548 raft_consensus.cc:493] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.372260  4952 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.372656  4548 raft_consensus.cc:515] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.373080  4952 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.375382  4952 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:44.378619  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:44.379818  4548 leader_election.cc:290] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:44.383924  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:44.385201  4204 leader_election.cc:336] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:44.387866  4352 leader_election.cc:336] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.388818  4352 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:44.389627  4952 raft_consensus.cc:2749] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.391194  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:44.398437  4952 raft_consensus.cc:493] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.399122  4952 raft_consensus.cc:515] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.399883  4204 leader_election.cc:304] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.401132  4548 raft_consensus.cc:2749] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.401292  4952 leader_election.cc:290] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:44.397524  4352 leader_election.cc:304] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.403707  4952 raft_consensus.cc:2749] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.406241  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:44.410825  4548 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
W20260709 13:14:44.411475  4352 leader_election.cc:336] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.412045  4352 leader_election.cc:304] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:44.412788  4952 raft_consensus.cc:2749] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.417164  4548 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.418704  4826 raft_consensus.cc:493] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.419417  4548 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.419358  4826 raft_consensus.cc:515] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.421685  4826 leader_election.cc:290] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
W20260709 13:14:44.428382  4204 leader_election.cc:336] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.445591  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:44.454879  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.455376  4956 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.455994  4956 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.458367  4956 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:44.459108  4384 raft_consensus.cc:2468] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:44.473764  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:44.474830  4236 raft_consensus.cc:2468] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:44.484501  4207 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.490094  5003 raft_consensus.cc:2804] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.490831  5003 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.491422  5003 raft_consensus.cc:3060] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.493656  4838 raft_consensus.cc:493] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.494309  4838 raft_consensus.cc:515] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.497555  4548 raft_consensus.cc:493] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.498183  4548 raft_consensus.cc:515] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.500254  4548 leader_election.cc:290] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
W20260709 13:14:44.503882  4278 leader_election.cc:336] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.505722  4838 leader_election.cc:290] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:44.506765  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:44.507745  4236 raft_consensus.cc:2468] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:44.509521  4278 leader_election.cc:304] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.510769  4838 raft_consensus.cc:2804] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.511479  4838 raft_consensus.cc:493] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.512159  4838 raft_consensus.cc:3060] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.530462  4548 raft_consensus.cc:493] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.531423  4548 raft_consensus.cc:515] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.532366  4950 raft_consensus.cc:493] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.532970  4950 raft_consensus.cc:515] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.533972  4548 leader_election.cc:290] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:44.535298  4950 leader_election.cc:290] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:44.539404  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:44.540225  4236 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:44.487306  4352 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:44.542625  4826 raft_consensus.cc:2804] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.542769  4278 leader_election.cc:304] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:44.543088  4826 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.543509  4826 raft_consensus.cc:3060] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.543669  4950 raft_consensus.cc:2804] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.544119  4950 raft_consensus.cc:493] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.544518  4950 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.550324  4983 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
W20260709 13:14:44.542521  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 55292.5us
I20260709 13:14:44.550966  4983 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.551370  4826 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.554522  4983 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.555178  4950 raft_consensus.cc:515] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.565526  4548 raft_consensus.cc:493] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.565968  4826 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:44.566215  4548 raft_consensus.cc:515] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.565866  4950 leader_election.cc:290] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:44.569235  4548 leader_election.cc:290] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.558940  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.576429  4389 raft_consensus.cc:2468] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:44.560011  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.577687  4384 raft_consensus.cc:2468] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
W20260709 13:14:44.560494  4352 leader_election.cc:336] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.578596  4352 leader_election.cc:304] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:44.579443  4826 raft_consensus.cc:2749] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.581771  4826 raft_consensus.cc:493] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.562134  5003 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.582361  4826 raft_consensus.cc:515] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.584465  5003 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.584650  4826 leader_election.cc:290] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.557724  4956 raft_consensus.cc:493] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.585444  4956 raft_consensus.cc:515] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.587944  4956 leader_election.cc:290] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.570668  4838 raft_consensus.cc:515] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.571668  5001 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:14:44.575448  4278 leader_election.cc:336] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.589951  5001 tablet_bootstrap.cc:492] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
W20260709 13:14:44.563714  4204 leader_election.cc:336] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.590749  5001 ts_tablet_manager.cc:1403] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.227s	user 0.058s	sys 0.066s
I20260709 13:14:44.593169  4207 leader_election.cc:304] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.593823  5001 raft_consensus.cc:359] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.594584  5001 raft_consensus.cc:740] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.595336  5001 consensus_queue.cc:260] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.595916  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:44.596835  4236 raft_consensus.cc:2393] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c3b8bb2dfba041dea91b3e6775c34505 in current term 2: Already voted for candidate ecb7bdee23254ebbb5be4faa5795e657 in this term.
I20260709 13:14:44.597054  5003 raft_consensus.cc:2804] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.597569  5003 raft_consensus.cc:493] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.597896  5003 raft_consensus.cc:3060] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:44.600755  4204 leader_election.cc:336] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:44.601613  4204 leader_election.cc:336] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.603178  4207 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.605973  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:44.606725  4310 raft_consensus.cc:2468] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:44.608047  4548 raft_consensus.cc:2804] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.608619  4548 raft_consensus.cc:493] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.609222  4548 raft_consensus.cc:3060] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.621830  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:44.630625  4310 raft_consensus.cc:2393] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 2: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:44.606724  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:44.623914  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:44.632747  4236 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.634300  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "476b62391a0c41cba2d9c578b2e05b4e" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:44.634995  4241 raft_consensus.cc:3060] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:44.624017  4204 leader_election.cc:336] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.625952  4838 leader_election.cc:290] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
W20260709 13:14:44.645190  4352 leader_election.cc:336] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:44.647032  4278 leader_election.cc:336] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.650298  4241 raft_consensus.cc:2468] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:14:44.651481  4352 leader_election.cc:304] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:44.652598  4952 raft_consensus.cc:2804] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.652988  4952 raft_consensus.cc:493] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.653415  4952 raft_consensus.cc:3060] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.662012  4983 raft_consensus.cc:493] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.679095  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.664795  4983 raft_consensus.cc:515] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.664254  5003 raft_consensus.cc:515] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.681440  4983 leader_election.cc:290] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.682404  5001 ts_tablet_manager.cc:1434] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.091s	user 0.019s	sys 0.026s
I20260709 13:14:44.682684  5003 leader_election.cc:290] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.667335  4952 raft_consensus.cc:515] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.683609  5001 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:44.683765  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:44.684602  4384 raft_consensus.cc:2393] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ecb7bdee23254ebbb5be4faa5795e657 in current term 2: Already voted for candidate c3b8bb2dfba041dea91b3e6775c34505 in this term.
I20260709 13:14:44.671634  4278 leader_election.cc:304] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
W20260709 13:14:44.645273  4204 leader_election.cc:336] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.687280  4838 raft_consensus.cc:2804] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.687873  4838 raft_consensus.cc:697] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:44.688822  4838 consensus_queue.cc:237] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.691877  4204 leader_election.cc:304] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
W20260709 13:14:44.692505  4278 leader_election.cc:336] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.685503  4952 leader_election.cc:290] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.696844  5005 raft_consensus.cc:493] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.697396  5005 raft_consensus.cc:515] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.699487  5005 leader_election.cc:290] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.702099  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.702837  4389 raft_consensus.cc:2468] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:44.704123  4281 leader_election.cc:304] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:44.704905  5005 raft_consensus.cc:2804] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.705689  5005 raft_consensus.cc:493] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.706059  5005 raft_consensus.cc:3060] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.711467  5001 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:44.712549  5001 tablet_bootstrap.cc:492] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
W20260709 13:14:44.719259  4204 leader_election.cc:336] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:44.719857  4204 leader_election.cc:336] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.721328  5001 ts_tablet_manager.cc:1403] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.004s
I20260709 13:14:44.722087  4064 catalog_manager.cc:5697] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:44.724400  5001 raft_consensus.cc:359] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.685657  4548 raft_consensus.cc:515] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.725334  5001 raft_consensus.cc:740] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.726267  5001 consensus_queue.cc:260] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.727097  4548 leader_election.cc:290] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.728609  5001 ts_tablet_manager.cc:1434] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:44.730736  5001 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:44.732193  4278 leader_election.cc:336] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.732949  4236 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:14:44.733672  4983 raft_consensus.cc:2749] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.738418  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.738605  4278 leader_election.cc:304] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.740466  4838 raft_consensus.cc:2804] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.741088  4838 raft_consensus.cc:697] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:44.742350  4838 consensus_queue.cc:237] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:44.747048  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a5871d73843d9867ab8076cbd10ac" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:44.747766  4384 raft_consensus.cc:3060] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.755980  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e515c59fdd462087377434a2fda3aa" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:44.756830  4389 raft_consensus.cc:3060] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.757568  4950 raft_consensus.cc:493] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.758131  4950 raft_consensus.cc:515] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.760460  4950 leader_election.cc:290] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.761301  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf28675179d3498593c326d198268cc9" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.762092  4382 raft_consensus.cc:2468] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:44.763723  4281 leader_election.cc:304] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:44.769187  4950 raft_consensus.cc:2804] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.769418  4207 leader_election.cc:304] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:44.769704  4950 raft_consensus.cc:493] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.769623  5005 raft_consensus.cc:515] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.770591  4983 raft_consensus.cc:2749] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.771744  4950 raft_consensus.cc:3060] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.772478  5005 leader_election.cc:290] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.773289  4207 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:44.773561  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f45a6a6cb72448ba6e261d361a0f446" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:44.774876  4382 raft_consensus.cc:3060] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.773629  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f966b9e1356c4224a74a4b1f6e10fca5" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
W20260709 13:14:44.777114  4278 leader_election.cc:336] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.776099  4983 raft_consensus.cc:2749] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.780124  4207 leader_election.cc:304] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:44.782199  4983 raft_consensus.cc:2749] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.785195  4389 raft_consensus.cc:2468] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 2.
W20260709 13:14:44.786019  4352 leader_election.cc:336] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:44.786048  4204 leader_election.cc:336] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.786576  4309 raft_consensus.cc:3060] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:44.789100  4278 leader_election.cc:336] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.790547  4382 raft_consensus.cc:2468] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:14:44.791885  4281 leader_election.cc:304] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.793133  4838 raft_consensus.cc:2804] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.794203  4838 raft_consensus.cc:697] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:44.795174  4309 raft_consensus.cc:2468] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 2.
I20260709 13:14:44.786589  4352 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:44.798439  4384 raft_consensus.cc:2468] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 2.
I20260709 13:14:44.797376  4838 consensus_queue.cc:237] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.800313 27432 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:14:44.800807 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.447s	user 0.312s	sys 0.005s
W20260709 13:14:44.803555  4352 leader_election.cc:336] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:44.804387  4352 leader_election.cc:336] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.804426  4826 raft_consensus.cc:2749] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.804841  4352 leader_election.cc:304] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.805637  4826 raft_consensus.cc:2749] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.807322  4826 raft_consensus.cc:493] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.808010  4826 raft_consensus.cc:515] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.810822  4826 leader_election.cc:290] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:44.811455  4352 leader_election.cc:304] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:44.813664  4207 leader_election.cc:304] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.812588  4956 raft_consensus.cc:2804] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.818552  4949 raft_consensus.cc:2804] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.819087  4956 raft_consensus.cc:697] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:44.819162  4949 raft_consensus.cc:697] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 2 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:44.820053  4956 consensus_queue.cc:237] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.820590  4950 raft_consensus.cc:515] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.821446  5005 raft_consensus.cc:493] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.821972  5005 raft_consensus.cc:515] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.826350  4207 leader_election.cc:304] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.826890  4950 leader_election.cc:290] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.827021  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf28675179d3498593c326d198268cc9" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:44.827579  4950 raft_consensus.cc:493] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.827787  4382 raft_consensus.cc:3060] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.828171  4950 raft_consensus.cc:515] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.829398  4983 raft_consensus.cc:2804] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.829983  4983 raft_consensus.cc:697] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 2 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:44.830539  4950 leader_election.cc:290] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.830816  4983 consensus_queue.cc:237] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
W20260709 13:14:44.838792  4278 leader_election.cc:336] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.839133  5005 leader_election.cc:290] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
W20260709 13:14:44.839358  4278 leader_election.cc:336] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.820060  4949 consensus_queue.cc:237] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
W20260709 13:14:44.849098  4352 leader_election.cc:336] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.851506  5001 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:44.855176  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:44.855918  4952 raft_consensus.cc:493] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.857319  4548 raft_consensus.cc:493] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.857860  4382 raft_consensus.cc:2468] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:14:44.858285  4548 raft_consensus.cc:515] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.860332  4548 leader_election.cc:290] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.857491  4952 raft_consensus.cc:515] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.860307  5001 tablet_bootstrap.cc:492] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:44.862771  5001 ts_tablet_manager.cc:1403] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.001s
I20260709 13:14:44.863531  4952 leader_election.cc:290] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.856825  4241 raft_consensus.cc:2468] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
W20260709 13:14:44.868374  4278 leader_election.cc:336] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.888077  4826 raft_consensus.cc:493] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.888722  4826 raft_consensus.cc:515] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:44.890776  4204 leader_election.cc:336] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:44.891485  4826 leader_election.cc:290] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.891829  5001 raft_consensus.cc:359] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.892807  5001 raft_consensus.cc:740] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.894019  5001 consensus_queue.cc:260] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:44.894217  4281 leader_election.cc:304] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:44.896442  5001 ts_tablet_manager.cc:1434] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:14:44.900255  4950 raft_consensus.cc:2804] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.919812  5001 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:44.921201  4385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.934275  4385 raft_consensus.cc:2468] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:44.938716  4950 raft_consensus.cc:697] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:44.939841  4950 consensus_queue.cc:237] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:44.971213  4281 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.4:36981, user_credentials={real_user=slave}} blocked reactor thread for 53398.6us
I20260709 13:14:44.976457  4281 leader_election.cc:304] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974
W20260709 13:14:44.979748  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 111812us
I20260709 13:14:44.978878  4838 raft_consensus.cc:493] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.982369  4838 raft_consensus.cc:515] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:44.984548  4063 catalog_manager.cc:5697] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:44.984815  4838 leader_election.cc:290] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:44.988132  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.988794  4384 raft_consensus.cc:2468] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:44.991117  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:44.993307  4980 raft_consensus.cc:2804] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.993837  4980 raft_consensus.cc:493] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.994280  4980 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.994351  4382 raft_consensus.cc:2468] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 1.
I20260709 13:14:44.995687  4352 leader_election.cc:304] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:44.997807  4826 raft_consensus.cc:2804] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.998204  4826 raft_consensus.cc:493] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:44.998588  4826 raft_consensus.cc:3060] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.007699  4061 catalog_manager.cc:5697] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.011854  5018 raft_consensus.cc:493] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:45.015818  5018 raft_consensus.cc:515] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.011981  4826 raft_consensus.cc:515] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.018242  5018 leader_election.cc:290] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:45.012410  4281 leader_election.cc:304] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:45.019620  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:45.020357  4384 raft_consensus.cc:2468] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 1.
I20260709 13:14:45.021226  4838 raft_consensus.cc:2804] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.021330  4826 leader_election.cc:290] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:45.021879  4838 raft_consensus.cc:493] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:45.013509  4980 raft_consensus.cc:515] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:45.022382  4838 raft_consensus.cc:3060] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.023975  4980 leader_election.cc:290] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
W20260709 13:14:45.026659  4278 leader_election.cc:336] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:45.030176  4352 leader_election.cc:336] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:45.031219  4281 leader_election.cc:304] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:45.035116  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:45.036177  4382 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.035239  5023 raft_consensus.cc:2804] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.037464  5023 raft_consensus.cc:493] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:45.037864  5023 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.045733  4838 raft_consensus.cc:515] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:45.046275  5023 raft_consensus.cc:515] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:45.069787  4278 leader_election.cc:336] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:45.071130  4207 leader_election.cc:304] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:45.071866  4241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:45.072496  4241 raft_consensus.cc:3060] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:45.074193  4352 leader_election.cc:336] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:45.074816  4352 leader_election.cc:336] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:45.073127  4983 raft_consensus.cc:2804] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.075505  4983 raft_consensus.cc:493] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:45.075951  4983 raft_consensus.cc:3060] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.052170  4382 raft_consensus.cc:2468] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:14:45.055226  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:45.078855  4236 raft_consensus.cc:2468] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 1.
I20260709 13:14:45.056578  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:45.057734  5001 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:45.068106  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:45.079932  4310 raft_consensus.cc:2393] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3b8bb2dfba041dea91b3e6775c34505 in current term 2: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:45.080199  4313 raft_consensus.cc:2393] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3b8bb2dfba041dea91b3e6775c34505 in current term 2: Already voted for candidate 44912ba11bc04ab383e985aa41ec5b38 in this term.
I20260709 13:14:45.080544  5001 tablet_bootstrap.cc:492] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:45.081357  5001 ts_tablet_manager.cc:1403] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.173s	user 0.023s	sys 0.001s
I20260709 13:14:45.081737  5023 leader_election.cc:290] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:45.083073  4241 raft_consensus.cc:2468] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 2.
I20260709 13:14:45.084506  5001 raft_consensus.cc:359] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.085394  5001 raft_consensus.cc:740] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.086153  5001 consensus_queue.cc:260] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.087121  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:45.087774  4384 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.088353  5001 ts_tablet_manager.cc:1434] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:45.089305  5001 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:45.095623  4838 leader_election.cc:290] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:45.097270  4384 raft_consensus.cc:2468] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:14:45.100340  4385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f0e5b41dc8442a8c42396f1323e8f7" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:45.101414  4281 leader_election.cc:304] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:45.103209  4838 raft_consensus.cc:2804] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.103842  4838 raft_consensus.cc:697] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:45.114318  4352 leader_election.cc:304] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:45.102804  4281 leader_election.cc:304] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:45.116302  4352 leader_election.cc:304] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:45.119522  4826 raft_consensus.cc:2749] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.120759  5020 raft_consensus.cc:2804] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.122155  5020 raft_consensus.cc:697] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:45.116297  4838 consensus_queue.cc:237] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:45.125376  4278 leader_election.cc:336] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:45.115238  4385 raft_consensus.cc:3060] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.137259  5020 consensus_queue.cc:237] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:45.139006  4278 leader_election.cc:336] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:45.142485  4241 raft_consensus.cc:1275] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.145543  4980 consensus_queue.cc:1048] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:45.167479  4235 raft_consensus.cc:1275] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.167903  5001 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:45.169569  4385 raft_consensus.cc:2468] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:14:45.170568  4952 raft_consensus.cc:2749] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.159799  4983 raft_consensus.cc:515] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.171868  4281 leader_election.cc:304] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:45.172444  5023 consensus_queue.cc:1048] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:45.173244  4980 raft_consensus.cc:2804] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.173383  4983 leader_election.cc:290] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:45.174108  4980 raft_consensus.cc:697] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:45.175168  4980 consensus_queue.cc:237] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:45.179366  4204 leader_election.cc:336] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:45.168865  5001 tablet_bootstrap.cc:492] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
W20260709 13:14:45.183368  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 64113.1us
I20260709 13:14:45.184815  4352 leader_election.cc:304] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:45.186048  4352 leader_election.cc:304] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:45.187248  5036 raft_consensus.cc:2804] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.187930  5036 raft_consensus.cc:493] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:14:45.188320  5036 raft_consensus.cc:3060] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:45.189711  4352 leader_election.cc:336] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
W20260709 13:14:45.192055  4352 leader_election.cc:336] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:45.188390  4952 raft_consensus.cc:2804] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.195771  4952 raft_consensus.cc:697] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:45.190609  5001 ts_tablet_manager.cc:1403] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.004s
I20260709 13:14:45.201128  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cf1309a8c14cb4aef37461b8eb906c" candidate_uuid: "ecb7bdee23254ebbb5be4faa5795e657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:45.202024  4389 raft_consensus.cc:3060] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.211709  5001 raft_consensus.cc:359] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.212584  5001 raft_consensus.cc:740] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.213397  5001 consensus_queue.cc:260] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.221602  4061 catalog_manager.cc:5697] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.223392  4061 catalog_manager.cc:5697] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:45.229858  4063 catalog_manager.cc:5697] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:45.241199  4952 consensus_queue.cc:237] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.244177  5001 ts_tablet_manager.cc:1434] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:14:45.224640  4061 catalog_manager.cc:5697] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.246146  5001 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:45.251662  5036 raft_consensus.cc:515] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.254046  4061 catalog_manager.cc:5697] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.255633  4389 raft_consensus.cc:2468] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecb7bdee23254ebbb5be4faa5795e657 in term 2.
I20260709 13:14:45.256255  4061 catalog_manager.cc:5697] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.257776  4207 leader_election.cc:304] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:45.269488  5036 leader_election.cc:290] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:45.265535  4949 raft_consensus.cc:2804] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.299578  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:45.300668  4235 raft_consensus.cc:3060] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.328997  4949 raft_consensus.cc:697] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 2 LEADER]: Becoming Leader. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:45.331732  4949 consensus_queue.cc:237] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
W20260709 13:14:45.338246  4352 leader_election.cc:336] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:45.340390  4310 raft_consensus.cc:1275] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer c3b8bb2dfba041dea91b3e6775c34505: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.344859  5034 consensus_queue.cc:1048] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:45.348074  4278 consensus_peers.cc:597] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.363014  4204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 79313.1us
W20260709 13:14:45.367133  4278 consensus_peers.cc:597] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.401319  4061 catalog_manager.cc:5697] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.423054  4063 catalog_manager.cc:5697] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:45.429033  4384 raft_consensus.cc:1275] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:45.436458  4278 consensus_peers.cc:597] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.436762  5005 consensus_queue.cc:1048] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:45.437161  4278 consensus_peers.cc:597] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.446424  4384 raft_consensus.cc:1275] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:45.451727  4352 consensus_peers.cc:597] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.454074  4204 consensus_peers.cc:597] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.428871  4235 raft_consensus.cc:2468] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 2.
I20260709 13:14:45.475518  5001 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:45.475697  4352 leader_election.cc:304] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:45.486344  5001 tablet_bootstrap.cc:492] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:45.487417  5001 ts_tablet_manager.cc:1403] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.241s	user 0.024s	sys 0.013s
I20260709 13:14:45.490469  4382 raft_consensus.cc:1275] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer ecb7bdee23254ebbb5be4faa5795e657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.491900  5001 raft_consensus.cc:359] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.498792  5001 raft_consensus.cc:740] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.498215  4061 catalog_manager.cc:5697] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "ecb7bdee23254ebbb5be4faa5795e657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:45.501291  5001 consensus_queue.cc:260] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.504668  5001 ts_tablet_manager.cc:1434] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:14:45.480582  5034 raft_consensus.cc:2804] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.506688  5034 raft_consensus.cc:697] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:45.507591  5034 consensus_queue.cc:237] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:45.509918  4382 raft_consensus.cc:1275] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer ecb7bdee23254ebbb5be4faa5795e657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.511905  5001 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:45.512589  5046 consensus_queue.cc:1048] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:45.514628  4204 consensus_peers.cc:597] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.487283  5015 consensus_queue.cc:1048] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:14:45.518550  5050 consensus_queue.cc:1048] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:45.571092  4386 raft_consensus.cc:1275] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.572839  4950 consensus_queue.cc:1048] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:45.655818  4278 consensus_peers.cc:597] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.666078  4385 raft_consensus.cc:1275] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.698366  4385 raft_consensus.cc:1275] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.713343  5015 consensus_queue.cc:1048] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:14:45.701776  5020 consensus_queue.cc:1048] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:14:45.750276  4278 consensus_peers.cc:597] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.903012  5001 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:45.904560  5001 tablet_bootstrap.cc:492] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
W20260709 13:14:45.907503  4278 consensus_peers.cc:597] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:45.912482  5067 log.cc:927] Time spent T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505: Append to log took a long time: real 0.060s	user 0.000s	sys 0.002s
I20260709 13:14:45.934197  4236 raft_consensus.cc:1275] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer c3b8bb2dfba041dea91b3e6775c34505: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:45.953510  5001 ts_tablet_manager.cc:1403] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.442s	user 0.033s	sys 0.004s
W20260709 13:14:45.965718  4352 consensus_peers.cc:597] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:45.992573  5001 raft_consensus.cc:359] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:45.994704  5001 raft_consensus.cc:740] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.952852  4063 catalog_manager.cc:5697] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 1 to 2, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:45.973387  4204 consensus_peers.cc:597] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:46.007071  4204 consensus_peers.cc:597] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.014055  4204 consensus_peers.cc:597] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:46.015944  5018 consensus_queue.cc:1048] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.022294  4387 raft_consensus.cc:1275] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer ecb7bdee23254ebbb5be4faa5795e657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:46.034157  4278 consensus_peers.cc:597] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:46.035179  5001 consensus_queue.cc:260] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:46.042659  4983 consensus_queue.cc:1048] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:46.043167  4278 consensus_peers.cc:597] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.046820  4204 consensus_peers.cc:597] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.051708  4278 consensus_peers.cc:597] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.054289  4278 consensus_peers.cc:597] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.056035  4278 consensus_peers.cc:597] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.057509  4278 consensus_peers.cc:597] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.063673  4278 consensus_peers.cc:597] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.064726  4278 consensus_peers.cc:597] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.075991  4204 consensus_peers.cc:597] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.086819  4352 consensus_peers.cc:597] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:46.091173  5079 raft_consensus.cc:493] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.091902  5001 ts_tablet_manager.cc:1434] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.132s	user 0.013s	sys 0.024s
I20260709 13:14:46.091853  5079 raft_consensus.cc:515] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:46.092990  5001 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:46.095216  4204 consensus_peers.cc:597] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.116464  4204 consensus_peers.cc:597] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.121656  4352 consensus_peers.cc:597] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.117219  4204 consensus_peers.cc:597] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.129508  4278 consensus_peers.cc:597] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.157841  4204 consensus_peers.cc:597] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:46.160728  5079 leader_election.cc:290] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:46.161623  5082 raft_consensus.cc:493] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.170469  5082 raft_consensus.cc:515] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:46.189646  5001 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.195093  5001 tablet_bootstrap.cc:492] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.196069  5001 ts_tablet_manager.cc:1403] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.008s
I20260709 13:14:46.200098  5001 raft_consensus.cc:359] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:46.190696  5082 leader_election.cc:290] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
W20260709 13:14:46.192392  4352 consensus_peers.cc:597] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.201706  4204 consensus_peers.cc:597] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.203068  4278 consensus_peers.cc:597] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.207060  4278 consensus_peers.cc:597] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.207753  4278 consensus_peers.cc:597] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:46.214200  5001 raft_consensus.cc:740] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.215502  5001 consensus_queue.cc:260] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
W20260709 13:14:46.225636  4204 consensus_peers.cc:597] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:46.227558  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:46.230248  5001 ts_tablet_manager.cc:1434] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:14:46.230777  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:46.238202  5001 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:46.245546  4278 consensus_peers.cc:597] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.261463  4352 consensus_peers.cc:597] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.262159  4352 consensus_peers.cc:597] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:46.265784  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:46.266242  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb795975f5724d21aea741fdb7dc678a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:46.267501  4995 leader_election.cc:304] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:46.268559  5082 raft_consensus.cc:2749] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.269605  4995 leader_election.cc:304] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:46.270818  5082 raft_consensus.cc:2749] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.270947  4240 raft_consensus.cc:1275] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer c3b8bb2dfba041dea91b3e6775c34505: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:46.276556  5082 raft_consensus.cc:493] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.277143  5082 raft_consensus.cc:515] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.286172  5082 leader_election.cc:290] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:46.287753  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:46.296438  4204 consensus_peers.cc:597] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.318174  4352 consensus_peers.cc:597] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:46.320519  5036 consensus_queue.cc:1048] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:46.339380  5073 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.339968  5073 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.342373  5073 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:46.343231  5001 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.344599  5001 tablet_bootstrap.cc:492] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.345381  5001 ts_tablet_manager.cc:1403] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.107s	user 0.020s	sys 0.005s
I20260709 13:14:46.347991  5001 raft_consensus.cc:359] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:46.348785  5001 raft_consensus.cc:740] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.357110  5001 consensus_queue.cc:260] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:46.359537  5001 ts_tablet_manager.cc:1434] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:46.360481  5001 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:46.378062  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:46.379221  4235 raft_consensus.cc:2468] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 2.
I20260709 13:14:46.385092  5001 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.386251  5001 tablet_bootstrap.cc:492] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.387027  5001 ts_tablet_manager.cc:1403] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:14:46.390098  5001 raft_consensus.cc:359] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:46.391129  5001 raft_consensus.cc:740] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.391971  5001 consensus_queue.cc:260] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:46.394584  5001 ts_tablet_manager.cc:1434] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:14:46.397491  5001 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:46.422168  5001 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.423202  5001 tablet_bootstrap.cc:492] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.423871  5001 ts_tablet_manager.cc:1403] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.000s
I20260709 13:14:46.426733  5001 raft_consensus.cc:359] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.427410  5001 raft_consensus.cc:740] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.429570  4352 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:46.430658  5073 raft_consensus.cc:2804] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:46.431231  5073 raft_consensus.cc:493] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.431737  5073 raft_consensus.cc:3060] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.428229  5001 consensus_queue.cc:260] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.440042  5001 ts_tablet_manager.cc:1434] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:14:46.441195  5001 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:46.478044  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9bbf2e5f1eb4b198b54c28a89a20bc9" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:46.451179  5073 raft_consensus.cc:515] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.482556  5073 leader_election.cc:290] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 election: Requested vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
W20260709 13:14:46.494988  4352 leader_election.cc:336] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:46.507027  4998 leader_election.cc:304] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:46.510319  5082 raft_consensus.cc:2749] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.536644  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebbff40bd944f06b60fe91902f8e57a" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:46.537467  4235 raft_consensus.cc:3060] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:46.561828  4278 consensus_peers.cc:597] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:46.579186  4235 raft_consensus.cc:2468] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 3.
I20260709 13:14:46.587738  5001 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.589412  5001 tablet_bootstrap.cc:492] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.590554  5001 ts_tablet_manager.cc:1403] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.150s	user 0.025s	sys 0.065s
I20260709 13:14:46.594884  5001 raft_consensus.cc:359] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:46.596036  5001 raft_consensus.cc:740] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.597445  5001 consensus_queue.cc:260] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:46.600550  5001 ts_tablet_manager.cc:1434] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:14:46.601675  5001 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:46.617045  4352 leader_election.cc:304] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:46.618283  5036 raft_consensus.cc:2804] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:46.618816  5036 raft_consensus.cc:697] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 3 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:46.619771  5036 consensus_queue.cc:237] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.683354  5082 raft_consensus.cc:493] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.683961  5082 raft_consensus.cc:515] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.684748  5001 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.699451  5001 tablet_bootstrap.cc:492] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.700242  5001 ts_tablet_manager.cc:1403] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.099s	user 0.023s	sys 0.000s
I20260709 13:14:46.703637  5001 raft_consensus.cc:359] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.704324  5001 raft_consensus.cc:740] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.686195  5082 leader_election.cc:290] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:46.688095  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d3c8a715e14f2cb977c6ad59220712" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
W20260709 13:14:46.709661  4352 consensus_peers.cc:597] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:46.710234  4352 leader_election.cc:336] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:14:46.708523  5001 consensus_queue.cc:260] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.719509  5001 ts_tablet_manager.cc:1434] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:14:46.720690  5001 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:46.731642  4064 catalog_manager.cc:5697] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 1 to 3, leader changed from 5579adc264d4484692d94b04f0b4f974 (127.26.202.1) to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 3 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.743187  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d3c8a715e14f2cb977c6ad59220712" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:46.776332  4998 leader_election.cc:304] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:46.777623  5082 raft_consensus.cc:2749] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.790871  5082 raft_consensus.cc:493] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.791414  5082 raft_consensus.cc:515] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.794301  5082 leader_election.cc:290] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:46.794574  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:46.796226  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73dfdf505542c191c5ec6047bb5fcb" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:46.809302  5001 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.811384  5001 tablet_bootstrap.cc:492] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.821519  5001 ts_tablet_manager.cc:1403] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.005s
I20260709 13:14:46.823747  5082 raft_consensus.cc:493] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.824330  5082 raft_consensus.cc:515] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.833598  5001 raft_consensus.cc:359] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:46.834467  5001 raft_consensus.cc:740] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.834751  5082 leader_election.cc:290] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:14:46.836841  5001 consensus_queue.cc:260] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:46.838451  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657" is_pre_election: true
I20260709 13:14:46.841813  5001 ts_tablet_manager.cc:1434] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:14:46.843189  5001 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:46.863543  4998 leader_election.cc:304] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:46.866973  5082 raft_consensus.cc:2749] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.872998  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb735e4fccce42b2a96e24b96915088a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:46.874881  5001 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.875967  5001 tablet_bootstrap.cc:492] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.876701  5001 ts_tablet_manager.cc:1403] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.009s
I20260709 13:14:46.879642  5001 raft_consensus.cc:359] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:46.880352  5001 raft_consensus.cc:740] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.881081  5001 consensus_queue.cc:260] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:46.883610  5001 ts_tablet_manager.cc:1434] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:14:46.884379  5001 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:46.887650  4998 leader_election.cc:304] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:14:46.888839  5082 raft_consensus.cc:2749] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.909649  5001 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:46.910802  5001 tablet_bootstrap.cc:492] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:46.911550  5001 ts_tablet_manager.cc:1403] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.008s
I20260709 13:14:46.914691  5001 raft_consensus.cc:359] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.915480  5001 raft_consensus.cc:740] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.916456  5001 consensus_queue.cc:260] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:46.919289  5001 ts_tablet_manager.cc:1434] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:46.920459  5001 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:47.059459  5001 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.061053  5001 tablet_bootstrap.cc:492] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.062022  5001 ts_tablet_manager.cc:1403] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.142s	user 0.035s	sys 0.045s
I20260709 13:14:47.078902  5001 raft_consensus.cc:359] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:47.079782  5001 raft_consensus.cc:740] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.083923  4235 raft_consensus.cc:1275] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 3 FOLLOWER]: Refusing update from remote peer c3b8bb2dfba041dea91b3e6775c34505: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:47.087604  5111 consensus_queue.cc:1048] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:47.080654  5001 consensus_queue.cc:260] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:47.108462  5001 ts_tablet_manager.cc:1434] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:14:47.111445  5001 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:47.184298  4352 consensus_peers.cc:597] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.216651  5146 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:35785 every 8 connection(s)
I20260709 13:14:47.217401 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:35785
I20260709 13:14:47.272600  5001 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.276394  5001 tablet_bootstrap.cc:492] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.277169  5001 ts_tablet_manager.cc:1403] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.014s
I20260709 13:14:47.283056  5001 raft_consensus.cc:359] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:47.283840  5001 raft_consensus.cc:740] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.284776  5001 consensus_queue.cc:260] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:47.286556  5001 ts_tablet_manager.cc:1434] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:47.287410  5001 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:47.289608  5107 raft_consensus.cc:3060] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.301515  5105 raft_consensus.cc:3060] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.310371  5108 raft_consensus.cc:3060] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.315009  5001 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.316416  5001 tablet_bootstrap.cc:492] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.317217  5001 ts_tablet_manager.cc:1403] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.007s
I20260709 13:14:47.322351  5001 raft_consensus.cc:359] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:47.323169  5001 raft_consensus.cc:740] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.324152  5001 consensus_queue.cc:260] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:47.392055  5147 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40011
I20260709 13:14:47.392735  5147 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:47.393996  5147 heartbeater.cc:507] Master 127.26.202.62:40011 requested a full tablet report, sending...
I20260709 13:14:47.407568  5001 ts_tablet_manager.cc:1434] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.090s	user 0.024s	sys 0.039s
I20260709 13:14:47.408601  5001 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:47.410555  5159 raft_consensus.cc:493] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.411218  5159 raft_consensus.cc:515] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:47.414626  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc74b88e70804c2ba5f2b32882e1043a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505" is_pre_election: true
I20260709 13:14:47.414367  5159 leader_election.cc:290] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:47.419683  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc74b88e70804c2ba5f2b32882e1043a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44912ba11bc04ab383e985aa41ec5b38" is_pre_election: true
I20260709 13:14:47.421350  4995 leader_election.cc:304] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974; no voters: 44912ba11bc04ab383e985aa41ec5b38, c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:47.422139  5159 raft_consensus.cc:2749] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.423053  5105 raft_consensus.cc:3060] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.456681  5103 raft_consensus.cc:3060] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.469214  4064 ts_manager.cc:194] Re-registered known tserver with Master: 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
I20260709 13:14:47.480595  5108 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.481261  5001 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.482403  5001 tablet_bootstrap.cc:492] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.483119  5001 ts_tablet_manager.cc:1403] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.027s
I20260709 13:14:47.485750  5001 raft_consensus.cc:359] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:47.486495  5001 raft_consensus.cc:740] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.487317  5001 consensus_queue.cc:260] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:47.491250  5001 ts_tablet_manager.cc:1434] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:47.494822  5001 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:47.562441  4064 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36388
I20260709 13:14:47.567118  5001 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.568262  5001 tablet_bootstrap.cc:492] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.568783  5147 heartbeater.cc:499] Master 127.26.202.62:40011 was elected leader, sending a full tablet report...
I20260709 13:14:47.568969  5001 ts_tablet_manager.cc:1403] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.074s	user 0.032s	sys 0.012s
I20260709 13:14:47.571940  5001 raft_consensus.cc:359] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:47.572734  5001 raft_consensus.cc:740] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.573637  5001 consensus_queue.cc:260] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:47.575513  5001 ts_tablet_manager.cc:1434] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:47.576323  5001 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:47.607621  5001 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.608666  5001 tablet_bootstrap.cc:492] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.609799  5001 ts_tablet_manager.cc:1403] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.007s
I20260709 13:14:47.612416  5001 raft_consensus.cc:359] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:47.613152  5001 raft_consensus.cc:740] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.613874  5001 consensus_queue.cc:260] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:47.618151  5001 ts_tablet_manager.cc:1434] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:14:47.619113  5001 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:47.655754  5001 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.656955  5001 tablet_bootstrap.cc:492] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.657676  5001 ts_tablet_manager.cc:1403] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.016s
I20260709 13:14:47.660455  5001 raft_consensus.cc:359] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:47.661265  5001 raft_consensus.cc:740] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.662104  5001 consensus_queue.cc:260] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:47.664536  5001 ts_tablet_manager.cc:1434] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:47.665493  5001 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:47.721621  5001 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.727660  5001 tablet_bootstrap.cc:492] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.728408  5001 ts_tablet_manager.cc:1403] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.063s	user 0.026s	sys 0.027s
I20260709 13:14:47.731143  5001 raft_consensus.cc:359] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:47.731814  5001 raft_consensus.cc:740] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.732451  5001 consensus_queue.cc:260] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:47.734705  5001 ts_tablet_manager.cc:1434] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
W20260709 13:14:47.736416  4278 consensus_peers.cc:597] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:47.738116  5001 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:47.785176  5001 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.786194  5001 tablet_bootstrap.cc:492] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:47.786914  5001 ts_tablet_manager.cc:1403] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.012s
I20260709 13:14:47.791183  5001 raft_consensus.cc:359] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:47.791847  5001 raft_consensus.cc:740] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.792678  5001 consensus_queue.cc:260] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:47.794802  5001 ts_tablet_manager.cc:1434] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:14:47.795910  5001 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:47.899436  4278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:41405, user_credentials={real_user=slave}} blocked reactor thread for 46177.6us
I20260709 13:14:47.909952  5103 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.009406  5001 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.017278  5001 tablet_bootstrap.cc:492] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.020215  5001 ts_tablet_manager.cc:1403] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.225s	user 0.068s	sys 0.123s
W20260709 13:14:48.021409  4352 consensus_peers.cc:597] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.022938  5001 raft_consensus.cc:359] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.023710  5001 raft_consensus.cc:740] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.024405  5001 consensus_queue.cc:260] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.026536  5001 ts_tablet_manager.cc:1434] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:48.027647  5001 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.052901  5103 raft_consensus.cc:3060] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.072106  5001 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.074280  5001 tablet_bootstrap.cc:492] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.075011  5001 ts_tablet_manager.cc:1403] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.025s
I20260709 13:14:48.077853  5001 raft_consensus.cc:359] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.078577  5001 raft_consensus.cc:740] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.079226  5001 consensus_queue.cc:260] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.081261  5001 ts_tablet_manager.cc:1434] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:48.082079  5001 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:48.109946  4204 consensus_peers.cc:597] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:48.139582  4278 consensus_peers.cc:597] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.147362  5001 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.148473  5001 tablet_bootstrap.cc:492] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.149209  5001 ts_tablet_manager.cc:1403] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.011s
I20260709 13:14:48.151759  5001 raft_consensus.cc:359] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.152470  5001 raft_consensus.cc:740] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.153172  5001 consensus_queue.cc:260] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.155426  5001 ts_tablet_manager.cc:1434] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:48.156322  5001 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:48.190830  4278 consensus_peers.cc:597] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:48.219002  5001 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.220353  5001 tablet_bootstrap.cc:492] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.221197  5001 ts_tablet_manager.cc:1403] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.012s
I20260709 13:14:48.224438  5001 raft_consensus.cc:359] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.225272  5001 raft_consensus.cc:740] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.226167  5001 consensus_queue.cc:260] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.228720  5001 ts_tablet_manager.cc:1434] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:48.234499  5001 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.293653  5001 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.294663  5001 tablet_bootstrap.cc:492] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.295336  5001 ts_tablet_manager.cc:1403] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.006s
I20260709 13:14:48.298425  5001 raft_consensus.cc:359] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.299448  5001 raft_consensus.cc:740] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.300184  5001 consensus_queue.cc:260] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.305680  5001 ts_tablet_manager.cc:1434] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:14:48.306574  5001 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:48.307324  4204 consensus_peers.cc:597] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:48.318096  4204 consensus_peers.cc:597] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:48.323836  4352 consensus_peers.cc:597] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:48.335372  5001 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.336582  5001 tablet_bootstrap.cc:492] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.337389  5001 ts_tablet_manager.cc:1403] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.015s
I20260709 13:14:48.340145  5001 raft_consensus.cc:359] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.340878  5001 raft_consensus.cc:740] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.341600  5001 consensus_queue.cc:260] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.343787  5001 ts_tablet_manager.cc:1434] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:48.345234  5001 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.374856  5001 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.376183  5001 tablet_bootstrap.cc:492] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.377050  5001 ts_tablet_manager.cc:1403] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.015s
I20260709 13:14:48.379797  5001 raft_consensus.cc:359] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.380527  5001 raft_consensus.cc:740] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.384233  5001 consensus_queue.cc:260] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.386674  5001 ts_tablet_manager.cc:1434] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:48.387605  5001 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.426491  5001 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.427611  5001 tablet_bootstrap.cc:492] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.428504  5001 ts_tablet_manager.cc:1403] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.019s
I20260709 13:14:48.431497  5001 raft_consensus.cc:359] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.434465  5001 raft_consensus.cc:740] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.435209  5001 consensus_queue.cc:260] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.442368  5001 ts_tablet_manager.cc:1434] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.008s
I20260709 13:14:48.443339  5001 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.461462  5001 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.462409  5001 tablet_bootstrap.cc:492] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.463023  5001 ts_tablet_manager.cc:1403] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:14:48.465611  5001 raft_consensus.cc:359] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.466300  5001 raft_consensus.cc:740] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.466974  5001 consensus_queue.cc:260] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.469065  5001 ts_tablet_manager.cc:1434] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:14:48.470449  5001 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.523078  5001 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.524046  5001 tablet_bootstrap.cc:492] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.524724  5001 ts_tablet_manager.cc:1403] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.054s	user 0.033s	sys 0.012s
I20260709 13:14:48.527339  5001 raft_consensus.cc:359] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.528053  5001 raft_consensus.cc:740] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.528712  5001 consensus_queue.cc:260] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.534416  5001 ts_tablet_manager.cc:1434] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:14:48.535295  5001 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.573472  5001 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.574487  5001 tablet_bootstrap.cc:492] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.575133  5001 ts_tablet_manager.cc:1403] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.016s
I20260709 13:14:48.577358  5001 raft_consensus.cc:359] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.578114  5001 raft_consensus.cc:740] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.578855  5001 consensus_queue.cc:260] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.580773  5001 ts_tablet_manager.cc:1434] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:14:48.581807  5001 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.582295  5103 raft_consensus.cc:3060] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.604419  5001 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.605309  5001 tablet_bootstrap.cc:492] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.605969  5001 ts_tablet_manager.cc:1403] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.002s
I20260709 13:14:48.608512  5001 raft_consensus.cc:359] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.609206  5001 raft_consensus.cc:740] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.609961  5001 consensus_queue.cc:260] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.616127  5001 ts_tablet_manager.cc:1434] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:14:48.617637  5001 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:48.622424  4204 consensus_peers.cc:597] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:48.652325  5001 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.653570  5001 tablet_bootstrap.cc:492] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.654265  5001 ts_tablet_manager.cc:1403] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.009s
I20260709 13:14:48.657305  5001 raft_consensus.cc:359] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.658082  5001 raft_consensus.cc:740] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.659016  5001 consensus_queue.cc:260] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.660590  5001 ts_tablet_manager.cc:1434] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:48.661387  5001 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.666770  5103 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.689704  5001 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.691028  5001 tablet_bootstrap.cc:492] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.691711  5001 ts_tablet_manager.cc:1403] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.031s	user 0.025s	sys 0.004s
I20260709 13:14:48.694523  5001 raft_consensus.cc:359] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.695194  5001 raft_consensus.cc:740] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.695902  5001 consensus_queue.cc:260] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.697790  5001 ts_tablet_manager.cc:1434] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:48.700428  5001 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
W20260709 13:14:48.712927  4278 consensus_peers.cc:597] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:48.726467  5001 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.727660  5001 tablet_bootstrap.cc:492] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.728384  5001 ts_tablet_manager.cc:1403] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.000s
I20260709 13:14:48.730983  5001 raft_consensus.cc:359] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.731709  5001 raft_consensus.cc:740] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.732517  5001 consensus_queue.cc:260] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.735172  5001 ts_tablet_manager.cc:1434] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.002s
I20260709 13:14:48.736246  5001 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.749960  5103 raft_consensus.cc:3060] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.854003  5001 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.855197  5001 tablet_bootstrap.cc:492] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.856069  5001 ts_tablet_manager.cc:1403] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.120s	user 0.043s	sys 0.056s
I20260709 13:14:48.858636  5108 raft_consensus.cc:3060] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.859467  5001 raft_consensus.cc:359] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.860155  5001 raft_consensus.cc:740] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.860716  5001 consensus_queue.cc:260] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:48.862955  5001 ts_tablet_manager.cc:1434] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:48.865290  5001 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.895018  5001 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.896063  5001 tablet_bootstrap.cc:492] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.896813  5001 ts_tablet_manager.cc:1403] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 13:14:48.899891  5001 raft_consensus.cc:359] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.900669  5001 raft_consensus.cc:740] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.901451  5001 consensus_queue.cc:260] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.904243  5001 ts_tablet_manager.cc:1434] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:48.908367  5001 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.928517  5001 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.929484  5001 tablet_bootstrap.cc:492] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.930110  5001 ts_tablet_manager.cc:1403] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:14:48.932626  5001 raft_consensus.cc:359] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.933341  5001 raft_consensus.cc:740] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.934019  5001 consensus_queue.cc:260] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:48.936208  5001 ts_tablet_manager.cc:1434] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:48.937261  5001 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.962028  5001 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.963014  5001 tablet_bootstrap.cc:492] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.963692  5001 ts_tablet_manager.cc:1403] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 13:14:48.970288  5001 raft_consensus.cc:359] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.971387  5001 raft_consensus.cc:740] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.972028  5001 consensus_queue.cc:260] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.973755  5001 ts_tablet_manager.cc:1434] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:14:48.974565  5001 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Bootstrap starting.
I20260709 13:14:48.990760  5001 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.991847  5001 tablet_bootstrap.cc:492] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Bootstrap complete.
I20260709 13:14:48.992774  5001 ts_tablet_manager.cc:1403] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 13:14:48.994984  5001 raft_consensus.cc:359] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.995491  5001 raft_consensus.cc:740] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Initialized, Role: FOLLOWER
I20260709 13:14:48.996162  5001 consensus_queue.cc:260] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:14:48.998021  5103 raft_consensus.cc:3060] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.998494  5001 ts_tablet_manager.cc:1434] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:14:49.480660  5108 raft_consensus.cc:3060] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.250980 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:57.295790  4313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21a1999637a0409fbafc5b729b043472"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:57.296686  4313 raft_consensus.cc:606] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:57.309629  4236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44"
dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
mode: GRACEFUL
new_leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
 from {username='slave'} at 127.0.0.1:35520
I20260709 13:14:57.310169  4236 raft_consensus.cc:606] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Received request to transfer leadership to TS c3b8bb2dfba041dea91b3e6775c34505
I20260709 13:14:57.312860  4313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:57.313414  4313 raft_consensus.cc:606] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:57.316627  4313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "752f5e425310433598dde61b0db31f15"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:57.317126  4313 raft_consensus.cc:606] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:57.321220  4313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:57.322535  4313 raft_consensus.cc:606] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:57.325405  4313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:57.325991  4313 raft_consensus.cc:606] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:57.327169 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:57.328461 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:57.366827  5217 raft_consensus.cc:993] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657: : Instructing follower c3b8bb2dfba041dea91b3e6775c34505 to start an election
I20260709 13:14:57.367486  5217 raft_consensus.cc:1081] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Signalling peer c3b8bb2dfba041dea91b3e6775c34505 to start an election
I20260709 13:14:57.369483  4382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44"
dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
 from {username='slave'} at 127.0.0.1:41376
I20260709 13:14:57.370182  5223 raft_consensus.cc:993] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.370196  4382 raft_consensus.cc:493] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.370767  5223 raft_consensus.cc:1081] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.370903  4382 raft_consensus.cc:3060] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.372430  5108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "752f5e425310433598dde61b0db31f15"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:57.372869  5108 raft_consensus.cc:493] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.373185  5108 raft_consensus.cc:3060] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.378686  4382 raft_consensus.cc:515] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:57.379685  5108 raft_consensus.cc:515] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:57.381750  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:57.382544  4236 raft_consensus.cc:3055] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.382485  4235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:57.383018  4236 raft_consensus.cc:740] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:57.383209  4235 raft_consensus.cc:3060] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.383901  4236 consensus_queue.cc:260] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:57.385126  4236 raft_consensus.cc:3060] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.391723  4235 raft_consensus.cc:2468] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:57.381088  4382 leader_election.cc:290] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:57.393328  4995 leader_election.cc:304] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:57.393491  5108 leader_election.cc:290] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:57.394999  4236 raft_consensus.cc:2468] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 2.
I20260709 13:14:57.396925  5232 raft_consensus.cc:2804] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:57.398334  5228 raft_consensus.cc:993] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.398834  5228 raft_consensus.cc:1081] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.399979  5232 raft_consensus.cc:697] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:57.400066  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752f5e425310433598dde61b0db31f15" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:57.401731  4313 raft_consensus.cc:3055] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.401255  5232 consensus_queue.cc:237] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:57.402081  4313 raft_consensus.cc:740] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:57.402961  4313 consensus_queue.cc:260] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:57.404357  5108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21a1999637a0409fbafc5b729b043472"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:57.405261  5108 raft_consensus.cc:493] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.405619  5108 raft_consensus.cc:3060] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.406064  5228 raft_consensus.cc:993] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.406669  5228 raft_consensus.cc:1081] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.408301  5101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:57.408944  5101 raft_consensus.cc:493] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.409335  5101 raft_consensus.cc:3060] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.414060  4310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfea592b3be44feb8ed92ca07526a44" candidate_uuid: "c3b8bb2dfba041dea91b3e6775c34505" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:57.414754  4310 raft_consensus.cc:3060] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.417444  5108 raft_consensus.cc:515] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.419113  5101 raft_consensus.cc:515] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.420658  4064 catalog_manager.cc:5697] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.421567  5101 leader_election.cc:290] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:57.421893  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:57.422529  4309 raft_consensus.cc:3055] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.422811  4313 raft_consensus.cc:3060] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.422821  4309 raft_consensus.cc:740] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:57.424234  4309 consensus_queue.cc:260] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.426725  4352 leader_election.cc:304] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:57.425561  4309 raft_consensus.cc:3060] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.429117  5108 leader_election.cc:290] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:57.433622  4314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:57.441725  4314 raft_consensus.cc:3055] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:57.442063  4314 raft_consensus.cc:740] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:57.443811  4314 consensus_queue.cc:260] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.444871  4314 raft_consensus.cc:3060] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.450548  4310 raft_consensus.cc:2468] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b8bb2dfba041dea91b3e6775c34505 in term 2.
I20260709 13:14:57.453438  5218 raft_consensus.cc:2804] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:57.454789  5218 raft_consensus.cc:697] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 LEADER]: Becoming Leader. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:57.457775  4314 raft_consensus.cc:2468] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:57.458534  5218 consensus_queue.cc:237] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:14:57.475029  4995 leader_election.cc:304] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:57.477252  5232 raft_consensus.cc:2804] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:57.477805  5232 raft_consensus.cc:697] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:57.478688  5232 consensus_queue.cc:237] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.458966  4309 raft_consensus.cc:2468] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:57.484428  4995 leader_election.cc:304] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:57.485391  5233 raft_consensus.cc:2804] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:57.478302  4313 raft_consensus.cc:2468] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:57.496984  4389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f420ee7d254e55a1a16267eb181e9a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:57.497882  4389 raft_consensus.cc:3060] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.508208  5233 raft_consensus.cc:697] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:57.509868  5233 consensus_queue.cc:237] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.512151  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a1999637a0409fbafc5b729b043472" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:57.512792  4382 raft_consensus.cc:3060] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.534433  4389 raft_consensus.cc:2468] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:57.536051  4382 raft_consensus.cc:2468] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:57.554901  5223 raft_consensus.cc:993] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.555640  5228 raft_consensus.cc:1081] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.558035  5101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:57.558801  5101 raft_consensus.cc:493] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.559226  5101 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.563795  4061 catalog_manager.cc:5697] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 reported cstate change: term changed from 1 to 2, leader changed from ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2) to c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4). New cstate: current_term: 2 leader_uuid: "c3b8bb2dfba041dea91b3e6775c34505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.569796  5101 raft_consensus.cc:515] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.574214  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:57.574822  4309 raft_consensus.cc:3055] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:57.575129  4309 raft_consensus.cc:740] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:57.575878  4309 consensus_queue.cc:260] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.576979  4309 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.577397  5101 leader_election.cc:290] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 3 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:57.580017  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea19effc04e4a57bfe81c26a27db285" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:57.580603  4382 raft_consensus.cc:3060] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.584349  4309 raft_consensus.cc:2468] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 3.
I20260709 13:14:57.585844  4995 leader_election.cc:304] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:57.586757  5232 raft_consensus.cc:2804] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:57.587219  5232 raft_consensus.cc:697] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 3 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:57.588101  5232 consensus_queue.cc:237] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.588616  4382 raft_consensus.cc:2468] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 3.
I20260709 13:14:57.597681  5228 raft_consensus.cc:993] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.598217  5223 raft_consensus.cc:1081] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:57.599674  5101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:57.600174  5101 raft_consensus.cc:493] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.600523  5101 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.607378  5101 raft_consensus.cc:515] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.607623  4061 catalog_manager.cc:5697] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.609432  4061 catalog_manager.cc:5697] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.610162  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:57.610919  4313 raft_consensus.cc:3055] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:57.610177  5101 leader_election.cc:290] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 3 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:57.611315  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469c95e4231846a7b411bc8e662f7897" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:57.612262  4382 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.611428  4061 catalog_manager.cc:5697] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 2 to 3, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.611346  4313 raft_consensus.cc:740] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:57.618384  4313 consensus_queue.cc:260] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.619712  4313 raft_consensus.cc:3060] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.624770  4382 raft_consensus.cc:2468] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 3.
I20260709 13:14:57.625998  4998 leader_election.cc:304] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, c3b8bb2dfba041dea91b3e6775c34505; no voters: 
I20260709 13:14:57.626847  4313 raft_consensus.cc:2468] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 3.
I20260709 13:14:57.627967  5232 raft_consensus.cc:2804] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:57.628685  5232 raft_consensus.cc:697] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 3 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:57.629602  5232 consensus_queue.cc:237] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:57.643824  4061 catalog_manager.cc:5697] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 2 to 3, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.880967  4313 raft_consensus.cc:1275] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer c3b8bb2dfba041dea91b3e6775c34505: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.882488  5218 consensus_queue.cc:1048] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:57.894598  4236 raft_consensus.cc:1275] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.896588  5232 consensus_queue.cc:1048] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:57.926496  4309 raft_consensus.cc:1275] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.936872  5241 consensus_queue.cc:1048] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:57.947685  4235 raft_consensus.cc:1275] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer c3b8bb2dfba041dea91b3e6775c34505: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.953116  5221 consensus_queue.cc:1048] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:14:57.954546  4386 raft_consensus.cc:1275] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.962723  5232 consensus_queue.cc:1048] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:57.987648  4309 raft_consensus.cc:1275] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:57.991303  5233 consensus_queue.cc:1048] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.043057  4382 raft_consensus.cc:1275] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.045049  5232 consensus_queue.cc:1048] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.047501  4309 raft_consensus.cc:1275] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.049407  5232 consensus_queue.cc:1048] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.155227  4386 raft_consensus.cc:1275] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:58.156453  5232 consensus_queue.cc:1048] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:58.165871  4309 raft_consensus.cc:1275] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:58.168818  5232 consensus_queue.cc:1048] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:58.174204  4313 raft_consensus.cc:1275] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:58.178786  5241 consensus_queue.cc:1048] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:58.185304  4382 raft_consensus.cc:1275] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:58.189827  5232 consensus_queue.cc:1048] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:58.329478 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:58.373080 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:58.417403  4386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3edf1d07e3f84aad9c9bb382774c77a0"
dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41300
I20260709 13:14:58.417922  4386 raft_consensus.cc:606] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:58.420528  4309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400506e66b634f6fbfc45dcc033f64f2"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:58.421412  4309 raft_consensus.cc:606] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:58.423979  4309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:58.424533  4309 raft_consensus.cc:606] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:58.427750  4309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:58.428470  4309 raft_consensus.cc:606] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:58.434932  4240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a"
dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35520
I20260709 13:14:58.435566  4240 raft_consensus.cc:606] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:58.438122  4309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f43e14aafd634647aacab29418de8662"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:14:58.438586  4309 raft_consensus.cc:606] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:14:58.440640 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:58.441980 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:58.513091  5223 raft_consensus.cc:993] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.513531  5225 raft_consensus.cc:993] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.513779  5228 raft_consensus.cc:1081] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.514487  5223 raft_consensus.cc:1081] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.515707  5107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:58.516352  5107 raft_consensus.cc:493] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.516441  5108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:58.516781  5107 raft_consensus.cc:3060] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.516990  5108 raft_consensus.cc:493] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.517408  5108 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.524446  5108 raft_consensus.cc:515] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.524444  5107 raft_consensus.cc:515] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.526784  5108 leader_election.cc:290] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 3 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:58.526813  5107 leader_election.cc:290] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:58.527910  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:58.528105  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842c1af88b9a449eaf38dadb53be5452" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:58.528566  4236 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.528784  4313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:58.528715  4309 raft_consensus.cc:3055] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:58.529386  4309 raft_consensus.cc:740] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:58.529398  4313 raft_consensus.cc:3055] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.529922  4313 raft_consensus.cc:740] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:58.530095  4240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed53a0a3d8540fcad750a907a09fa6b" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:58.530370  4309 consensus_queue.cc:260] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.530726  4313 consensus_queue.cc:260] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.531723  4309 raft_consensus.cc:3060] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.531977  4313 raft_consensus.cc:3060] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.530750  4240 raft_consensus.cc:3060] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.539270  4236 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 3.
I20260709 13:14:58.540573  4995 leader_election.cc:304] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:58.541334  5233 raft_consensus.cc:2804] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:58.541801  5233 raft_consensus.cc:697] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 3 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:58.542718  5233 consensus_queue.cc:237] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.548365  4240 raft_consensus.cc:2468] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.549693  4995 leader_election.cc:304] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:14:58.550091  4313 raft_consensus.cc:2468] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.551851  5262 raft_consensus.cc:2804] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.552349  5262 raft_consensus.cc:697] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:58.553210  5262 consensus_queue.cc:237] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.550206  4309 raft_consensus.cc:2468] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 3.
I20260709 13:14:58.572857  5221 raft_consensus.cc:993] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.574636  5221 raft_consensus.cc:1081] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.572875  4064 catalog_manager.cc:5697] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 2 to 3, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 3 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.576499  5108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3edf1d07e3f84aad9c9bb382774c77a0"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35326
I20260709 13:14:58.577172  5108 raft_consensus.cc:493] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.577672  5108 raft_consensus.cc:3060] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.585286  5108 raft_consensus.cc:515] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:58.592584  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf1d07e3f84aad9c9bb382774c77a0" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:58.593205  4309 raft_consensus.cc:3060] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.594028  5108 leader_election.cc:290] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:14:58.595152  4386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3edf1d07e3f84aad9c9bb382774c77a0" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:14:58.595880  4386 raft_consensus.cc:3055] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.596264  4386 raft_consensus.cc:740] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3b8bb2dfba041dea91b3e6775c34505, State: Running, Role: LEADER
I20260709 13:14:58.597102  4386 consensus_queue.cc:260] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:58.598408  4386 raft_consensus.cc:3060] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.601441  4309 raft_consensus.cc:2468] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.602742  4995 leader_election.cc:304] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:58.603598  5233 raft_consensus.cc:2804] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.604254  5233 raft_consensus.cc:697] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:58.607559  5233 consensus_queue.cc:237] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:14:58.608336  4386 raft_consensus.cc:2468] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.628666  4064 catalog_manager.cc:5697] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.630326  4064 catalog_manager.cc:5697] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.763293  5225 raft_consensus.cc:993] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.763988  5268 raft_consensus.cc:1081] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.765712  5108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "400506e66b634f6fbfc45dcc033f64f2"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:58.766284  5108 raft_consensus.cc:493] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.766574  5108 raft_consensus.cc:3060] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.771778  5225 raft_consensus.cc:993] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.771955  5108 raft_consensus.cc:515] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.772475  5268 raft_consensus.cc:1081] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.774089  5108 leader_election.cc:290] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:58.774415  5104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f43e14aafd634647aacab29418de8662"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:14:58.775161  5104 raft_consensus.cc:493] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.775260  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400506e66b634f6fbfc45dcc033f64f2" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:58.775631  5104 raft_consensus.cc:3060] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.775920  4309 raft_consensus.cc:3055] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.776289  4309 raft_consensus.cc:740] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:58.777262  4309 consensus_queue.cc:260] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.778460  4309 raft_consensus.cc:3060] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.781787  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400506e66b634f6fbfc45dcc033f64f2" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:58.782480  4236 raft_consensus.cc:3060] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.784518  5104 raft_consensus.cc:515] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.786157  4309 raft_consensus.cc:2468] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.787259  4995 leader_election.cc:304] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:58.788084  5104 leader_election.cc:290] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:58.788811  5233 raft_consensus.cc:2804] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.789428  5233 raft_consensus.cc:697] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:58.790464  4236 raft_consensus.cc:2468] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.790308  5233 consensus_queue.cc:237] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.791616  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43e14aafd634647aacab29418de8662" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:58.792191  4309 raft_consensus.cc:3055] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.792485  4309 raft_consensus.cc:740] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:14:58.793251  4309 consensus_queue.cc:260] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.793613  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43e14aafd634647aacab29418de8662" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:58.794167  4236 raft_consensus.cc:3060] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.794587  4309 raft_consensus.cc:3060] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.800936  4309 raft_consensus.cc:2468] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.803997  4995 leader_election.cc:304] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:58.805383  5270 raft_consensus.cc:2804] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.805898  5270 raft_consensus.cc:697] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:58.807188  5270 consensus_queue.cc:237] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.811708  4236 raft_consensus.cc:2468] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.814313  4064 catalog_manager.cc:5697] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.833909  4064 catalog_manager.cc:5697] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.852813  5236 raft_consensus.cc:993] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.853365  5236 raft_consensus.cc:1081] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:14:58.854981  5104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35316
I20260709 13:14:58.855647  5104 raft_consensus.cc:493] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.856029  5104 raft_consensus.cc:3060] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.861797  5104 raft_consensus.cc:515] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.863523  5104 leader_election.cc:290] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:14:58.864156  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:14:58.864391  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf65ed933a94d2781c82e8e3145354a" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:14:58.864821  4236 raft_consensus.cc:3055] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:58.864848  4309 raft_consensus.cc:3060] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.865407  4236 raft_consensus.cc:740] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:14:58.866236  4236 consensus_queue.cc:260] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.867475  4236 raft_consensus.cc:3060] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.871975  4309 raft_consensus.cc:2468] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.873617  4995 leader_election.cc:304] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:14:58.874255  4236 raft_consensus.cc:2468] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:14:58.874444  5270 raft_consensus.cc:2804] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:58.875725  5270 raft_consensus.cc:697] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:14:58.876675  5270 consensus_queue.cc:237] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:14:58.891302  4064 catalog_manager.cc:5697] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.995311  4236 raft_consensus.cc:1275] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:58.996685  5270 consensus_queue.cc:1048] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.014375  4313 raft_consensus.cc:1275] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.017889  5262 consensus_queue.cc:1048] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:59.030926  4309 raft_consensus.cc:1275] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.033556  5262 consensus_queue.cc:1048] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:59.042413  4314 raft_consensus.cc:1275] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:59.046204  5233 consensus_queue.cc:1048] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.051265  4386 raft_consensus.cc:1275] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.061088  5233 consensus_queue.cc:1048] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.112282  4236 raft_consensus.cc:1275] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 3 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:59.118367  5270 consensus_queue.cc:1048] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.271839  4236 raft_consensus.cc:1275] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.765496  5241 consensus_queue.cc:1048] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:59.446973 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:59.871773  4313 raft_consensus.cc:1275] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.930101  4235 raft_consensus.cc:1275] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.954419 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:59.959918  4235 raft_consensus.cc:1275] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.967316  4313 raft_consensus.cc:1275] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.967612  4311 raft_consensus.cc:1275] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.977627  5270 consensus_queue.cc:1048] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.989323  5292 consensus_queue.cc:1048] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.992044  5292 consensus_queue.cc:1048] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.032243  5292 consensus_queue.cc:1048] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.035521  5292 consensus_queue.cc:1048] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.046463  4235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53"
dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35520
I20260709 13:15:00.049250  4235 raft_consensus.cc:606] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:15:00.061753  4235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a48d172190094aa293e39aed636ea970"
dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35520
I20260709 13:15:00.062672  4235 raft_consensus.cc:606] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:15:00.072274  4235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b04569646f764da18b971041e8187bf1"
dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
mode: GRACEFUL
new_leader_uuid: "44912ba11bc04ab383e985aa41ec5b38"
 from {username='slave'} at 127.0.0.1:35520
I20260709 13:15:00.072937  4235 raft_consensus.cc:606] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Received request to transfer leadership to TS 44912ba11bc04ab383e985aa41ec5b38
I20260709 13:15:00.074862 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:00.077766 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:00.266117  4095 debug-util.cc:398] Leaking SignalData structure 0x7b0800260480 after lost signal to thread 27435
W20260709 13:15:00.267288  4095 debug-util.cc:398] Leaking SignalData structure 0x7b080013c2c0 after lost signal to thread 4098
W20260709 13:15:00.268420  4095 debug-util.cc:398] Leaking SignalData structure 0x7b08002603c0 after lost signal to thread 4265
W20260709 13:15:00.269444  4095 debug-util.cc:398] Leaking SignalData structure 0x7b080029cae0 after lost signal to thread 4339
W20260709 13:15:00.273540  4095 debug-util.cc:398] Leaking SignalData structure 0x7b0800311740 after lost signal to thread 4413
W20260709 13:15:00.274856  4095 debug-util.cc:398] Leaking SignalData structure 0x7b080020f1a0 after lost signal to thread 5146
I20260709 13:15:00.307986  5290 raft_consensus.cc:993] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:15:00.308666  5236 raft_consensus.cc:1081] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:15:00.311129  5107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35316
I20260709 13:15:00.311774  5107 raft_consensus.cc:493] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:00.313143  5107 raft_consensus.cc:3060] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.325162  5107 raft_consensus.cc:515] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:15:00.328277  5107 leader_election.cc:290] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:15:00.332233  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:15:00.332386  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c54676fa8be4fbcb6132a795b560f53" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:15:00.333158  4236 raft_consensus.cc:3055] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:00.333884  4309 raft_consensus.cc:3060] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.333581  4236 raft_consensus.cc:740] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:15:00.338846  4236 consensus_queue.cc:260] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:15:00.341895  4309 raft_consensus.cc:2468] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:15:00.342625  4236 raft_consensus.cc:3060] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.343741  4995 leader_election.cc:304] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974; no voters: 
I20260709 13:15:00.347398  5241 raft_consensus.cc:2804] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:00.347954  5241 raft_consensus.cc:697] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:15:00.348868  5241 consensus_queue.cc:237] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:15:00.356369  4236 raft_consensus.cc:2468] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:15:00.359549  5236 raft_consensus.cc:993] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:15:00.360080  5236 raft_consensus.cc:1081] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:15:00.369916  5290 raft_consensus.cc:993] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657: : Instructing follower 44912ba11bc04ab383e985aa41ec5b38 to start an election
I20260709 13:15:00.370518  5290 raft_consensus.cc:1081] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Signalling peer 44912ba11bc04ab383e985aa41ec5b38 to start an election
I20260709 13:15:00.375106  5105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a48d172190094aa293e39aed636ea970"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35316
I20260709 13:15:00.375859  5105 raft_consensus.cc:493] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:00.376287  5105 raft_consensus.cc:3060] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.375125  4314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b04569646f764da18b971041e8187bf1"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
 from {username='slave'} at 127.0.0.1:37890
I20260709 13:15:00.378456  4314 raft_consensus.cc:493] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:00.378975  4314 raft_consensus.cc:3060] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.392911  4314 raft_consensus.cc:515] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:15:00.393325  5105 raft_consensus.cc:515] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:15:00.396384  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:15:00.397107  4236 raft_consensus.cc:3055] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:00.395859  4314 leader_election.cc:290] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981)
I20260709 13:15:00.397373  4385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04569646f764da18b971041e8187bf1" candidate_uuid: "44912ba11bc04ab383e985aa41ec5b38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:15:00.398099  4385 raft_consensus.cc:3060] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.405730  4064 catalog_manager.cc:5697] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.397410  4236 raft_consensus.cc:740] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:15:00.409626  4236 consensus_queue.cc:260] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:15:00.411055  4236 raft_consensus.cc:3060] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.418933  4236 raft_consensus.cc:2468] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:15:00.420881  5105 leader_election.cc:290] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers c3b8bb2dfba041dea91b3e6775c34505 (127.26.202.4:36981), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
I20260709 13:15:00.426324  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d172190094aa293e39aed636ea970" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:15:00.428390  4236 raft_consensus.cc:3055] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:00.429431  4236 raft_consensus.cc:740] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecb7bdee23254ebbb5be4faa5795e657, State: Running, Role: LEADER
I20260709 13:15:00.432525  4236 consensus_queue.cc:260] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:15:00.434092  4236 raft_consensus.cc:3060] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.434821  4278 leader_election.cc:304] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44912ba11bc04ab383e985aa41ec5b38, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:15:00.441151  4384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a48d172190094aa293e39aed636ea970" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3b8bb2dfba041dea91b3e6775c34505"
I20260709 13:15:00.441614  5298 raft_consensus.cc:2804] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:00.442083  4384 raft_consensus.cc:3060] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.442276  5298 raft_consensus.cc:697] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Becoming Leader. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:15:00.443835  4385 raft_consensus.cc:2468] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44912ba11bc04ab383e985aa41ec5b38 in term 2.
I20260709 13:15:00.443686  5298 consensus_queue.cc:237] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } }
I20260709 13:15:00.449579  4236 raft_consensus.cc:2468] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:15:00.450851  4995 leader_election.cc:304] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:15:00.451802  5241 raft_consensus.cc:2804] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:00.452296  5241 raft_consensus.cc:697] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:15:00.453531  5241 consensus_queue.cc:237] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:15:00.456374  4384 raft_consensus.cc:2468] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:15:00.471256  4063 catalog_manager.cc:5697] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 reported cstate change: term changed from 1 to 2, leader changed from ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2) to 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "44912ba11bc04ab383e985aa41ec5b38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.495012  4063 catalog_manager.cc:5697] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:00.825577  4309 raft_consensus.cc:1275] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:00.826776  5270 consensus_queue.cc:1048] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.842716  4235 raft_consensus.cc:1275] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:00.845095  5300 consensus_queue.cc:1048] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.863111  4236 raft_consensus.cc:1275] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:00.872826  4384 raft_consensus.cc:1275] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 44912ba11bc04ab383e985aa41ec5b38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:00.874436  5302 consensus_queue.cc:1048] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.875031  5241 consensus_queue.cc:1048] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.918268  4388 raft_consensus.cc:1275] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:00.929651  5270 consensus_queue.cc:1048] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.934197  4236 raft_consensus.cc:1275] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:00.937216  5270 consensus_queue.cc:1048] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.078866 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:01.132025 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:01.170858  4309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b"
dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
mode: GRACEFUL
new_leader_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:41802
I20260709 13:15:01.171398  4309 raft_consensus.cc:606] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Received request to transfer leadership to TS 5579adc264d4484692d94b04f0b4f974
I20260709 13:15:01.172658 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:15:01.173991 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:01.418154  5302 raft_consensus.cc:993] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38: : Instructing follower 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:15:01.419303  5302 raft_consensus.cc:1081] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Signalling peer 5579adc264d4484692d94b04f0b4f974 to start an election
I20260709 13:15:01.435521  5105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b"
dest_uuid: "5579adc264d4484692d94b04f0b4f974"
 from {username='slave'} at 127.0.0.1:35306
I20260709 13:15:01.436726  5105 raft_consensus.cc:493] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:01.437391  5105 raft_consensus.cc:3060] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:01.472077  4352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:35505, user_credentials={real_user=slave}} blocked reactor thread for 44322.4us
I20260709 13:15:01.475404  5105 raft_consensus.cc:515] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:15:01.479825  5105 leader_election.cc:290] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Requested vote from peers ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405), 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505)
I20260709 13:15:01.499357  4236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecb7bdee23254ebbb5be4faa5795e657"
I20260709 13:15:01.500305  4236 raft_consensus.cc:3060] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.508801  4236 raft_consensus.cc:2468] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:15:01.510474  4309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7785a087d2b14d74a39cc2bcfd8e408b" candidate_uuid: "5579adc264d4484692d94b04f0b4f974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44912ba11bc04ab383e985aa41ec5b38"
I20260709 13:15:01.511258  4309 raft_consensus.cc:3055] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:01.511718  4309 raft_consensus.cc:740] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44912ba11bc04ab383e985aa41ec5b38, State: Running, Role: LEADER
I20260709 13:15:01.512938  4309 consensus_queue.cc:260] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:15:01.514564  4309 raft_consensus.cc:3060] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:01.514971  4236 raft_consensus.cc:1240] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Rejecting Update request from peer 44912ba11bc04ab383e985aa41ec5b38 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:01.531898  4309 raft_consensus.cc:2468] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5579adc264d4484692d94b04f0b4f974 in term 2.
I20260709 13:15:01.539503  4995 leader_election.cc:304] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657; no voters: 
I20260709 13:15:01.540544  5349 raft_consensus.cc:2804] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:01.541383  5349 raft_consensus.cc:697] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Becoming Leader. State: Replica: 5579adc264d4484692d94b04f0b4f974, State: Running, Role: LEADER
I20260709 13:15:01.542527  5349 consensus_queue.cc:237] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } }
I20260709 13:15:01.556635  4063 catalog_manager.cc:5697] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 reported cstate change: term changed from 1 to 2, leader changed from 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3) to 5579adc264d4484692d94b04f0b4f974 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "5579adc264d4484692d94b04f0b4f974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.140666  4309 raft_consensus.cc:1275] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:02.142684  5349 consensus_queue.cc:1048] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:02.156911  4236 raft_consensus.cc:1275] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Refusing update from remote peer 5579adc264d4484692d94b04f0b4f974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:02.175263 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:02.180895  5270 consensus_queue.cc:1048] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:02.273108 27432 tablet_server.cc:179] TabletServer@127.26.202.1:35785 shutting down...
W20260709 13:15:02.276386  4204 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 335 similar messages]
W20260709 13:15:02.293969  4204 consensus_peers.cc:597] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.312609  4204 consensus_peers.cc:597] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.327790  4204 consensus_peers.cc:597] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.330698  4352 consensus_peers.cc:597] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.337945  4278 consensus_peers.cc:597] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.348573  4204 consensus_peers.cc:597] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.349139  4278 consensus_peers.cc:597] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.351900  4278 consensus_peers.cc:597] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.352600  4278 consensus_peers.cc:597] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.362769 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:02.364477 27432 tablet_replica.cc:333] stopping tablet replica
W20260709 13:15:02.364845  4278 consensus_peers.cc:597] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.365784 27432 raft_consensus.cc:2243] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.366466 27432 raft_consensus.cc:2272] T fa55eb9f8d154841ba534af714307367 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.367404  4204 consensus_peers.cc:597] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.369963 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.371145 27432 raft_consensus.cc:2243] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.371734 27432 raft_consensus.cc:2272] T e8ed5b6d47f14476bba3acb7086b321e P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.374531  4278 consensus_peers.cc:597] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.375291 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.376370 27432 raft_consensus.cc:2243] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.376888 27432 raft_consensus.cc:2272] T 0ea9b5d28359489f94ce555295cfa1ed P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.379664 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.380463 27432 raft_consensus.cc:2243] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.381771 27432 raft_consensus.cc:2272] T 842c1af88b9a449eaf38dadb53be5452 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.384876  4204 consensus_peers.cc:597] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.385334 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.386049 27432 raft_consensus.cc:2243] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.386757 27432 raft_consensus.cc:2272] T 3edf1d07e3f84aad9c9bb382774c77a0 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.389369 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.390254 27432 raft_consensus.cc:2243] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.391498 27432 raft_consensus.cc:2272] T 21a1999637a0409fbafc5b729b043472 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.395010 27432 tablet_replica.cc:333] stopping tablet replica
W20260709 13:15:02.395871  4352 consensus_peers.cc:597] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.395931 27432 raft_consensus.cc:2243] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.396585 27432 raft_consensus.cc:2272] T c6a4b9478f394578ba05a6d2c9402d7c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.399242 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.399964 27432 raft_consensus.cc:2243] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.400490 27432 raft_consensus.cc:2272] T 41f0e5b41dc8442a8c42396f1323e8f7 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.403606 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.404407 27432 raft_consensus.cc:2243] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.404832 27432 raft_consensus.cc:2272] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.407424 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.408031 27432 raft_consensus.cc:2243] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.408870 27432 raft_consensus.cc:2272] T 6ed53a0a3d8540fcad750a907a09fa6b P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.411230 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.411919 27432 raft_consensus.cc:2243] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.412506 27432 raft_consensus.cc:2272] T d6fd7710f5714f70a0f2c2500729d68c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.415411 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.416110 27432 raft_consensus.cc:2243] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.417060 27432 raft_consensus.cc:2272] T f43e14aafd634647aacab29418de8662 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.419281 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.419917 27432 raft_consensus.cc:2243] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.420401 27432 raft_consensus.cc:2272] T f966b9e1356c4224a74a4b1f6e10fca5 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.422901 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.423538 27432 raft_consensus.cc:2243] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.424345 27432 raft_consensus.cc:2272] T 7785a087d2b14d74a39cc2bcfd8e408b P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.427647 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.428579 27432 raft_consensus.cc:2243] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.429278 27432 raft_consensus.cc:2272] T 476b62391a0c41cba2d9c578b2e05b4e P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.432767 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.433525 27432 raft_consensus.cc:2243] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.434003 27432 raft_consensus.cc:2272] T c157a34e361841ed97d83cab3e137e59 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.434094  4204 consensus_peers.cc:597] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.437084 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.437742 27432 raft_consensus.cc:2243] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.438199 27432 raft_consensus.cc:2272] T 53ab991adb234419a39cef0dd745b8fc P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.440845 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.441907 27432 raft_consensus.cc:2243] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.442500 27432 raft_consensus.cc:2272] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.445580 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.446318 27432 raft_consensus.cc:2243] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.447301 27432 raft_consensus.cc:2272] T 9bf65ed933a94d2781c82e8e3145354a P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.449976 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.450538 27432 raft_consensus.cc:2243] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.451092 27432 raft_consensus.cc:2272] T 739d61d00a4f4a2688668ab2a87b2b44 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.454300 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.455011 27432 raft_consensus.cc:2243] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.455960 27432 raft_consensus.cc:2272] T 752f5e425310433598dde61b0db31f15 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.458564 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.459381 27432 raft_consensus.cc:2243] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.459992 27432 raft_consensus.cc:2272] T fb735e4fccce42b2a96e24b96915088a P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.462783 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.463351 27432 raft_consensus.cc:2243] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.463838 27432 raft_consensus.cc:2272] T 65e836aa87f0415ab357635172010986 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.466127 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.466719 27432 raft_consensus.cc:2243] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.467571 27432 raft_consensus.cc:2272] T 469c95e4231846a7b411bc8e662f7897 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.470021 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.470670 27432 raft_consensus.cc:2243] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.471150 27432 raft_consensus.cc:2272] T e17a5871d73843d9867ab8076cbd10ac P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.473786 27432 tablet_replica.cc:333] stopping tablet replica
W20260709 13:15:02.474172  4204 consensus_peers.cc:597] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.474970 27432 raft_consensus.cc:2243] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.475636 27432 raft_consensus.cc:2272] T bf28675179d3498593c326d198268cc9 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.477723  4204 consensus_peers.cc:597] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.479112 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.480180 27432 raft_consensus.cc:2243] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.480752 27432 raft_consensus.cc:2272] T 9d73dfdf505542c191c5ec6047bb5fcb P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.481870  4278 consensus_peers.cc:597] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.484056 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.484903 27432 raft_consensus.cc:2243] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.485657 27432 raft_consensus.cc:2272] T cebbff40bd944f06b60fe91902f8e57a P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.488478 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.489228 27432 raft_consensus.cc:2243] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.490135 27432 raft_consensus.cc:2272] T cea19effc04e4a57bfe81c26a27db285 P 5579adc264d4484692d94b04f0b4f974 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.492605 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.493382 27432 raft_consensus.cc:2243] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.493832 27432 raft_consensus.cc:2272] T d79b38c9325e4a73a58f685c1a82a83c P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.497108 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.498040 27432 raft_consensus.cc:2243] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:15:02.498123  4204 consensus_peers.cc:597] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.499286 27432 raft_consensus.cc:2272] T 400506e66b634f6fbfc45dcc033f64f2 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.501775 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.502384 27432 raft_consensus.cc:2243] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.502908 27432 raft_consensus.cc:2272] T eb795975f5724d21aea741fdb7dc678a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.505383 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.505986 27432 raft_consensus.cc:2243] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.506594 27432 raft_consensus.cc:2272] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.510200 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.511066 27432 raft_consensus.cc:2243] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.511642 27432 raft_consensus.cc:2272] T e5ebbec07a3541cbada5d5e7bbb65f60 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.512154  4278 consensus_peers.cc:597] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.514256  4278 consensus_peers.cc:597] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.515264 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.516319 27432 raft_consensus.cc:2243] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.516907 27432 raft_consensus.cc:2272] T 3569c9c3631041cc8cd59b958fd9b9e5 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.519444  4352 consensus_peers.cc:597] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.520328 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.521375 27432 raft_consensus.cc:2243] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.521955 27432 raft_consensus.cc:2272] T 34d3c8a715e14f2cb977c6ad59220712 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.522974  4278 consensus_peers.cc:597] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.524889 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.525699 27432 raft_consensus.cc:2243] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.526224 27432 raft_consensus.cc:2272] T 8f45a6a6cb72448ba6e261d361a0f446 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.528698 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.529330 27432 raft_consensus.cc:2243] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.530383 27432 raft_consensus.cc:2272] T f0f420ee7d254e55a1a16267eb181e9a P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.533905 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.534761 27432 raft_consensus.cc:2243] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.535914 27432 raft_consensus.cc:2272] T a48d172190094aa293e39aed636ea970 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.539016 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.539796 27432 raft_consensus.cc:2243] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.540392 27432 raft_consensus.cc:2272] T 90cf1309a8c14cb4aef37461b8eb906c P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.543704 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.544483 27432 raft_consensus.cc:2243] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.545080 27432 raft_consensus.cc:2272] T fc74b88e70804c2ba5f2b32882e1043a P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.548281 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.548949 27432 raft_consensus.cc:2243] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.549600 27432 raft_consensus.cc:2272] T 6ced5da688734c378b6fa628fca1e639 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.552176 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.552853 27432 raft_consensus.cc:2243] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.553997 27432 raft_consensus.cc:2272] T 7c54676fa8be4fbcb6132a795b560f53 P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.557228 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.558059 27432 raft_consensus.cc:2243] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.558472 27432 raft_consensus.cc:2272] T f9e515c59fdd462087377434a2fda3aa P 5579adc264d4484692d94b04f0b4f974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.560635 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:02.561211 27432 raft_consensus.cc:2243] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.561631 27432 raft_consensus.cc:2272] T 3c201d492968497482b2b8432e5fbf37 P 5579adc264d4484692d94b04f0b4f974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.596992  4278 consensus_peers.cc:597] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.639523 27432 tablet_server.cc:196] TabletServer@127.26.202.1:35785 shutdown complete.
W20260709 13:15:02.640339  4204 consensus_peers.cc:597] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.659078  4352 consensus_peers.cc:597] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.679493  4352 consensus_peers.cc:597] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.686157  4352 consensus_peers.cc:597] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.728055  4352 consensus_peers.cc:597] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.738507 27432 tablet_server.cc:179] TabletServer@127.26.202.2:0 shutting down...
W20260709 13:15:02.746335  4278 consensus_peers.cc:597] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.748101  4352 consensus_peers.cc:597] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.787292  4352 consensus_peers.cc:597] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.789822  4352 consensus_peers.cc:597] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.792915 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:02.794236 27432 tablet_replica.cc:333] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.796751 27432 raft_consensus.cc:2243] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.797725 27432 raft_consensus.cc:2272] T 842c1af88b9a449eaf38dadb53be5452 P ecb7bdee23254ebbb5be4faa5795e657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.801127 27432 tablet_replica.cc:333] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.802419 27432 raft_consensus.cc:2243] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.803109 27432 raft_consensus.cc:2272] T 6ced5da688734c378b6fa628fca1e639 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.806054 27432 tablet_replica.cc:333] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.806838 27432 raft_consensus.cc:2243] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.807446 27432 raft_consensus.cc:2272] T 7c54676fa8be4fbcb6132a795b560f53 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.810585 27432 tablet_replica.cc:333] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
W20260709 13:15:02.812644  4352 consensus_peers.cc:597] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.812739 27432 raft_consensus.cc:2243] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.815056 27432 raft_consensus.cc:2272] T e17a5871d73843d9867ab8076cbd10ac P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.818189 27432 tablet_replica.cc:333] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.819134 27432 raft_consensus.cc:2243] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.819685 27432 raft_consensus.cc:2272] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.821820  4352 consensus_peers.cc:597] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Couldn't send request to peer 5579adc264d4484692d94b04f0b4f974. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.822773 27432 tablet_replica.cc:333] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.823805 27432 raft_consensus.cc:2243] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.824431 27432 raft_consensus.cc:2272] T 476b62391a0c41cba2d9c578b2e05b4e P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.828168 27432 tablet_replica.cc:333] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.829319 27432 raft_consensus.cc:2243] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.830838 27432 raft_consensus.cc:2272] T f9e515c59fdd462087377434a2fda3aa P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.833181 27432 tablet_replica.cc:333] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.833901 27432 raft_consensus.cc:2243] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.834384 27432 raft_consensus.cc:2272] T fcb55c5197494054ac66ee0284bc1234 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.836704 27432 tablet_replica.cc:333] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.837585 27432 raft_consensus.cc:2243] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.838078 27432 raft_consensus.cc:2272] T c6a4b9478f394578ba05a6d2c9402d7c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.840163 27432 tablet_replica.cc:333] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.840771 27432 raft_consensus.cc:2243] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.841249 27432 raft_consensus.cc:2272] T 762ce0ab18a64b88be473be55dedb1a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.843503 27432 tablet_replica.cc:333] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.844357 27432 raft_consensus.cc:2243] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.845062 27432 raft_consensus.cc:2272] T cebbff40bd944f06b60fe91902f8e57a P ecb7bdee23254ebbb5be4faa5795e657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.847594 27432 tablet_replica.cc:333] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.848328 27432 raft_consensus.cc:2243] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.849378 27432 raft_consensus.cc:2272] T 9d73dfdf505542c191c5ec6047bb5fcb P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.853826 27432 tablet_replica.cc:333] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.854661 27432 raft_consensus.cc:2243] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.855165 27432 raft_consensus.cc:2272] T da6d778f3b244e66937e6d76ff2e1062 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.857935 27432 tablet_replica.cc:333] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.859124 27432 raft_consensus.cc:2243] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.860594 27432 raft_consensus.cc:2272] T 3c201d492968497482b2b8432e5fbf37 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.865073 27432 tablet_replica.cc:333] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.865950 27432 raft_consensus.cc:2243] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.866559 27432 raft_consensus.cc:2272] T 6ed53a0a3d8540fcad750a907a09fa6b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.869248  4278 consensus_peers.cc:597] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.869622 27432 tablet_replica.cc:333] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.870654 27432 raft_consensus.cc:2243] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.871699 27432 raft_consensus.cc:2272] T c98f6e00475941138b7b84fa7c833346 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.874789 27432 tablet_replica.cc:333] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.875641 27432 raft_consensus.cc:2243] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.876253 27432 raft_consensus.cc:2272] T 3f70326950f444e7ac889e0c48b46af4 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.879882 27432 tablet_replica.cc:333] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.880681 27432 raft_consensus.cc:2243] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:02.881440  4352 consensus_peers.cc:597] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.881923 27432 raft_consensus.cc:2272] T 0ea9b5d28359489f94ce555295cfa1ed P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.886829 27432 tablet_replica.cc:333] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.887737 27432 raft_consensus.cc:2243] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.888350 27432 raft_consensus.cc:2272] T 34d3c8a715e14f2cb977c6ad59220712 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.891747 27432 tablet_replica.cc:333] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.892774 27432 raft_consensus.cc:2243] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.893784 27432 raft_consensus.cc:2272] T e5ebbec07a3541cbada5d5e7bbb65f60 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.896777 27432 tablet_replica.cc:333] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
W20260709 13:15:02.897660  4352 consensus_peers.cc:597] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.897750 27432 raft_consensus.cc:2243] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.899504 27432 raft_consensus.cc:2272] T 54e3336557ec4724bcb643f2bb5728a6 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.902312 27432 tablet_replica.cc:333] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.903193 27432 raft_consensus.cc:2243] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.903765 27432 raft_consensus.cc:2272] T b80801dd62bc4b0894771a460938aa71 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.906477 27432 tablet_replica.cc:333] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.907313 27432 raft_consensus.cc:2243] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.907979 27432 raft_consensus.cc:2272] T a48d172190094aa293e39aed636ea970 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.912338  4278 consensus_peers.cc:597] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.911089 27432 tablet_replica.cc:333] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.913630 27432 raft_consensus.cc:2243] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.914757 27432 raft_consensus.cc:2272] T 90cf1309a8c14cb4aef37461b8eb906c P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:02.914762  4352 consensus_peers.cc:597] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.918171 27432 tablet_replica.cc:333] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.918987 27432 raft_consensus.cc:2243] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.919524 27432 raft_consensus.cc:2272] T 7785a087d2b14d74a39cc2bcfd8e408b P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.922690 27432 tablet_replica.cc:333] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.923386 27432 raft_consensus.cc:2243] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.924808 27432 raft_consensus.cc:2272] T 6775419b4ff84b9998e052bce5db37ef P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.927238 27432 tablet_replica.cc:333] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.928015 27432 raft_consensus.cc:2243] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.928604 27432 raft_consensus.cc:2272] T f4e8c02c3d29423eb6b91bb28f5e7666 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.931371 27432 tablet_replica.cc:333] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.932137 27432 raft_consensus.cc:2243] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.932742 27432 raft_consensus.cc:2272] T b04569646f764da18b971041e8187bf1 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.935501 27432 tablet_replica.cc:333] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.936297 27432 raft_consensus.cc:2243] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.937423 27432 raft_consensus.cc:2272] T b82fde8e022a4d05bc9940a384ce326a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.940424 27432 tablet_replica.cc:333] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
W20260709 13:15:02.940953  4352 consensus_peers.cc:597] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.941308 27432 raft_consensus.cc:2243] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:02.941658  4352 consensus_peers.cc:597] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.941969 27432 raft_consensus.cc:2272] T 1f31b1c5c2a1430fbb22163bc29c247f P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.944528 27432 tablet_replica.cc:333] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.945390 27432 raft_consensus.cc:2243] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.946020 27432 raft_consensus.cc:2272] T f43e14aafd634647aacab29418de8662 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.948833 27432 tablet_replica.cc:333] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.949534 27432 raft_consensus.cc:2243] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.950450 27432 raft_consensus.cc:2272] T d6fd7710f5714f70a0f2c2500729d68c P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.952590 27432 tablet_replica.cc:333] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.953301 27432 raft_consensus.cc:2243] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.953771 27432 raft_consensus.cc:2272] T 2dfea592b3be44feb8ed92ca07526a44 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.956176 27432 tablet_replica.cc:333] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.956746 27432 raft_consensus.cc:2243] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.957226 27432 raft_consensus.cc:2272] T 400506e66b634f6fbfc45dcc033f64f2 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.959239 27432 tablet_replica.cc:333] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.959815 27432 raft_consensus.cc:2243] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.960268 27432 raft_consensus.cc:2272] T be46b7b34a104332852aedf71a934cb3 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.962564 27432 tablet_replica.cc:333] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.963177 27432 raft_consensus.cc:2243] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.963662 27432 raft_consensus.cc:2272] T eb795975f5724d21aea741fdb7dc678a P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.966013 27432 tablet_replica.cc:333] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.966593 27432 raft_consensus.cc:2243] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.967433 27432 raft_consensus.cc:2272] T 53ab991adb234419a39cef0dd745b8fc P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.970791 27432 tablet_replica.cc:333] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.971553 27432 raft_consensus.cc:2243] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.972628 27432 raft_consensus.cc:2272] T c157a34e361841ed97d83cab3e137e59 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.975896 27432 tablet_replica.cc:333] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.976728 27432 raft_consensus.cc:2243] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:02.977834 27432 raft_consensus.cc:2272] T e8ed5b6d47f14476bba3acb7086b321e P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.980430 27432 tablet_replica.cc:333] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.981127 27432 raft_consensus.cc:2243] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.981710 27432 raft_consensus.cc:2272] T 9bf65ed933a94d2781c82e8e3145354a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.984406 27432 tablet_replica.cc:333] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.985165 27432 raft_consensus.cc:2243] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.985670 27432 raft_consensus.cc:2272] T 739d61d00a4f4a2688668ab2a87b2b44 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.987972 27432 tablet_replica.cc:333] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.988543 27432 raft_consensus.cc:2243] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.989090 27432 raft_consensus.cc:2272] T 65e836aa87f0415ab357635172010986 P ecb7bdee23254ebbb5be4faa5795e657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.991253 27432 tablet_replica.cc:333] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.991793 27432 raft_consensus.cc:2243] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.992280 27432 raft_consensus.cc:2272] T 752f5e425310433598dde61b0db31f15 P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:02.994899 27432 tablet_replica.cc:333] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657: stopping tablet replica
I20260709 13:15:02.995613 27432 raft_consensus.cc:2243] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:02.996166 27432 raft_consensus.cc:2272] T fb735e4fccce42b2a96e24b96915088a P ecb7bdee23254ebbb5be4faa5795e657 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:03.017345  4278 consensus_peers.cc:597] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:03.045073  4352 consensus_peers.cc:597] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:03.045730  4278 consensus_peers.cc:597] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.083581 27432 tablet_server.cc:196] TabletServer@127.26.202.2:0 shutdown complete.
W20260709 13:15:03.104763  4352 consensus_peers.cc:597] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:41405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:03.130467  4278 consensus_peers.cc:597] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:41405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:03.164371  4278 consensus_peers.cc:597] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:41405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.172802 27432 tablet_server.cc:179] TabletServer@127.26.202.3:0 shutting down...
W20260709 13:15:03.184995  4352 consensus_peers.cc:597] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:41405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:03.207779  4352 consensus_peers.cc:597] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:41405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.221791 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:03.224684 27432 tablet_replica.cc:333] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.225555 27432 raft_consensus.cc:2243] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:03.226078  4278 consensus_peers.cc:597] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 -> Peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Couldn't send request to peer ecb7bdee23254ebbb5be4faa5795e657. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:41405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.226145 27432 raft_consensus.cc:2272] T 7c54676fa8be4fbcb6132a795b560f53 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.228773 27432 tablet_replica.cc:333] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.229724 27432 raft_consensus.cc:2243] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.230552 27432 raft_consensus.cc:2272] T 476b62391a0c41cba2d9c578b2e05b4e P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.232717 27432 tablet_replica.cc:333] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.233362 27432 raft_consensus.cc:2243] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.233803 27432 raft_consensus.cc:2272] T da6d778f3b244e66937e6d76ff2e1062 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.236312 27432 tablet_replica.cc:333] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.236999 27432 raft_consensus.cc:2243] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.237596 27432 raft_consensus.cc:2272] T 842c1af88b9a449eaf38dadb53be5452 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:03.239022  4352 consensus_peers.cc:597] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.240008 27432 tablet_replica.cc:333] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.240681 27432 raft_consensus.cc:2243] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.241150 27432 raft_consensus.cc:2272] T 9bf65ed933a94d2781c82e8e3145354a P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.243263 27432 tablet_replica.cc:333] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.243850 27432 raft_consensus.cc:2243] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.244815 27432 raft_consensus.cc:2272] T fcb55c5197494054ac66ee0284bc1234 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.247288 27432 tablet_replica.cc:333] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.247960 27432 raft_consensus.cc:2243] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:03.248590  4352 consensus_peers.cc:597] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.248915 27432 raft_consensus.cc:2272] T 65e836aa87f0415ab357635172010986 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.251143 27432 tablet_replica.cc:333] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.251936 27432 raft_consensus.cc:2243] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.252532 27432 raft_consensus.cc:2272] T 752f5e425310433598dde61b0db31f15 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.255172 27432 tablet_replica.cc:333] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.256033 27432 raft_consensus.cc:2243] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:03.257053  4352 consensus_peers.cc:597] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.257213 27432 raft_consensus.cc:2272] T fa55eb9f8d154841ba534af714307367 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.260141 27432 tablet_replica.cc:333] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.260753 27432 raft_consensus.cc:2243] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.261582 27432 raft_consensus.cc:2272] T bf28675179d3498593c326d198268cc9 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.264405 27432 tablet_replica.cc:333] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.265230 27432 raft_consensus.cc:2243] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.265811 27432 raft_consensus.cc:2272] T 762ce0ab18a64b88be473be55dedb1a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.268823 27432 tablet_replica.cc:333] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.269466 27432 raft_consensus.cc:2243] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.269913 27432 raft_consensus.cc:2272] T 469c95e4231846a7b411bc8e662f7897 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.272205 27432 tablet_replica.cc:333] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.272778 27432 raft_consensus.cc:2243] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.273295 27432 raft_consensus.cc:2272] T e5ebbec07a3541cbada5d5e7bbb65f60 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.275264 27432 tablet_replica.cc:333] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.275822 27432 raft_consensus.cc:2243] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.276264 27432 raft_consensus.cc:2272] T f0f420ee7d254e55a1a16267eb181e9a P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.278822 27432 tablet_replica.cc:333] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.279793 27432 raft_consensus.cc:2243] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.280857 27432 raft_consensus.cc:2272] T 8f45a6a6cb72448ba6e261d361a0f446 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.283928 27432 tablet_replica.cc:333] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.284921 27432 raft_consensus.cc:2243] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.286046 27432 raft_consensus.cc:2272] T d79b38c9325e4a73a58f685c1a82a83c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.289193 27432 tablet_replica.cc:333] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.290037 27432 raft_consensus.cc:2243] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.290613 27432 raft_consensus.cc:2272] T cea19effc04e4a57bfe81c26a27db285 P 44912ba11bc04ab383e985aa41ec5b38 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:03.291939  4352 consensus_peers.cc:597] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.293545 27432 tablet_replica.cc:333] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.294446 27432 raft_consensus.cc:2243] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.295503 27432 raft_consensus.cc:2272] T 1f31b1c5c2a1430fbb22163bc29c247f P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.298651 27432 tablet_replica.cc:333] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.299484 27432 raft_consensus.cc:2243] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.300061 27432 raft_consensus.cc:2272] T d6fd7710f5714f70a0f2c2500729d68c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.302803 27432 tablet_replica.cc:333] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.303653 27432 raft_consensus.cc:2243] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.304145 27432 raft_consensus.cc:2272] T f43e14aafd634647aacab29418de8662 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.306856 27432 tablet_replica.cc:333] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.307778 27432 raft_consensus.cc:2243] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.308310 27432 raft_consensus.cc:2272] T e8ed5b6d47f14476bba3acb7086b321e P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.311280 27432 tablet_replica.cc:333] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.312135 27432 raft_consensus.cc:2243] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.312729 27432 raft_consensus.cc:2272] T 2dfea592b3be44feb8ed92ca07526a44 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.315799 27432 tablet_replica.cc:333] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.316427 27432 raft_consensus.cc:2243] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.316952 27432 raft_consensus.cc:2272] T 400506e66b634f6fbfc45dcc033f64f2 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.319238 27432 tablet_replica.cc:333] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.320066 27432 raft_consensus.cc:2243] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.320570 27432 raft_consensus.cc:2272] T be46b7b34a104332852aedf71a934cb3 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.322960 27432 tablet_replica.cc:333] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.323760 27432 raft_consensus.cc:2243] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.324828 27432 raft_consensus.cc:2272] T eb795975f5724d21aea741fdb7dc678a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.327950 27432 tablet_replica.cc:333] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.328775 27432 raft_consensus.cc:2243] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.329326 27432 raft_consensus.cc:2272] T 3569c9c3631041cc8cd59b958fd9b9e5 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.332149 27432 tablet_replica.cc:333] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.332981 27432 raft_consensus.cc:2243] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.333547 27432 raft_consensus.cc:2272] T 54e3336557ec4724bcb643f2bb5728a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.336607 27432 tablet_replica.cc:333] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.337376 27432 raft_consensus.cc:2243] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.337898 27432 raft_consensus.cc:2272] T fc74b88e70804c2ba5f2b32882e1043a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.340693 27432 tablet_replica.cc:333] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.341545 27432 raft_consensus.cc:2243] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.342589 27432 raft_consensus.cc:2272] T b80801dd62bc4b0894771a460938aa71 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.345371 27432 tablet_replica.cc:333] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.346148 27432 raft_consensus.cc:2243] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.346678 27432 raft_consensus.cc:2272] T f966b9e1356c4224a74a4b1f6e10fca5 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.349413 27432 tablet_replica.cc:333] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.350148 27432 raft_consensus.cc:2243] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.350615 27432 raft_consensus.cc:2272] T 7785a087d2b14d74a39cc2bcfd8e408b P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.353178 27432 tablet_replica.cc:333] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.353940 27432 raft_consensus.cc:2243] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.354918 27432 raft_consensus.cc:2272] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:03.355600  4352 consensus_peers.cc:597] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:03.356251  4352 consensus_peers.cc:597] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.357769 27432 tablet_replica.cc:333] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.358707 27432 raft_consensus.cc:2243] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.359216 27432 raft_consensus.cc:2272] T 6775419b4ff84b9998e052bce5db37ef P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.362243 27432 tablet_replica.cc:333] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.363144 27432 raft_consensus.cc:2243] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.364041 27432 raft_consensus.cc:2272] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.366875 27432 tablet_replica.cc:333] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.367672 27432 raft_consensus.cc:2243] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.368273 27432 raft_consensus.cc:2272] T 6ed53a0a3d8540fcad750a907a09fa6b P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.371680 27432 tablet_replica.cc:333] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.372885 27432 raft_consensus.cc:2243] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.373485 27432 raft_consensus.cc:2272] T c98f6e00475941138b7b84fa7c833346 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.376330 27432 tablet_replica.cc:333] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.377156 27432 raft_consensus.cc:2243] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.377589 27432 raft_consensus.cc:2272] T f4e8c02c3d29423eb6b91bb28f5e7666 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.379599 27432 tablet_replica.cc:333] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.380373 27432 raft_consensus.cc:2243] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.381744 27432 raft_consensus.cc:2272] T b04569646f764da18b971041e8187bf1 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.383715 27432 tablet_replica.cc:333] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.384238 27432 raft_consensus.cc:2243] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.384977 27432 raft_consensus.cc:2272] T 41f0e5b41dc8442a8c42396f1323e8f7 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.387061 27432 tablet_replica.cc:333] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.387538 27432 raft_consensus.cc:2243] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.388270 27432 raft_consensus.cc:2272] T c6a4b9478f394578ba05a6d2c9402d7c P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.390599 27432 tablet_replica.cc:333] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.391125 27432 raft_consensus.cc:2243] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.391558 27432 raft_consensus.cc:2272] T 21a1999637a0409fbafc5b729b043472 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.393666 27432 tablet_replica.cc:333] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.394224 27432 raft_consensus.cc:2243] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.394663 27432 raft_consensus.cc:2272] T 3edf1d07e3f84aad9c9bb382774c77a0 P 44912ba11bc04ab383e985aa41ec5b38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.396647 27432 tablet_replica.cc:333] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.397228 27432 raft_consensus.cc:2243] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.397739 27432 raft_consensus.cc:2272] T b82fde8e022a4d05bc9940a384ce326a P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.400033 27432 tablet_replica.cc:333] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38: stopping tablet replica
I20260709 13:15:03.400570 27432 raft_consensus.cc:2243] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.401084 27432 raft_consensus.cc:2272] T 3f70326950f444e7ac889e0c48b46af4 P 44912ba11bc04ab383e985aa41ec5b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.419654  5371 raft_consensus.cc:493] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:15:03.420300  5371 raft_consensus.cc:515] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:15:03.422597  5371 leader_election.cc:290] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
W20260709 13:15:03.425729  4352 leader_election.cc:336] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:03.428349  4352 leader_election.cc:336] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:15:03.429052  4352 leader_election.cc:304] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:15:03.429917  5371 raft_consensus.cc:2749] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:03.442595  5371 raft_consensus.cc:493] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:15:03.443526  5371 raft_consensus.cc:515] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:15:03.446609  5371 leader_election.cc:290] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
W20260709 13:15:03.452674  4352 leader_election.cc:336] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:03.454182  4352 leader_election.cc:336] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:15:03.454543  4352 leader_election.cc:304] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:15:03.455164  5371 raft_consensus.cc:2749] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:03.488776 27432 tablet_server.cc:196] TabletServer@127.26.202.3:0 shutdown complete.
W20260709 13:15:03.522823  4352 consensus_peers.cc:597] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.3:35505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.558152 27432 tablet_server.cc:179] TabletServer@127.26.202.4:0 shutting down...
I20260709 13:15:03.561233  5371 raft_consensus.cc:493] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:15:03.561986  5371 raft_consensus.cc:515] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } } peers { permanent_uuid: "ecb7bdee23254ebbb5be4faa5795e657" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 41405 } }
I20260709 13:15:03.564220  5371 leader_election.cc:290] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785), ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405)
W20260709 13:15:03.568522  4352 leader_election.cc:336] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ecb7bdee23254ebbb5be4faa5795e657 (127.26.202.2:41405): Network error: Client connection negotiation failed: client connection to 127.26.202.2:41405: connect: Connection refused (error 111)
W20260709 13:15:03.569628  4352 leader_election.cc:336] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:15:03.569954  4352 leader_election.cc:304] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 5579adc264d4484692d94b04f0b4f974, ecb7bdee23254ebbb5be4faa5795e657
I20260709 13:15:03.570569  5371 raft_consensus.cc:2749] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:03.581714  4352 consensus_peers.cc:597] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.3:35505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.586654  5371 raft_consensus.cc:493] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5579adc264d4484692d94b04f0b4f974)
I20260709 13:15:03.587379  5371 raft_consensus.cc:515] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44912ba11bc04ab383e985aa41ec5b38" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 35505 } } peers { permanent_uuid: "c3b8bb2dfba041dea91b3e6775c34505" member_type: VOTER last_known_addr { host: "127.26.202.4" port: 36981 } } peers { permanent_uuid: "5579adc264d4484692d94b04f0b4f974" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 35785 } }
I20260709 13:15:03.589191  5371 leader_election.cc:290] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505), 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785)
W20260709 13:15:03.595729  4352 leader_election.cc:336] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Network error: Client connection negotiation failed: client connection to 127.26.202.3:35505: connect: Connection refused (error 111)
W20260709 13:15:03.596913  4352 leader_election.cc:336] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5579adc264d4484692d94b04f0b4f974 (127.26.202.1:35785): Network error: Client connection negotiation failed: client connection to 127.26.202.1:35785: connect: Connection refused (error 111)
I20260709 13:15:03.597345  4352 leader_election.cc:304] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3b8bb2dfba041dea91b3e6775c34505; no voters: 44912ba11bc04ab383e985aa41ec5b38, 5579adc264d4484692d94b04f0b4f974
I20260709 13:15:03.598066  5371 raft_consensus.cc:2749] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:03.611805 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:03.612957 27432 tablet_replica.cc:333] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.614396 27432 raft_consensus.cc:2243] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.615597 27432 raft_consensus.cc:2272] T 6ced5da688734c378b6fa628fca1e639 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.618115 27432 tablet_replica.cc:333] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.618752 27432 raft_consensus.cc:2243] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.619215 27432 raft_consensus.cc:2272] T e17a5871d73843d9867ab8076cbd10ac P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.621284 27432 tablet_replica.cc:333] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.621841 27432 raft_consensus.cc:2243] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.622260 27432 raft_consensus.cc:2272] T 1f31b1c5c2a1430fbb22163bc29c247f P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.624310 27432 tablet_replica.cc:333] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.624922 27432 raft_consensus.cc:2243] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.625780 27432 raft_consensus.cc:2272] T a9bbf2e5f1eb4b198b54c28a89a20bc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.627960 27432 tablet_replica.cc:333] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.628657 27432 raft_consensus.cc:2243] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.629194 27432 raft_consensus.cc:2272] T fcb55c5197494054ac66ee0284bc1234 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.631786 27432 tablet_replica.cc:333] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.632357 27432 raft_consensus.cc:2243] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:03.632504  4352 consensus_peers.cc:597] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 -> Peer 44912ba11bc04ab383e985aa41ec5b38 (127.26.202.3:35505): Couldn't send request to peer 44912ba11bc04ab383e985aa41ec5b38. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.3:35505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:03.632798 27432 raft_consensus.cc:2272] T f9e515c59fdd462087377434a2fda3aa P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.635110 27432 tablet_replica.cc:333] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.635763 27432 raft_consensus.cc:2243] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.636237 27432 raft_consensus.cc:2272] T bf28675179d3498593c326d198268cc9 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.638391 27432 tablet_replica.cc:333] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.638988 27432 raft_consensus.cc:2243] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.639811 27432 raft_consensus.cc:2272] T 762ce0ab18a64b88be473be55dedb1a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.641891 27432 tablet_replica.cc:333] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.642467 27432 raft_consensus.cc:2243] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.642912 27432 raft_consensus.cc:2272] T fa55eb9f8d154841ba534af714307367 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.644908 27432 tablet_replica.cc:333] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.645678 27432 raft_consensus.cc:2243] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.646130 27432 raft_consensus.cc:2272] T 9d73dfdf505542c191c5ec6047bb5fcb P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.648181 27432 tablet_replica.cc:333] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.648837 27432 raft_consensus.cc:2243] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.649304 27432 raft_consensus.cc:2272] T 469c95e4231846a7b411bc8e662f7897 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.651331 27432 tablet_replica.cc:333] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.652046 27432 raft_consensus.cc:2243] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.652951 27432 raft_consensus.cc:2272] T fb735e4fccce42b2a96e24b96915088a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.655239 27432 tablet_replica.cc:333] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.655921 27432 raft_consensus.cc:2243] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.656822 27432 raft_consensus.cc:2272] T da6d778f3b244e66937e6d76ff2e1062 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.658981 27432 tablet_replica.cc:333] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.659627 27432 raft_consensus.cc:2243] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.660115 27432 raft_consensus.cc:2272] T 3c201d492968497482b2b8432e5fbf37 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.662276 27432 tablet_replica.cc:333] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.662878 27432 raft_consensus.cc:2243] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.663723 27432 raft_consensus.cc:2272] T f4e8c02c3d29423eb6b91bb28f5e7666 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.666044 27432 tablet_replica.cc:333] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.666694 27432 raft_consensus.cc:2243] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.667166 27432 raft_consensus.cc:2272] T d79b38c9325e4a73a58f685c1a82a83c P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.669229 27432 tablet_replica.cc:333] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.669816 27432 raft_consensus.cc:2243] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.670634 27432 raft_consensus.cc:2272] T cebbff40bd944f06b60fe91902f8e57a P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.672724 27432 tablet_replica.cc:333] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.673557 27432 raft_consensus.cc:2243] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.674163 27432 raft_consensus.cc:2272] T cea19effc04e4a57bfe81c26a27db285 P c3b8bb2dfba041dea91b3e6775c34505 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.676507 27432 tablet_replica.cc:333] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.677224 27432 raft_consensus.cc:2243] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.677699 27432 raft_consensus.cc:2272] T 41f0e5b41dc8442a8c42396f1323e8f7 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.679868 27432 tablet_replica.cc:333] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.680457 27432 raft_consensus.cc:2243] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.680933 27432 raft_consensus.cc:2272] T 21a1999637a0409fbafc5b729b043472 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.683102 27432 tablet_replica.cc:333] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.683801 27432 raft_consensus.cc:2243] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.684315 27432 raft_consensus.cc:2272] T 3edf1d07e3f84aad9c9bb382774c77a0 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.686767 27432 tablet_replica.cc:333] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.687635 27432 raft_consensus.cc:2243] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.688177 27432 raft_consensus.cc:2272] T b82fde8e022a4d05bc9940a384ce326a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.690982 27432 tablet_replica.cc:333] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.691785 27432 raft_consensus.cc:2243] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.692590 27432 raft_consensus.cc:2272] T 3f70326950f444e7ac889e0c48b46af4 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.694856 27432 tablet_replica.cc:333] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.695540 27432 raft_consensus.cc:2243] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.695991 27432 raft_consensus.cc:2272] T 0ea9b5d28359489f94ce555295cfa1ed P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.698099 27432 tablet_replica.cc:333] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.698637 27432 raft_consensus.cc:2243] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.699400 27432 raft_consensus.cc:2272] T 2dfea592b3be44feb8ed92ca07526a44 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.701620 27432 tablet_replica.cc:333] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.702157 27432 raft_consensus.cc:2243] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.702943 27432 raft_consensus.cc:2272] T be46b7b34a104332852aedf71a934cb3 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.705178 27432 tablet_replica.cc:333] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.705696 27432 raft_consensus.cc:2243] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.706094 27432 raft_consensus.cc:2272] T 53ab991adb234419a39cef0dd745b8fc P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.708110 27432 tablet_replica.cc:333] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.708618 27432 raft_consensus.cc:2243] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.709101 27432 raft_consensus.cc:2272] T c157a34e361841ed97d83cab3e137e59 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.711189 27432 tablet_replica.cc:333] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.711748 27432 raft_consensus.cc:2243] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.712615 27432 raft_consensus.cc:2272] T 34d3c8a715e14f2cb977c6ad59220712 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.714775 27432 tablet_replica.cc:333] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.715379 27432 raft_consensus.cc:2243] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.716717 27432 raft_consensus.cc:2272] T 3569c9c3631041cc8cd59b958fd9b9e5 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.719808 27432 tablet_replica.cc:333] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.720593 27432 raft_consensus.cc:2243] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.721192 27432 raft_consensus.cc:2272] T f0f420ee7d254e55a1a16267eb181e9a P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.723450 27432 tablet_replica.cc:333] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.724068 27432 raft_consensus.cc:2243] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.724617 27432 raft_consensus.cc:2272] T 8f45a6a6cb72448ba6e261d361a0f446 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.726953 27432 tablet_replica.cc:333] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.727636 27432 raft_consensus.cc:2243] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.728135 27432 raft_consensus.cc:2272] T 54e3336557ec4724bcb643f2bb5728a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.730665 27432 tablet_replica.cc:333] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.731254 27432 raft_consensus.cc:2243] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.731724 27432 raft_consensus.cc:2272] T a48d172190094aa293e39aed636ea970 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.733913 27432 tablet_replica.cc:333] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.734606 27432 raft_consensus.cc:2243] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.735455 27432 raft_consensus.cc:2272] T fc74b88e70804c2ba5f2b32882e1043a P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.737854 27432 tablet_replica.cc:333] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.738518 27432 raft_consensus.cc:2243] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.739077 27432 raft_consensus.cc:2272] T 90cf1309a8c14cb4aef37461b8eb906c P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.741299 27432 tablet_replica.cc:333] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.741909 27432 raft_consensus.cc:2243] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.742365 27432 raft_consensus.cc:2272] T b80801dd62bc4b0894771a460938aa71 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.744766 27432 tablet_replica.cc:333] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.745579 27432 raft_consensus.cc:2243] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.746080 27432 raft_consensus.cc:2272] T d8c9caf0b83f44a9bc3b6b2fd38789a6 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.748198 27432 tablet_replica.cc:333] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.748754 27432 raft_consensus.cc:2243] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.749228 27432 raft_consensus.cc:2272] T 6775419b4ff84b9998e052bce5db37ef P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.751267 27432 tablet_replica.cc:333] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.751864 27432 raft_consensus.cc:2243] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.752421 27432 raft_consensus.cc:2272] T 8e41d162a7f742a0b613d0a3e9ebaeb2 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.754685 27432 tablet_replica.cc:333] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.755216 27432 raft_consensus.cc:2243] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.755666 27432 raft_consensus.cc:2272] T c98f6e00475941138b7b84fa7c833346 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.757826 27432 tablet_replica.cc:333] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.758375 27432 raft_consensus.cc:2243] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.759300 27432 raft_consensus.cc:2272] T f966b9e1356c4224a74a4b1f6e10fca5 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.761391 27432 tablet_replica.cc:333] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.761904 27432 raft_consensus.cc:2243] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.762692 27432 raft_consensus.cc:2272] T 739d61d00a4f4a2688668ab2a87b2b44 P c3b8bb2dfba041dea91b3e6775c34505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.764879 27432 tablet_replica.cc:333] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505: stopping tablet replica
I20260709 13:15:03.765416 27432 raft_consensus.cc:2243] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.765846 27432 raft_consensus.cc:2272] T b04569646f764da18b971041e8187bf1 P c3b8bb2dfba041dea91b3e6775c34505 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.840965 27432 tablet_server.cc:196] TabletServer@127.26.202.4:0 shutdown complete.
I20260709 13:15:03.910893 27432 master.cc:562] Master@127.26.202.62:40011 shutting down...
I20260709 13:15:03.945533 27432 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:03.946166 27432 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.946484 27432 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4a137dbbc3444cd9afb9e27e0428bacb: stopping tablet replica
I20260709 13:15:03.998765 27432 master.cc:584] Master@127.26.202.62:40011 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34400 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:15:04.097961 27432 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.202.62:40125
I20260709 13:15:04.099054 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:04.105556  5375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:04.105548  5376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:04.106721  5378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:04.107939 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:04.109158 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:04.109368 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:04.109524 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602904109507 us; error 0 us; skew 500 ppm
I20260709 13:15:04.110097 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:04.112568 27432 webserver.cc:533] Webserver started at http://127.26.202.62:38529/ using document root <none> and password file <none>
I20260709 13:15:04.113134 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:04.113333 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:04.113639 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:04.114773 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/master-0-root/instance:
uuid: "48597f956364486284b33d916d0f6266"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:04.119431 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:04.123353  5383 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.124598 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:04.124971 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/master-0-root
uuid: "48597f956364486284b33d916d0f6266"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:04.125521 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:04.168483 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:04.169921 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:04.212373 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.62:40125
I20260709 13:15:04.212572  5434 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.62:40125 every 8 connection(s)
I20260709 13:15:04.216615  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.227607  5435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266: Bootstrap starting.
I20260709 13:15:04.232743  5435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.237700  5435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266: No bootstrap required, opened a new log
I20260709 13:15:04.240144  5435 raft_consensus.cc:359] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48597f956364486284b33d916d0f6266" member_type: VOTER }
I20260709 13:15:04.240558  5435 raft_consensus.cc:385] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.240880  5435 raft_consensus.cc:740] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48597f956364486284b33d916d0f6266, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.241634  5435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48597f956364486284b33d916d0f6266" member_type: VOTER }
I20260709 13:15:04.242143  5435 raft_consensus.cc:399] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:04.242422  5435 raft_consensus.cc:493] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:04.242723  5435 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:04.247992  5435 raft_consensus.cc:515] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48597f956364486284b33d916d0f6266" member_type: VOTER }
I20260709 13:15:04.248590  5435 leader_election.cc:304] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48597f956364486284b33d916d0f6266; no voters: 
I20260709 13:15:04.249903  5435 leader_election.cc:290] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:04.250399  5438 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:04.252135  5438 raft_consensus.cc:697] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 1 LEADER]: Becoming Leader. State: Replica: 48597f956364486284b33d916d0f6266, State: Running, Role: LEADER
I20260709 13:15:04.252954  5438 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48597f956364486284b33d916d0f6266" member_type: VOTER }
I20260709 13:15:04.253230  5435 sys_catalog.cc:565] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:04.258190  5439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48597f956364486284b33d916d0f6266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48597f956364486284b33d916d0f6266" member_type: VOTER } }
I20260709 13:15:04.258368  5440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48597f956364486284b33d916d0f6266. Latest consensus state: current_term: 1 leader_uuid: "48597f956364486284b33d916d0f6266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48597f956364486284b33d916d0f6266" member_type: VOTER } }
I20260709 13:15:04.258988  5439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:04.259234  5440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:04.264648  5444 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:04.271299  5444 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:04.276376 27432 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:04.283591  5444 catalog_manager.cc:1383] Generated new cluster ID: 9c81a16f774b4b68bb7ade58773f90c1
I20260709 13:15:04.283857  5444 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:04.302040  5444 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:04.303387  5444 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:04.319648  5444 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266: Generated new TSK 0
I20260709 13:15:04.320298  5444 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:04.344938 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:04.351807  5456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:04.353276  5457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:04.355222  5459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:04.355449 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:04.356730 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:04.356957 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:04.357199 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602904357182 us; error 0 us; skew 500 ppm
I20260709 13:15:04.357755 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:04.360198 27432 webserver.cc:533] Webserver started at http://127.26.202.1:37929/ using document root <none> and password file <none>
I20260709 13:15:04.360739 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:04.360951 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:04.361294 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:04.362421 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root/instance:
uuid: "44a969eee104434bb4647dcd6486b3cc"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:04.367137 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:04.370819  5464 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.371707 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:15:04.372061 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "44a969eee104434bb4647dcd6486b3cc"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:04.372364 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:04.385632 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:04.386888 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:04.388423 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:04.390827 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:04.391068 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.391309 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:04.391494 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.436612 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:40165
I20260709 13:15:04.436806  5526 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:40165 every 8 connection(s)
I20260709 13:15:04.442152 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:04.449864  5531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:04.450901  5532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:04.454191 27432 server_base.cc:1061] running on GCE node
W20260709 13:15:04.455315  5534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:04.456367 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:04.456455  5527 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40125
W20260709 13:15:04.456622 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:04.457046 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602904457004 us; error 0 us; skew 500 ppm
I20260709 13:15:04.457099  5527 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:04.457701 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:04.458006  5527 heartbeater.cc:507] Master 127.26.202.62:40125 requested a full tablet report, sending...
I20260709 13:15:04.460460 27432 webserver.cc:533] Webserver started at http://127.26.202.2:40225/ using document root <none> and password file <none>
I20260709 13:15:04.460541  5400 ts_manager.cc:194] Registered new tserver with Master: 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165)
I20260709 13:15:04.461172 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:04.461427 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:04.461707 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:04.462622  5400 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46000
I20260709 13:15:04.462774 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-1-root/instance:
uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:04.467675 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:04.471587  5539 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.472623 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:15:04.472908 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-1-root
uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:04.473229 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:04.494331 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:04.495528 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:04.496937 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:04.499527 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:04.499711 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.500028 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:04.500173 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.543749 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.2:33523
I20260709 13:15:04.543962  5601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.2:33523 every 8 connection(s)
I20260709 13:15:04.548812 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:04.557565  5606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:04.558677  5605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:04.565224  5602 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40125
I20260709 13:15:04.566023  5602 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:04.566046  5608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:04.566226 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:04.567144  5602 heartbeater.cc:507] Master 127.26.202.62:40125 requested a full tablet report, sending...
I20260709 13:15:04.567389 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:04.567775 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:04.567970 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602904567953 us; error 0 us; skew 500 ppm
I20260709 13:15:04.568758 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:04.569787  5400 ts_manager.cc:194] Registered new tserver with Master: c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:04.571734 27432 webserver.cc:533] Webserver started at http://127.26.202.3:38913/ using document root <none> and password file <none>
I20260709 13:15:04.571749  5400 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46004
I20260709 13:15:04.572469 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:04.572729 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:04.573081 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:04.574335 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-2-root/instance:
uuid: "a1ff46d6092a4139b815792d98865386"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:04.579246 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:04.582944  5613 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.584015 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:15:04.584311 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-2-root
uuid: "a1ff46d6092a4139b815792d98865386"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:04.584606 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:04.610113 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:04.611434 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:04.612977 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:04.615900 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:04.616318 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.616698 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:04.616864 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:04.663764 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.3:39775
I20260709 13:15:04.663872  5675 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.3:39775 every 8 connection(s)
I20260709 13:15:04.680276  5676 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40125
I20260709 13:15:04.680851  5676 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:04.681774  5676 heartbeater.cc:507] Master 127.26.202.62:40125 requested a full tablet report, sending...
I20260709 13:15:04.684453  5400 ts_manager.cc:194] Registered new tserver with Master: a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:04.684998 27432 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01778932s
I20260709 13:15:04.686007  5400 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46010
I20260709 13:15:04.714177  5400 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46016:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:04.717171  5400 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:04.800452  5641 tablet_service.cc:1511] Processing CreateTablet for tablet 7f5cffa266914dc8b8c846ae682e2e09 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:04.802014  5641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5cffa266914dc8b8c846ae682e2e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.804100  5640 tablet_service.cc:1511] Processing CreateTablet for tablet 0860a05280034829bf2312ed6739890d (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:04.806559  5639 tablet_service.cc:1511] Processing CreateTablet for tablet 95f22e67d11f416d8bda69478df8aca4 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:04.808581  5638 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcb4de792964fb4a55272eb57c5fe3e (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:04.810300  5640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0860a05280034829bf2312ed6739890d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.811403  5567 tablet_service.cc:1511] Processing CreateTablet for tablet 7f5cffa266914dc8b8c846ae682e2e09 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:04.813136  5567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5cffa266914dc8b8c846ae682e2e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.813364  5638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcb4de792964fb4a55272eb57c5fe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.814890  5637 tablet_service.cc:1511] Processing CreateTablet for tablet 5617a3488177480da431a01e0cf99155 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:04.816975  5637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5617a3488177480da431a01e0cf99155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.824680  5639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f22e67d11f416d8bda69478df8aca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.818634  5566 tablet_service.cc:1511] Processing CreateTablet for tablet 0860a05280034829bf2312ed6739890d (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:04.829123  5566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0860a05280034829bf2312ed6739890d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.820006  5565 tablet_service.cc:1511] Processing CreateTablet for tablet 95f22e67d11f416d8bda69478df8aca4 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:04.834872  5565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f22e67d11f416d8bda69478df8aca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.821410  5563 tablet_service.cc:1511] Processing CreateTablet for tablet 5617a3488177480da431a01e0cf99155 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:04.839875  5563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5617a3488177480da431a01e0cf99155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.823891  5564 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcb4de792964fb4a55272eb57c5fe3e (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:04.843719  5564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcb4de792964fb4a55272eb57c5fe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.847715  5636 tablet_service.cc:1511] Processing CreateTablet for tablet fae69f0e08cd4fc59615404e810ebae6 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:04.849283  5636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae69f0e08cd4fc59615404e810ebae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.852480  5562 tablet_service.cc:1511] Processing CreateTablet for tablet fae69f0e08cd4fc59615404e810ebae6 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:04.854256  5562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae69f0e08cd4fc59615404e810ebae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.856016  5561 tablet_service.cc:1511] Processing CreateTablet for tablet 071a230265da4ca0865fb4cf6be13ea9 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:04.861289  5561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071a230265da4ca0865fb4cf6be13ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.866178  5690 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:04.876343  5491 tablet_service.cc:1511] Processing CreateTablet for tablet 0860a05280034829bf2312ed6739890d (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:04.876749  5492 tablet_service.cc:1511] Processing CreateTablet for tablet 7f5cffa266914dc8b8c846ae682e2e09 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:04.877557  5690 tablet_bootstrap.cc:654] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.878080  5491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0860a05280034829bf2312ed6739890d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.878317  5487 tablet_service.cc:1511] Processing CreateTablet for tablet fae69f0e08cd4fc59615404e810ebae6 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:04.878883  5492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5cffa266914dc8b8c846ae682e2e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.879818  5487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae69f0e08cd4fc59615404e810ebae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.880505  5490 tablet_service.cc:1511] Processing CreateTablet for tablet 95f22e67d11f416d8bda69478df8aca4 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:04.882076  5490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f22e67d11f416d8bda69478df8aca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.881964  5488 tablet_service.cc:1511] Processing CreateTablet for tablet 5617a3488177480da431a01e0cf99155 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:04.883572  5488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5617a3488177480da431a01e0cf99155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.886502  5489 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcb4de792964fb4a55272eb57c5fe3e (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:04.888217  5489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcb4de792964fb4a55272eb57c5fe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.886507  5486 tablet_service.cc:1511] Processing CreateTablet for tablet 071a230265da4ca0865fb4cf6be13ea9 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:04.891314  5486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071a230265da4ca0865fb4cf6be13ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.904407  5638 tablet_service.cc:1511] Processing CreateTablet for tablet 071a230265da4ca0865fb4cf6be13ea9 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:04.906455  5638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071a230265da4ca0865fb4cf6be13ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.925879  5485 tablet_service.cc:1511] Processing CreateTablet for tablet 3db384ebddbb4cc5b286364da5177128 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:04.927603  5485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db384ebddbb4cc5b286364da5177128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.943697  5560 tablet_service.cc:1511] Processing CreateTablet for tablet 3db384ebddbb4cc5b286364da5177128 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:04.953521  5560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db384ebddbb4cc5b286364da5177128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.966305  5692 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:04.967954  5640 tablet_service.cc:1511] Processing CreateTablet for tablet 3db384ebddbb4cc5b286364da5177128 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:04.969457  5640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db384ebddbb4cc5b286364da5177128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.972465  5690 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:04.973089  5690 ts_tablet_manager.cc:1403] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.107s	user 0.035s	sys 0.044s
I20260709 13:15:04.975732  5484 tablet_service.cc:1511] Processing CreateTablet for tablet 1bef056819f146bcb3e5121aacc32b39 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:04.976238  5690 raft_consensus.cc:359] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:04.977114  5690 raft_consensus.cc:385] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:04.977408  5690 raft_consensus.cc:740] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:04.978181  5484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bef056819f146bcb3e5121aacc32b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:04.978148  5690 consensus_queue.cc:260] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:04.992400  5692 tablet_bootstrap.cc:654] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:04.995222  5567 tablet_service.cc:1511] Processing CreateTablet for tablet 1bef056819f146bcb3e5121aacc32b39 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:04.996670  5567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bef056819f146bcb3e5121aacc32b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.007340  5487 tablet_service.cc:1511] Processing CreateTablet for tablet ea9728262c5d40adbe8b6f99d9f27eeb (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:05.010280  5638 tablet_service.cc:1511] Processing CreateTablet for tablet 1bef056819f146bcb3e5121aacc32b39 (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:05.011698  5638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bef056819f146bcb3e5121aacc32b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.015272  5559 tablet_service.cc:1511] Processing CreateTablet for tablet ea9728262c5d40adbe8b6f99d9f27eeb (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:05.021672  5694 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:05.025825  5559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9728262c5d40adbe8b6f99d9f27eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.033391  5487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9728262c5d40adbe8b6f99d9f27eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.050025  5690 ts_tablet_manager.cc:1434] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.077s	user 0.011s	sys 0.025s
I20260709 13:15:05.050923  5676 heartbeater.cc:499] Master 127.26.202.62:40125 was elected leader, sending a full tablet report...
I20260709 13:15:05.051138  5690 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.056536  5690 tablet_bootstrap.cc:654] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.071653  5637 tablet_service.cc:1511] Processing CreateTablet for tablet ea9728262c5d40adbe8b6f99d9f27eeb (DEFAULT_TABLE table=test-workload [id=9cd70f3278534b62b60510334e99c762]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:05.073771  5694 tablet_bootstrap.cc:654] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.074079  5637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea9728262c5d40adbe8b6f99d9f27eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.094810  5693 raft_consensus.cc:493] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.096046  5693 raft_consensus.cc:515] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:05.105293  5690 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.105899  5690 ts_tablet_manager.cc:1403] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.005s
I20260709 13:15:05.111296  5694 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.111740  5693 leader_election.cc:290] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165)
I20260709 13:15:05.108872  5690 raft_consensus.cc:359] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.115729  5690 raft_consensus.cc:385] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.116065  5690 raft_consensus.cc:740] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.111892  5694 ts_tablet_manager.cc:1403] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.004s
I20260709 13:15:05.112113  5692 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.116914  5690 consensus_queue.cc:260] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.117689  5692 ts_tablet_manager.cc:1403] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.020s
I20260709 13:15:05.119215  5690 ts_tablet_manager.cc:1434] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:15:05.120805  5692 raft_consensus.cc:359] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:05.121654  5692 raft_consensus.cc:385] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.121960  5692 raft_consensus.cc:740] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.123163  5692 consensus_queue.cc:260] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:05.124884  5690 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.125275  5694 raft_consensus.cc:359] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:05.126155  5694 raft_consensus.cc:385] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.126092  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.126812  5694 raft_consensus.cc:740] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.127676  5694 consensus_queue.cc:260] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:05.128254  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:05.132982  5577 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 0.
I20260709 13:15:05.134107  5690 tablet_bootstrap.cc:654] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.134140  5502 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 0.
I20260709 13:15:05.140002  5616 leader_election.cc:304] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.141448  5693 raft_consensus.cc:2804] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.142000  5693 raft_consensus.cc:493] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.143265  5693 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.146469  5602 heartbeater.cc:499] Master 127.26.202.62:40125 was elected leader, sending a full tablet report...
I20260709 13:15:05.149062  5690 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.149729  5690 ts_tablet_manager.cc:1403] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 13:15:05.153278  5690 raft_consensus.cc:359] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.153777  5692 ts_tablet_manager.cc:1434] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.018s
I20260709 13:15:05.154217  5690 raft_consensus.cc:385] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.154739  5690 raft_consensus.cc:740] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.155419  5692 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:05.155880  5690 consensus_queue.cc:260] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.158623  5690 ts_tablet_manager.cc:1434] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:05.159806  5690 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.166308  5527 heartbeater.cc:499] Master 127.26.202.62:40125 was elected leader, sending a full tablet report...
I20260709 13:15:05.166515  5692 tablet_bootstrap.cc:654] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.166873  5694 ts_tablet_manager.cc:1434] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.017s
I20260709 13:15:05.167438  5690 tablet_bootstrap.cc:654] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.168187  5694 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
W20260709 13:15:05.169358  5677 tablet.cc:2406] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:05.178313  5694 tablet_bootstrap.cc:654] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.178993  5692 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.179615  5692 ts_tablet_manager.cc:1403] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:15:05.183547  5692 raft_consensus.cc:359] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.184639  5692 raft_consensus.cc:385] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.185205  5692 raft_consensus.cc:740] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.186563  5692 consensus_queue.cc:260] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.190294  5692 ts_tablet_manager.cc:1434] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 13:15:05.191753  5692 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:05.199455  5692 tablet_bootstrap.cc:654] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.203646  5695 raft_consensus.cc:493] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.204440  5695 raft_consensus.cc:515] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.205152  5693 raft_consensus.cc:515] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:05.208541  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
W20260709 13:15:05.210166  5616 leader_election.cc:343] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.211241  5695 leader_election.cc:290] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:05.211931  5694 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.212570  5694 ts_tablet_manager.cc:1403] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.009s
I20260709 13:15:05.212420  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
W20260709 13:15:05.214025  5616 leader_election.cc:343] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.214524  5616 leader_election.cc:304] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ff46d6092a4139b815792d98865386; no voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:05.215341  5695 raft_consensus.cc:2749] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.217410  5694 raft_consensus.cc:359] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.218364  5694 raft_consensus.cc:385] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.218703  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:05.219399  5577 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.221240  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:05.222175  5502 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.218945  5692 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.229519  5692 ts_tablet_manager.cc:1403] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.000s
I20260709 13:15:05.233731  5577 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 1.
I20260709 13:15:05.234725  5502 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 1.
I20260709 13:15:05.236737  5616 leader_election.cc:304] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:05.239652  5695 raft_consensus.cc:2804] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.240988  5692 raft_consensus.cc:359] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.241816  5692 raft_consensus.cc:385] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.242139  5692 raft_consensus.cc:740] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.242897  5692 consensus_queue.cc:260] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.218706  5694 raft_consensus.cc:740] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.244668  5694 consensus_queue.cc:260] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.245865  5693 leader_election.cc:290] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 election: Requested vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165)
I20260709 13:15:05.248334  5694 ts_tablet_manager.cc:1434] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:15:05.249434  5694 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:05.249923  5690 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.250648  5690 ts_tablet_manager.cc:1403] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.091s	user 0.040s	sys 0.045s
I20260709 13:15:05.250972  5695 raft_consensus.cc:697] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:05.252137  5695 consensus_queue.cc:237] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:05.254238  5690 raft_consensus.cc:359] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.255152  5690 raft_consensus.cc:385] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.255532  5690 raft_consensus.cc:740] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.256657  5692 ts_tablet_manager.cc:1434] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:15:05.256469  5690 consensus_queue.cc:260] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.257781  5692 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:05.260264  5690 ts_tablet_manager.cc:1434] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:05.262287  5690 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.266455  5694 tablet_bootstrap.cc:654] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:05.269203  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:05.264883  5692 tablet_bootstrap.cc:654] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.270470  5690 tablet_bootstrap.cc:654] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.275622  5694 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.276176  5694 ts_tablet_manager.cc:1403] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:15:05.276341  5692 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.276907  5692 ts_tablet_manager.cc:1403] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:15:05.279193  5694 raft_consensus.cc:359] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.280064  5694 raft_consensus.cc:385] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.278651  5400 catalog_manager.cc:5697] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.280413  5694 raft_consensus.cc:740] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.280172  5692 raft_consensus.cc:359] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.280979  5692 raft_consensus.cc:385] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.281320  5692 raft_consensus.cc:740] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.281423  5694 consensus_queue.cc:260] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.282127  5692 consensus_queue.cc:260] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.283910  5690 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.284454  5692 ts_tablet_manager.cc:1434] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:15:05.284492  5690 ts_tablet_manager.cc:1403] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.001s
I20260709 13:15:05.285626  5692 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:05.288518  5690 raft_consensus.cc:359] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.289408  5690 raft_consensus.cc:385] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.289765  5690 raft_consensus.cc:740] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.290593  5690 consensus_queue.cc:260] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.292263  5692 tablet_bootstrap.cc:654] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.291543  5694 ts_tablet_manager.cc:1434] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:15:05.293486  5690 ts_tablet_manager.cc:1434] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:05.294866  5690 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.293869  5694 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:05.308175  5690 tablet_bootstrap.cc:654] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.310349  5694 tablet_bootstrap.cc:654] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.311694  5692 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.312549  5692 ts_tablet_manager.cc:1403] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.014s
I20260709 13:15:05.316648  5692 raft_consensus.cc:359] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.317921  5692 raft_consensus.cc:385] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.318404  5692 raft_consensus.cc:740] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.319631  5692 consensus_queue.cc:260] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.321142  5702 raft_consensus.cc:493] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.321704  5702 raft_consensus.cc:515] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.322692  5692 ts_tablet_manager.cc:1434] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:15:05.323880  5692 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:05.320744  5690 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.325306  5690 ts_tablet_manager.cc:1403] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.011s
I20260709 13:15:05.325554  5694 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.326107  5694 ts_tablet_manager.cc:1403] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 13:15:05.327477  5702 leader_election.cc:290] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.339713  5692 tablet_bootstrap.cc:654] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.343895  5694 raft_consensus.cc:359] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.345256  5694 raft_consensus.cc:385] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.346484  5694 raft_consensus.cc:740] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.348356  5694 consensus_queue.cc:260] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.352475  5694 ts_tablet_manager.cc:1434] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:15:05.347151  5690 raft_consensus.cc:359] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.353225  5690 raft_consensus.cc:385] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.353601  5690 raft_consensus.cc:740] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.354521  5690 consensus_queue.cc:260] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.357230  5690 ts_tablet_manager.cc:1434] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.006s
I20260709 13:15:05.359308  5690 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.366086  5690 tablet_bootstrap.cc:654] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.358214  5694 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:05.372761  5700 raft_consensus.cc:493] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.373399  5700 raft_consensus.cc:515] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.376125  5694 tablet_bootstrap.cc:654] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.377537  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
W20260709 13:15:05.379487  5468 leader_election.cc:343] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.384507  5700 leader_election.cc:290] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.388882  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
W20260709 13:15:05.391364  5467 leader_election.cc:343] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.392031  5467 leader_election.cc:304] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc; no voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:05.393603  5702 raft_consensus.cc:2749] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.396301  5692 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.396891  5692 ts_tablet_manager.cc:1403] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.027s
I20260709 13:15:05.400228  5692 raft_consensus.cc:359] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.401034  5692 raft_consensus.cc:385] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.401325  5692 raft_consensus.cc:740] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.402207  5700 raft_consensus.cc:493] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.402112  5692 consensus_queue.cc:260] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.402961  5700 raft_consensus.cc:515] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.406247  5700 leader_election.cc:290] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.411701  5692 ts_tablet_manager.cc:1434] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:15:05.412863  5692 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:05.415202  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.417444  5501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae69f0e08cd4fc59615404e810ebae6" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.418602  5501 raft_consensus.cc:2468] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
I20260709 13:15:05.420045  5692 tablet_bootstrap.cc:654] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:05.420926  5542 leader_election.cc:343] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.422139  5542 leader_election.cc:304] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.424726  5725 raft_consensus.cc:2804] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.425382  5725 raft_consensus.cc:493] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.425892  5725 raft_consensus.cc:3060] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.429587  5690 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.430065  5694 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.430239  5690 ts_tablet_manager.cc:1403] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.071s	user 0.004s	sys 0.011s
I20260709 13:15:05.430608  5694 ts_tablet_manager.cc:1403] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.073s	user 0.038s	sys 0.016s
I20260709 13:15:05.434003  5694 raft_consensus.cc:359] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.433836  5690 raft_consensus.cc:359] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.434885  5694 raft_consensus.cc:385] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.434981  5690 raft_consensus.cc:385] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.435413  5690 raft_consensus.cc:740] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.435660  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.436693  5690 consensus_queue.cc:260] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.438097  5650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae69f0e08cd4fc59615404e810ebae6" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.438970  5650 raft_consensus.cc:2468] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
W20260709 13:15:05.440799  5543 leader_election.cc:343] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.441365  5543 leader_election.cc:304] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2ff33a1b2cd480aa75922b143ab7b55; no voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386
I20260709 13:15:05.442338  5725 raft_consensus.cc:515] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.444500  5700 raft_consensus.cc:2749] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.435433  5694 raft_consensus.cc:740] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.445974  5501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae69f0e08cd4fc59615404e810ebae6" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:05.446947  5501 raft_consensus.cc:3060] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.447227  5694 consensus_queue.cc:260] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.448741  5650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae69f0e08cd4fc59615404e810ebae6" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:05.449669  5694 ts_tablet_manager.cc:1434] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:15:05.449618  5650 raft_consensus.cc:3060] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.450901  5694 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:05.456578  5501 raft_consensus.cc:2468] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
I20260709 13:15:05.458199  5542 leader_election.cc:304] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.461135  5690 ts_tablet_manager.cc:1434] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:15:05.462050  5694 tablet_bootstrap.cc:654] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.446491  5725 leader_election.cc:290] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.465301  5725 raft_consensus.cc:2804] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.465775  5725 raft_consensus.cc:697] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:05.466611  5725 consensus_queue.cc:237] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.471290  5690 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.475903  5650 raft_consensus.cc:2468] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
I20260709 13:15:05.477382  5694 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.487573  5694 ts_tablet_manager.cc:1403] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.009s
I20260709 13:15:05.484534  5400 catalog_manager.cc:5697] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.490834  5690 tablet_bootstrap.cc:654] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.491648  5694 raft_consensus.cc:359] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.492547  5694 raft_consensus.cc:385] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.492934  5694 raft_consensus.cc:740] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.493958  5694 consensus_queue.cc:260] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.496718  5694 ts_tablet_manager.cc:1434] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:15:05.497859  5694 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:05.501590  5692 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.502202  5692 ts_tablet_manager.cc:1403] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.090s	user 0.040s	sys 0.035s
I20260709 13:15:05.505367  5692 raft_consensus.cc:359] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.506150  5692 raft_consensus.cc:385] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.506196  5694 tablet_bootstrap.cc:654] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.506531  5692 raft_consensus.cc:740] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.508169  5692 consensus_queue.cc:260] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.510663  5692 ts_tablet_manager.cc:1434] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:05.511796  5692 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:05.511824  5690 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.512658  5690 ts_tablet_manager.cc:1403] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.019s
I20260709 13:15:05.516796  5690 raft_consensus.cc:359] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.517794  5690 raft_consensus.cc:385] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.518139  5690 raft_consensus.cc:740] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.518868  5692 tablet_bootstrap.cc:654] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.519192  5690 consensus_queue.cc:260] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.527531  5694 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.528255  5694 ts_tablet_manager.cc:1403] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.009s
I20260709 13:15:05.530175  5702 raft_consensus.cc:493] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.530794  5702 raft_consensus.cc:515] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.531661  5694 raft_consensus.cc:359] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.532536  5694 raft_consensus.cc:385] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.532887  5694 raft_consensus.cc:740] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.533439  5702 leader_election.cc:290] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.533775  5694 consensus_queue.cc:260] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.535553  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:05.536579  5694 ts_tablet_manager.cc:1434] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:05.537700  5694 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
W20260709 13:15:05.537545  5467 leader_election.cc:343] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.540328  5650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.541085  5650 raft_consensus.cc:2468] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 0.
I20260709 13:15:05.542649  5468 leader_election.cc:304] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:05.543450  5690 ts_tablet_manager.cc:1434] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:15:05.544574  5690 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.546139  5694 tablet_bootstrap.cc:654] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.549532  5702 raft_consensus.cc:2804] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.550318  5702 raft_consensus.cc:493] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.550830  5690 tablet_bootstrap.cc:654] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.550849  5702 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.558182  5733 raft_consensus.cc:493] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.558998  5733 raft_consensus.cc:515] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.562963  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0860a05280034829bf2312ed6739890d" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:05.563957  5577 raft_consensus.cc:2468] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 0.
I20260709 13:15:05.565853  5467 leader_election.cc:304] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.575690  5733 leader_election.cc:290] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.576267  5733 raft_consensus.cc:2804] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.576637  5733 raft_consensus.cc:493] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.576942  5650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0860a05280034829bf2312ed6739890d" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.576954  5733 raft_consensus.cc:3060] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.579450  5650 raft_consensus.cc:2468] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 0.
I20260709 13:15:05.579212  5692 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.580317  5692 ts_tablet_manager.cc:1403] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.069s	user 0.043s	sys 0.023s
I20260709 13:15:05.582799  5702 raft_consensus.cc:515] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.583868  5692 raft_consensus.cc:359] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.584553  5692 raft_consensus.cc:385] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.584817  5692 raft_consensus.cc:740] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.585536  5692 consensus_queue.cc:260] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.585826  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:05.586086  5650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:05.586676  5650 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.587569  5692 ts_tablet_manager.cc:1434] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:05.588745  5692 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
W20260709 13:15:05.588661  5467 leader_election.cc:343] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.590771  5733 raft_consensus.cc:515] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.591415  5694 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.592051  5694 ts_tablet_manager.cc:1403] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.032s
I20260709 13:15:05.593670  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0860a05280034829bf2312ed6739890d" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:05.594347  5577 raft_consensus.cc:3060] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.594508  5692 tablet_bootstrap.cc:654] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.595309  5694 raft_consensus.cc:359] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.596058  5694 raft_consensus.cc:385] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.596381  5694 raft_consensus.cc:740] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.597601  5694 consensus_queue.cc:260] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.602447  5694 ts_tablet_manager.cc:1434] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:05.603516  5694 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:05.603580  5725 raft_consensus.cc:493] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.604601  5725 raft_consensus.cc:515] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.607848  5577 raft_consensus.cc:2468] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 1.
I20260709 13:15:05.608771  5501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.609189  5467 leader_election.cc:304] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.609488  5501 raft_consensus.cc:2468] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
I20260709 13:15:05.611536  5734 raft_consensus.cc:2804] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.613399  5542 leader_election.cc:304] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.614442  5733 leader_election.cc:290] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 election: Requested vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.614480  5700 raft_consensus.cc:2804] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.615007  5700 raft_consensus.cc:493] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.615422  5700 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.616005  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0860a05280034829bf2312ed6739890d" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:05.616283  5725 leader_election.cc:290] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.616696  5651 raft_consensus.cc:3060] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.617957  5690 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.618199  5649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.618503  5690 ts_tablet_manager.cc:1403] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.000s
I20260709 13:15:05.618937  5649 raft_consensus.cc:2468] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
I20260709 13:15:05.621508  5690 raft_consensus.cc:359] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.622270  5690 raft_consensus.cc:385] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.622120  5734 raft_consensus.cc:697] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 1 LEADER]: Becoming Leader. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Running, Role: LEADER
I20260709 13:15:05.622581  5690 raft_consensus.cc:740] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.623116  5650 raft_consensus.cc:2468] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 1.
I20260709 13:15:05.623202  5734 consensus_queue.cc:237] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.623311  5690 consensus_queue.cc:260] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.624500  5468 leader_election.cc:304] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:05.625445  5733 raft_consensus.cc:2804] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.624434  5651 raft_consensus.cc:2468] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 1.
I20260709 13:15:05.626065  5733 raft_consensus.cc:697] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 1 LEADER]: Becoming Leader. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Running, Role: LEADER
I20260709 13:15:05.624704  5702 leader_election.cc:290] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 election: Requested vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.627241  5692 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.627090  5733 consensus_queue.cc:237] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.627789  5692 ts_tablet_manager.cc:1403] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.008s
I20260709 13:15:05.631423  5690 ts_tablet_manager.cc:1434] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:05.632560  5690 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386: Bootstrap starting.
I20260709 13:15:05.635772  5694 tablet_bootstrap.cc:654] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.638309  5725 raft_consensus.cc:493] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.638857  5725 raft_consensus.cc:515] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.639734  5692 raft_consensus.cc:359] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.640440  5692 raft_consensus.cc:385] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.630911  5700 raft_consensus.cc:515] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.640698  5692 raft_consensus.cc:740] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.641438  5692 consensus_queue.cc:260] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.643522  5690 tablet_bootstrap.cc:654] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.642901  5399 catalog_manager.cc:5697] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a969eee104434bb4647dcd6486b3cc (127.26.202.1). New cstate: current_term: 1 leader_uuid: "44a969eee104434bb4647dcd6486b3cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.646229  5725 leader_election.cc:290] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.649595  5700 leader_election.cc:290] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.651950  5692 ts_tablet_manager.cc:1434] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 13:15:05.652228  5501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.653033  5692 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55: Bootstrap starting.
I20260709 13:15:05.653502  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:05.654122  5502 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.655781  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.656736  5651 raft_consensus.cc:2468] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
I20260709 13:15:05.659502  5692 tablet_bootstrap.cc:654] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.663494  5695 consensus_queue.cc:1048] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:05.667681  5542 leader_election.cc:343] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.678874  5543 leader_election.cc:304] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 44a969eee104434bb4647dcd6486b3cc
I20260709 13:15:05.680208  5739 raft_consensus.cc:2804] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.680629  5739 raft_consensus.cc:493] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.680964  5739 raft_consensus.cc:3060] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.683597  5694 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.684248  5694 ts_tablet_manager.cc:1403] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.081s	user 0.006s	sys 0.007s
I20260709 13:15:05.678766  5650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:05.680824  5502 raft_consensus.cc:2468] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
I20260709 13:15:05.686969  5690 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386: No bootstrap required, opened a new log
I20260709 13:15:05.687587  5690 ts_tablet_manager.cc:1403] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.009s
I20260709 13:15:05.692385  5690 raft_consensus.cc:359] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.693197  5690 raft_consensus.cc:385] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.692723  5694 raft_consensus.cc:359] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.693599  5690 raft_consensus.cc:740] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.693747  5694 raft_consensus.cc:385] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.694401  5690 consensus_queue.cc:260] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.692853  5739 raft_consensus.cc:515] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.694123  5694 raft_consensus.cc:740] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.696388  5690 ts_tablet_manager.cc:1434] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:05.697284  5542 leader_election.cc:304] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.698210  5700 raft_consensus.cc:2804] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.690399  5650 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.698688  5700 raft_consensus.cc:697] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:05.699595  5700 consensus_queue.cc:237] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.700580  5739 leader_election.cc:290] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.696651  5694 consensus_queue.cc:260] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.701256  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:05.701845  5651 raft_consensus.cc:3060] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.702742  5694 ts_tablet_manager.cc:1434] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:15:05.703754  5694 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:05.708590  5692 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55: No bootstrap required, opened a new log
I20260709 13:15:05.709409  5692 ts_tablet_manager.cc:1403] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.000s
I20260709 13:15:05.712908  5692 raft_consensus.cc:359] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.711405  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:05.713768  5692 raft_consensus.cc:385] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.714514  5692 raft_consensus.cc:740] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.715215  5692 consensus_queue.cc:260] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.717263  5692 ts_tablet_manager.cc:1434] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:05.718079  5651 raft_consensus.cc:2468] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
W20260709 13:15:05.718235  5542 leader_election.cc:343] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:05.720151  5650 raft_consensus.cc:2468] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
I20260709 13:15:05.721194  5543 leader_election.cc:304] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 44a969eee104434bb4647dcd6486b3cc
I20260709 13:15:05.727275  5739 raft_consensus.cc:2804] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.731315  5694 tablet_bootstrap.cc:654] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:05.731438  5739 raft_consensus.cc:697] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:05.732415  5739 consensus_queue.cc:237] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.723100  5398 catalog_manager.cc:5697] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a969eee104434bb4647dcd6486b3cc (127.26.202.1). New cstate: current_term: 1 leader_uuid: "44a969eee104434bb4647dcd6486b3cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.738567  5399 catalog_manager.cc:5697] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.739476  5700 raft_consensus.cc:493] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.744971  5700 raft_consensus.cc:515] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.747712  5694 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: No bootstrap required, opened a new log
I20260709 13:15:05.748098  5694 ts_tablet_manager.cc:1403] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 13:15:05.740818  5693 consensus_queue.cc:1048] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:15:05.745923  5695 raft_consensus.cc:493] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.762403  5693 raft_consensus.cc:493] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.763228  5693 raft_consensus.cc:515] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.770397  5695 raft_consensus.cc:515] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.773490  5733 raft_consensus.cc:493] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.773854  5725 raft_consensus.cc:493] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.774184  5733 raft_consensus.cc:515] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.774595  5693 leader_election.cc:290] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:05.774428  5725 raft_consensus.cc:515] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.775442  5501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.775703  5695 leader_election.cc:290] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:05.776232  5501 raft_consensus.cc:2468] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 0.
I20260709 13:15:05.776648  5725 leader_election.cc:290] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.776620  5733 leader_election.cc:290] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.781244  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.782155  5502 raft_consensus.cc:2468] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 0.
I20260709 13:15:05.776962  5700 leader_election.cc:290] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.785748  5576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:05.786957  5576 raft_consensus.cc:2468] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 0.
I20260709 13:15:05.787113  5575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:05.788955  5575 raft_consensus.cc:2468] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 0.
I20260709 13:15:05.789247  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:05.789673  5467 leader_election.cc:304] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.790050  5574 raft_consensus.cc:2468] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 0.
I20260709 13:15:05.788082  5501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.791290  5501 raft_consensus.cc:2468] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
I20260709 13:15:05.791348  5694 raft_consensus.cc:359] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.792274  5694 raft_consensus.cc:385] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:05.787386  5616 leader_election.cc:304] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:05.784977  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc" is_pre_election: true
I20260709 13:15:05.793110  5542 leader_election.cc:304] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.793663  5502 raft_consensus.cc:2468] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
I20260709 13:15:05.794373  5650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.794781  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.794902  5733 raft_consensus.cc:2804] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.795123  5650 raft_consensus.cc:2468] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
I20260709 13:15:05.795498  5651 raft_consensus.cc:2468] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 0.
I20260709 13:15:05.795639  5733 raft_consensus.cc:493] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.794376  5695 raft_consensus.cc:2804] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.796271  5733 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.796705  5695 raft_consensus.cc:493] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.796957  5542 leader_election.cc:304] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.797293  5695 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.797994  5725 raft_consensus.cc:2804] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.798432  5725 raft_consensus.cc:493] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.798791  5725 raft_consensus.cc:3060] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.801314  5700 raft_consensus.cc:2804] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.801856  5700 raft_consensus.cc:493] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.802295  5700 raft_consensus.cc:3060] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.806962  5694 raft_consensus.cc:740] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:05.810649  5694 consensus_queue.cc:260] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.813207  5694 ts_tablet_manager.cc:1434] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 13:15:05.816422  5733 raft_consensus.cc:515] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.817641  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:05.818413  5695 raft_consensus.cc:515] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.820060  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:05.818985  5733 leader_election.cc:290] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 election: Requested vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.821117  5574 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.822086  5695 leader_election.cc:290] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:05.818435  5651 raft_consensus.cc:2468] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 0.
I20260709 13:15:05.827255  5575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:05.828059  5575 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.829092  5502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:05.829821  5502 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.831519  5725 raft_consensus.cc:515] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.833750  5725 leader_election.cc:290] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.820130  5700 raft_consensus.cc:515] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.834589  5501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:05.835268  5501 raft_consensus.cc:3060] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.835983  5700 leader_election.cc:290] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:05.837064  5500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:05.837836  5500 raft_consensus.cc:3060] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.838325  5575 raft_consensus.cc:2468] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 1.
I20260709 13:15:05.827260  5616 leader_election.cc:304] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.842720  5695 raft_consensus.cc:2804] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:05.843137  5695 raft_consensus.cc:493] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:05.843487  5695 raft_consensus.cc:3060] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.843991  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:05.844843  5651 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.845453  5650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:05.846000  5500 raft_consensus.cc:2468] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
I20260709 13:15:05.846101  5650 raft_consensus.cc:3060] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:05.847266  5616 leader_election.cc:304] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.847994  5649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:05.848748  5707 raft_consensus.cc:2804] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.854501  5650 raft_consensus.cc:2468] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
I20260709 13:15:05.856344  5542 leader_election.cc:304] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.856510  5543 leader_election.cc:304] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.857729  5725 raft_consensus.cc:2804] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.854779  5398 catalog_manager.cc:5697] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.858255  5725 raft_consensus.cc:697] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:05.858408  5739 raft_consensus.cc:2804] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.859265  5502 raft_consensus.cc:2468] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 1.
I20260709 13:15:05.859238  5725 consensus_queue.cc:237] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.864157  5651 raft_consensus.cc:2468] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 1.
I20260709 13:15:05.866566  5574 raft_consensus.cc:2468] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a969eee104434bb4647dcd6486b3cc in term 1.
I20260709 13:15:05.867930  5707 raft_consensus.cc:697] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:05.868134  5467 leader_election.cc:304] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:05.869588  5733 raft_consensus.cc:2804] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:05.870175  5733 raft_consensus.cc:697] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 LEADER]: Becoming Leader. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Running, Role: LEADER
I20260709 13:15:05.869338  5695 raft_consensus.cc:515] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.871131  5733 consensus_queue.cc:237] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.872634  5649 raft_consensus.cc:2393] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c2ff33a1b2cd480aa75922b143ab7b55 in current term 1: Already voted for candidate a1ff46d6092a4139b815792d98865386 in this term.
I20260709 13:15:05.870342  5501 raft_consensus.cc:2468] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
I20260709 13:15:05.876521  5695 leader_election.cc:290] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:05.878149  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:05.878207  5700 consensus_queue.cc:1048] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:05.881599  5739 raft_consensus.cc:697] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:05.871155  5707 consensus_queue.cc:237] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.883301  5501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:05.882810  5739 consensus_queue.cc:237] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:05.884855  5501 raft_consensus.cc:2393] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1ff46d6092a4139b815792d98865386 in current term 1: Already voted for candidate c2ff33a1b2cd480aa75922b143ab7b55 in this term.
I20260709 13:15:05.882094  5754 consensus_queue.cc:1048] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:05.890911  5616 leader_election.cc:304] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ff46d6092a4139b815792d98865386; no voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:05.892248  5695 raft_consensus.cc:2749] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:05.894133  5398 catalog_manager.cc:5697] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a969eee104434bb4647dcd6486b3cc (127.26.202.1). New cstate: current_term: 1 leader_uuid: "44a969eee104434bb4647dcd6486b3cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.911799  5400 catalog_manager.cc:5697] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.911162  5399 catalog_manager.cc:5697] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:05.913692  5400 catalog_manager.cc:5697] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.010004  5733 consensus_queue.cc:1048] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.019784  5574 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:06.024834  5734 consensus_queue.cc:1048] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:06.030823  5734 consensus_queue.cc:1048] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.040397 27432 ts_manager.cc:295] Set tserver state for 44a969eee104434bb4647dcd6486b3cc to MAINTENANCE_MODE
I20260709 13:15:06.041342 27432 tablet_server.cc:179] TabletServer@127.26.202.1:0 shutting down...
I20260709 13:15:06.046564  5734 consensus_queue.cc:1048] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:06.078697 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:06.079607 27432 tablet_replica.cc:333] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.080322 27432 raft_consensus.cc:2243] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.080758 27432 raft_consensus.cc:2272] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.082825 27432 tablet_replica.cc:333] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.083417 27432 raft_consensus.cc:2243] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.083817 27432 raft_consensus.cc:2272] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.085664 27432 tablet_replica.cc:333] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.086424 27432 raft_consensus.cc:2243] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.087275 27432 raft_consensus.cc:2272] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.089628 27432 tablet_replica.cc:333] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.090235 27432 raft_consensus.cc:2243] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:06.090837 27432 pending_rounds.cc:70] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Trying to abort 1 pending ops.
I20260709 13:15:06.091035 27432 pending_rounds.cc:77] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637502486863872 op_type: NO_OP noop_request { }
I20260709 13:15:06.091337 27432 raft_consensus.cc:2889] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:06.091638 27432 raft_consensus.cc:2272] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.093916 27432 tablet_replica.cc:333] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.094558 27432 raft_consensus.cc:2243] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.094893 27432 raft_consensus.cc:2272] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.096530 27432 tablet_replica.cc:333] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.097034 27432 raft_consensus.cc:2243] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.097528 27432 raft_consensus.cc:2272] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.099889 27432 tablet_replica.cc:333] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.100430 27432 raft_consensus.cc:2243] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.100898 27432 raft_consensus.cc:2272] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.103137 27432 tablet_replica.cc:333] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.103812 27432 raft_consensus.cc:2243] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.104197 27432 raft_consensus.cc:2272] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.106541 27432 tablet_replica.cc:333] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.107133 27432 raft_consensus.cc:2243] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:15:06.107290  5542 consensus_peers.cc:597] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.108103 27432 raft_consensus.cc:2272] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.110348 27432 tablet_replica.cc:333] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: stopping tablet replica
I20260709 13:15:06.110785 27432 raft_consensus.cc:2243] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.111129 27432 raft_consensus.cc:2272] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.144325 27432 tablet_server.cc:196] TabletServer@127.26.202.1:0 shutdown complete.
W20260709 13:15:06.200037  5616 consensus_peers.cc:597] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.259903  5754 consensus_queue.cc:1048] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:06.271225  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:15:06.271301  5542 consensus_peers.cc:597] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.305182  5725 consensus_queue.cc:1048] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:06.316926  5542 consensus_peers.cc:597] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.384980  5707 consensus_queue.cc:1048] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:06.406913  5616 consensus_peers.cc:597] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:06.421553  5542 consensus_peers.cc:597] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.435714  5725 consensus_queue.cc:1048] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:06.444324  5542 consensus_peers.cc:597] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:06.478466  5725 consensus_queue.cc:1048] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:07.272702  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:15:07.320010  5542 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111) [suppressed 130 similar messages]
I20260709 13:15:07.520825  5695 raft_consensus.cc:493] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a969eee104434bb4647dcd6486b3cc)
I20260709 13:15:07.521411  5695 raft_consensus.cc:515] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.523249  5695 leader_election.cc:290] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:07.525135  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
W20260709 13:15:07.527273  5616 leader_election.cc:336] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111)
I20260709 13:15:07.527639  5616 leader_election.cc:304] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1ff46d6092a4139b815792d98865386; no voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:07.528360  5695 raft_consensus.cc:2749] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:07.535184  5774 raft_consensus.cc:493] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a969eee104434bb4647dcd6486b3cc)
I20260709 13:15:07.535809  5774 raft_consensus.cc:515] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.537639  5774 leader_election.cc:290] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:07.538847  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:07.539587  5651 raft_consensus.cc:2468] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 1.
I20260709 13:15:07.540024  5774 raft_consensus.cc:493] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a969eee104434bb4647dcd6486b3cc)
I20260709 13:15:07.540580  5774 raft_consensus.cc:515] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.540813  5543 leader_election.cc:304] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:07.541767  5739 raft_consensus.cc:2804] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:07.541942  5542 leader_election.cc:336] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111)
I20260709 13:15:07.542186  5739 raft_consensus.cc:493] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a969eee104434bb4647dcd6486b3cc)
I20260709 13:15:07.542588  5739 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.542834  5774 leader_election.cc:290] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:07.544090  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0860a05280034829bf2312ed6739890d" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
W20260709 13:15:07.547385  5542 leader_election.cc:336] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111)
I20260709 13:15:07.547946  5542 leader_election.cc:304] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2ff33a1b2cd480aa75922b143ab7b55; no voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386
I20260709 13:15:07.549081  5774 raft_consensus.cc:2749] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:07.550459  5739 raft_consensus.cc:515] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.552908  5739 leader_election.cc:290] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:07.554509  5695 raft_consensus.cc:493] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a969eee104434bb4647dcd6486b3cc)
I20260709 13:15:07.555369  5695 raft_consensus.cc:515] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.557749  5695 leader_election.cc:290] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
W20260709 13:15:07.558107  5542 leader_election.cc:336] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111)
I20260709 13:15:07.560130  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0860a05280034829bf2312ed6739890d" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:07.560348  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:07.560832  5651 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.560878  5574 raft_consensus.cc:2468] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 1.
I20260709 13:15:07.562139  5616 leader_election.cc:304] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
W20260709 13:15:07.562994  5616 leader_election.cc:336] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111)
I20260709 13:15:07.562989  5695 raft_consensus.cc:2804] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:07.563652  5695 raft_consensus.cc:493] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a969eee104434bb4647dcd6486b3cc)
I20260709 13:15:07.564024  5695 raft_consensus.cc:3060] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.567915  5651 raft_consensus.cc:2468] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 2.
I20260709 13:15:07.569224  5543 leader_election.cc:304] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 44a969eee104434bb4647dcd6486b3cc
I20260709 13:15:07.570137  5739 raft_consensus.cc:2804] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:07.569985  5695 raft_consensus.cc:515] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.570657  5739 raft_consensus.cc:697] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:07.571475  5739 consensus_queue.cc:237] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.572057  5695 leader_election.cc:290] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:07.573829  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0860a05280034829bf2312ed6739890d" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:07.574544  5574 raft_consensus.cc:3060] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.580278  5574 raft_consensus.cc:2468] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:07.579962  5400 catalog_manager.cc:5697] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 1 to 2, leader changed from 44a969eee104434bb4647dcd6486b3cc (127.26.202.1) to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:07.581727  5616 leader_election.cc:304] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:07.582551  5695 raft_consensus.cc:2804] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:07.583855  5695 raft_consensus.cc:697] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
W20260709 13:15:07.584498  5616 leader_election.cc:336] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111)
I20260709 13:15:07.584818  5695 consensus_queue.cc:237] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.594939  5398 catalog_manager.cc:5697] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 1 to 2, leader changed from 44a969eee104434bb4647dcd6486b3cc (127.26.202.1) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:07.976022  5651 raft_consensus.cc:1275] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.977782  5774 consensus_queue.cc:1048] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:07.994688  5542 consensus_peers.cc:597] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:07.996448  5695 raft_consensus.cc:493] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.997232  5695 raft_consensus.cc:515] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:07.999378  5695 leader_election.cc:290] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:08.000627  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:08.001545  5574 raft_consensus.cc:2468] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 1.
I20260709 13:15:08.002709  5616 leader_election.cc:304] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:08.003561  5695 raft_consensus.cc:2804] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:08.003748  5616 leader_election.cc:336] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111)
I20260709 13:15:08.004055  5695 raft_consensus.cc:493] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.004477  5695 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.010389  5695 raft_consensus.cc:515] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:08.012619  5695 leader_election.cc:290] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:08.014456  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:08.015159  5574 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:08.016732  5616 leader_election.cc:336] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111)
I20260709 13:15:08.020664  5574 raft_consensus.cc:2468] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:08.022055  5616 leader_election.cc:304] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 44a969eee104434bb4647dcd6486b3cc
I20260709 13:15:08.022802  5695 raft_consensus.cc:2804] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:08.023312  5695 raft_consensus.cc:697] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:08.024117  5695 consensus_queue.cc:237] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:08.031839  5400 catalog_manager.cc:5697] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 1 to 2, leader changed from 44a969eee104434bb4647dcd6486b3cc (127.26.202.1) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:08.034795  5616 consensus_peers.cc:597] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:08.054085  5574 raft_consensus.cc:1275] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:08.055670  5695 consensus_queue.cc:1048] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:08.273940  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:08.455973  5574 raft_consensus.cc:1275] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:08.457952  5777 consensus_queue.cc:1048] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:08.476742  5616 consensus_peers.cc:597] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:08.550302  5542 consensus_peers.cc:597] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.680372  5542 consensus_peers.cc:597] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.704694  5616 consensus_peers.cc:597] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.780493  5542 consensus_peers.cc:597] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.844957  5542 consensus_peers.cc:597] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.894320  5542 consensus_peers.cc:597] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:09.033089  5616 consensus_peers.cc:597] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:09.275250  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:15:10.276643  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:15:10.387727  5542 consensus_peers.cc:597] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:10.529443  5616 consensus_peers.cc:597] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:10.933894  5616 consensus_peers.cc:597] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:11.010845  5542 consensus_peers.cc:597] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:11.164801 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:11.168597  5616 consensus_peers.cc:597] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:11.172736  5793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.174052  5794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:11.174677 27432 server_base.cc:1061] running on GCE node
W20260709 13:15:11.174642  5796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:11.177120 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:11.177378 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:11.177610 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602911177588 us; error 0 us; skew 500 ppm
I20260709 13:15:11.178212 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:11.180868 27432 webserver.cc:533] Webserver started at http://127.26.202.1:37929/ using document root <none> and password file <none>
I20260709 13:15:11.181519 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:11.181689 27432 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:15:11.185941 27432 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:11.190346  5801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.191296 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:15:11.191705 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "44a969eee104434bb4647dcd6486b3cc"
format_stamp: "Formatted at 2026-07-09 13:15:04 on dist-test-slave-008w"
I20260709 13:15:11.192034 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:11.205361 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:11.206535 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:11.208105 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:11.211895  5808 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:15:11.261626  5542 consensus_peers.cc:597] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:11.276593 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:15:11.277063 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.066s	user 0.003s	sys 0.000s
I20260709 13:15:11.277387 27432 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
W20260709 13:15:11.277755  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:11.282490  5808 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
W20260709 13:15:11.287300  5542 consensus_peers.cc:597] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:11.303968  5808 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.304975  5808 tablet_bootstrap.cc:492] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.305761  5808 ts_tablet_manager.cc:1403] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:15:11.307840  5808 raft_consensus.cc:359] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.308434  5808 raft_consensus.cc:740] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.309165  5808 consensus_queue.cc:260] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.311445  5808 ts_tablet_manager.cc:1434] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:11.312245  5808 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.324923  5808 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.325773  5808 tablet_bootstrap.cc:492] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.326368  5808 ts_tablet_manager.cc:1403] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 13:15:11.328495  5808 raft_consensus.cc:359] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.329108  5808 raft_consensus.cc:740] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.329784  5808 consensus_queue.cc:260] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.331076 27432 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:15:11.331259  5808 ts_tablet_manager.cc:1434] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:11.331408 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.054s	user 0.051s	sys 0.000s
I20260709 13:15:11.332248  5808 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.351080  5808 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.352459  5808 tablet_bootstrap.cc:492] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.353402  5808 ts_tablet_manager.cc:1403] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 13:15:11.356997  5808 raft_consensus.cc:359] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.357900  5808 raft_consensus.cc:740] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.358793  5808 consensus_queue.cc:260] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.361218  5808 ts_tablet_manager.cc:1434] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:11.362079  5808 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.427487  5808 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:15:11.429543  5808 tablet_bootstrap.cc:492] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.430711  5808 ts_tablet_manager.cc:1403] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.012s
I20260709 13:15:11.435317  5808 raft_consensus.cc:359] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.437059  5808 raft_consensus.cc:740] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.438313  5808 consensus_queue.cc:260] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.442194  5808 ts_tablet_manager.cc:1434] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.008s
I20260709 13:15:11.444211  5808 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.457540 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:40165
I20260709 13:15:11.458231  5870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:40165 every 8 connection(s)
I20260709 13:15:11.465277  5808 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.466049 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:11.466369  5808 tablet_bootstrap.cc:492] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.467644  5808 ts_tablet_manager.cc:1403] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:15:11.471192  5808 raft_consensus.cc:359] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.472110  5808 raft_consensus.cc:385] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.472553  5808 raft_consensus.cc:740] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.473436  5808 consensus_queue.cc:260] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.476135  5808 ts_tablet_manager.cc:1434] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:11.477684  5808 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.481673  5846 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.500283  5873 heartbeater.cc:344] Connected to a master server at 127.26.202.62:40125
I20260709 13:15:11.501035  5873 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:11.502058  5873 heartbeater.cc:507] Master 127.26.202.62:40125 requested a full tablet report, sending...
I20260709 13:15:11.511195  5808 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.512108  5808 tablet_bootstrap.cc:492] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.512698  5808 ts_tablet_manager.cc:1403] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.004s
I20260709 13:15:11.517519  5808 raft_consensus.cc:359] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.518916  5808 raft_consensus.cc:740] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.519781  5808 consensus_queue.cc:260] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.522189  5808 ts_tablet_manager.cc:1434] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.005s
I20260709 13:15:11.522596  5574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
mode: GRACEFUL
new_leader_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:15:11.523241  5808 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.523454  5574 raft_consensus.cc:606] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Received request to transfer leadership to TS a1ff46d6092a4139b815792d98865386
I20260709 13:15:11.528894  5398 ts_manager.cc:194] Re-registered known tserver with Master: 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165)
I20260709 13:15:11.529395  5574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
mode: GRACEFUL
new_leader_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:15:11.530180  5574 raft_consensus.cc:606] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Received request to transfer leadership to TS a1ff46d6092a4139b815792d98865386
I20260709 13:15:11.532003 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:11.532801 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:11.533721 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:11.547801  5808 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.548864  5808 tablet_bootstrap.cc:492] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.549608  5808 ts_tablet_manager.cc:1403] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 13:15:11.552397  5398 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46030
I20260709 13:15:11.552608  5808 raft_consensus.cc:359] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:11.553402  5808 raft_consensus.cc:740] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.554412  5808 consensus_queue.cc:260] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:11.556188  5808 ts_tablet_manager.cc:1434] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:11.556880  5873 heartbeater.cc:499] Master 127.26.202.62:40125 was elected leader, sending a full tablet report...
I20260709 13:15:11.556908  5808 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.564258  5846 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.571297  5846 pending_rounds.cc:85] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Aborting all ops after (but not including) 0
I20260709 13:15:11.571600  5846 pending_rounds.cc:107] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:15:11.571940  5846 raft_consensus.cc:2889] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:11.576455  5808 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.577526  5808 tablet_bootstrap.cc:492] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.578169  5808 ts_tablet_manager.cc:1403] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:15:11.580681  5808 raft_consensus.cc:359] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.581331  5808 raft_consensus.cc:740] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.581969  5808 consensus_queue.cc:260] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.583725  5808 ts_tablet_manager.cc:1434] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:15:11.584431  5808 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.595753  5808 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.596494  5808 tablet_bootstrap.cc:492] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.597155  5808 ts_tablet_manager.cc:1403] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:15:11.599123  5808 raft_consensus.cc:359] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.599628  5808 raft_consensus.cc:740] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.600302  5808 consensus_queue.cc:260] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.601890  5808 ts_tablet_manager.cc:1434] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:11.602842  5808 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap starting.
I20260709 13:15:11.613822  5808 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:11.614566  5808 tablet_bootstrap.cc:492] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Bootstrap complete.
I20260709 13:15:11.615175  5808 ts_tablet_manager.cc:1403] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:15:11.617182  5808 raft_consensus.cc:359] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.617717  5808 raft_consensus.cc:740] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a969eee104434bb4647dcd6486b3cc, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.618317  5808 consensus_queue.cc:260] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.620036  5808 ts_tablet_manager.cc:1434] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:11.681170  5882 raft_consensus.cc:993] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55: : Instructing follower a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:11.681725  5882 raft_consensus.cc:1081] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Signalling peer a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:11.683995  5651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:15:11.683983  5845 raft_consensus.cc:3060] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.684769  5651 raft_consensus.cc:493] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:11.685376  5651 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.694501  5651 raft_consensus.cc:515] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.697207  5651 leader_election.cc:290] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:11.698276  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:11.699180  5846 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.700052  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:11.700779  5574 raft_consensus.cc:3055] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:11.701220  5574 raft_consensus.cc:740] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:11.702322  5574 consensus_queue.cc:260] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.704134  5574 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.708899  5846 raft_consensus.cc:2468] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:11.710543  5616 leader_election.cc:304] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:11.711434  5792 raft_consensus.cc:2804] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.711877  5792 raft_consensus.cc:697] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:11.712749  5792 consensus_queue.cc:237] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.714136  5574 raft_consensus.cc:2468] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:11.721966  5398 catalog_manager.cc:5697] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 1 to 2, leader changed from c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.726167  5774 raft_consensus.cc:993] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55: : Instructing follower a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:11.726764  5882 raft_consensus.cc:1081] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Signalling peer a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:11.728785  5651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:15:11.729359  5651 raft_consensus.cc:493] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:11.729674  5651 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.737737  5651 raft_consensus.cc:515] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.740377  5651 leader_election.cc:290] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 3 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:11.740844  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:11.741591  5846 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.742359  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:11.743065  5577 raft_consensus.cc:3055] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:11.743412  5577 raft_consensus.cc:740] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:11.744508  5577 consensus_queue.cc:260] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.746057  5577 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.750087  5846 raft_consensus.cc:2468] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 3.
I20260709 13:15:11.751420  5616 leader_election.cc:304] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:11.752180  5792 raft_consensus.cc:2804] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:11.752668  5792 raft_consensus.cc:697] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:11.753760  5792 consensus_queue.cc:237] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.754235  5577 raft_consensus.cc:2468] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 3.
I20260709 13:15:11.762094  5398 catalog_manager.cc:5697] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 2 to 3, leader changed from c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.809163  5810 raft_consensus.cc:493] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.809737  5810 raft_consensus.cc:515] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:11.812077  5810 leader_election.cc:290] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:11.821395  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" is_pre_election: true
I20260709 13:15:11.825907  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb" candidate_uuid: "44a969eee104434bb4647dcd6486b3cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1ff46d6092a4139b815792d98865386" is_pre_election: true
I20260709 13:15:11.827342  5805 leader_election.cc:304] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc; no voters: a1ff46d6092a4139b815792d98865386, c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:11.828169  5810 raft_consensus.cc:2749] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.838340  5846 raft_consensus.cc:3060] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.136653  5846 raft_consensus.cc:1275] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:12.138099  5889 consensus_queue.cc:1048] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:12.149469  5577 raft_consensus.cc:1275] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:12.151292  5903 consensus_queue.cc:1048] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:12.167557  5846 raft_consensus.cc:1275] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.169229  5903 consensus_queue.cc:1048] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.180464  5577 raft_consensus.cc:1275] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.182560  5903 consensus_queue.cc:1048] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:12.278874  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:12.553753 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:12.574656  5649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
mode: GRACEFUL
new_leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:46624
I20260709 13:15:12.575347  5649 raft_consensus.cc:606] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Received request to transfer leadership to TS c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:12.577595  5792 raft_consensus.cc:993] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386: : Instructing follower c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:12.578105  5903 raft_consensus.cc:1081] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Signalling peer c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:12.578419  5649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
mode: GRACEFUL
new_leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:46624
I20260709 13:15:12.579071  5649 raft_consensus.cc:606] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Received request to transfer leadership to TS c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:12.579695  5577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:34076
I20260709 13:15:12.580351  5577 raft_consensus.cc:493] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.580704  5577 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.581833  5574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
mode: GRACEFUL
new_leader_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:15:12.582422  5574 raft_consensus.cc:606] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Received request to transfer leadership to TS a1ff46d6092a4139b815792d98865386
I20260709 13:15:12.583735 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:12.584285 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:12.584987 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:12.586652  5577 raft_consensus.cc:515] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:12.589046  5577 leader_election.cc:290] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:12.589387  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:12.589638  5649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:12.590066  5846 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.590322  5649 raft_consensus.cc:3055] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.590587  5649 raft_consensus.cc:740] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:12.591363  5649 consensus_queue.cc:260] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:12.592566  5649 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.596444  5846 raft_consensus.cc:2468] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 2.
I20260709 13:15:12.597901  5542 leader_election.cc:304] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:12.598634  5904 raft_consensus.cc:2804] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:12.599072  5904 raft_consensus.cc:697] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:12.599254  5649 raft_consensus.cc:2468] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 2.
I20260709 13:15:12.600069  5904 consensus_queue.cc:237] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:12.608120  5398 catalog_manager.cc:5697] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 1 to 2, leader changed from a1ff46d6092a4139b815792d98865386 (127.26.202.3) to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.807964  5909 raft_consensus.cc:993] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: : Instructing follower c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:12.808607  5903 raft_consensus.cc:1081] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Signalling peer c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:12.810201  5577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:34076
I20260709 13:15:12.810793  5577 raft_consensus.cc:493] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.811173  5577 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.817422  5577 raft_consensus.cc:515] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:12.819172  5577 leader_election.cc:290] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 election: Requested vote from peers a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775), 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165)
I20260709 13:15:12.820087  5649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:12.820237  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:12.820789  5649 raft_consensus.cc:3055] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.820854  5846 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.821169  5649 raft_consensus.cc:740] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:12.822057  5649 consensus_queue.cc:260] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:12.823087  5649 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.826413  5846 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 2.
I20260709 13:15:12.827705  5542 leader_election.cc:304] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:12.828576  5904 raft_consensus.cc:2804] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:12.829097  5904 raft_consensus.cc:697] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:12.829885  5649 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 2.
I20260709 13:15:12.829977  5904 consensus_queue.cc:237] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:12.837983  5398 catalog_manager.cc:5697] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 1 to 2, leader changed from a1ff46d6092a4139b815792d98865386 (127.26.202.3) to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.989490  5774 raft_consensus.cc:993] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55: : Instructing follower a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:12.990049  5904 raft_consensus.cc:1081] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Signalling peer a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:12.991657  5649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:15:12.992231  5649 raft_consensus.cc:493] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.992367  5846 raft_consensus.cc:1275] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:12.992586  5649 raft_consensus.cc:3060] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.993896  5774 consensus_queue.cc:1048] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.000334  5649 raft_consensus.cc:515] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:13.003618  5845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:13.003618  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcb4de792964fb4a55272eb57c5fe3e" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:13.004415  5845 raft_consensus.cc:3060] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.004771  5577 raft_consensus.cc:3055] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.005264  5577 raft_consensus.cc:740] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:13.006186  5577 consensus_queue.cc:260] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:13.010011  5577 raft_consensus.cc:3060] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.010470  5651 raft_consensus.cc:1275] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.013726  5774 consensus_queue.cc:1048] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.016705  5845 raft_consensus.cc:2468] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:13.019001  5616 leader_election.cc:304] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:13.017282  5649 leader_election.cc:290] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:13.020147  5903 raft_consensus.cc:2804] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.020622  5903 raft_consensus.cc:697] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:13.020766  5577 raft_consensus.cc:2468] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:13.022426  5903 consensus_queue.cc:237] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:13.043613  5398 catalog_manager.cc:5697] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 1 to 2, leader changed from c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.217299  5846 raft_consensus.cc:1275] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.218703  5774 consensus_queue.cc:1048] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.228384  5651 raft_consensus.cc:1275] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.230202  5926 consensus_queue.cc:1048] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:13.279920  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:13.407258  5577 raft_consensus.cc:1275] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.408867  5903 consensus_queue.cc:1048] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.418637  5846 raft_consensus.cc:1275] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.421162  5929 consensus_queue.cc:1048] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.594259 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:13.602972  5651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
mode: GRACEFUL
new_leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:46624
I20260709 13:15:13.603631  5651 raft_consensus.cc:606] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Received request to transfer leadership to TS c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:13.606866  5577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
mode: GRACEFUL
new_leader_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:15:13.607566  5577 raft_consensus.cc:606] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Received request to transfer leadership to TS a1ff46d6092a4139b815792d98865386
I20260709 13:15:13.610616  5577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
mode: GRACEFUL
new_leader_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:15:13.611115  5577 raft_consensus.cc:606] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Received request to transfer leadership to TS a1ff46d6092a4139b815792d98865386
I20260709 13:15:13.612221 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:13.612756 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:13.613384 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:13.653784  5774 raft_consensus.cc:993] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55: : Instructing follower a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:13.654381  5926 raft_consensus.cc:1081] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Signalling peer a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:13.656095  5649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:15:13.656687  5649 raft_consensus.cc:493] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.657122  5649 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.662135  5649 raft_consensus.cc:515] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:13.663751  5649 leader_election.cc:290] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 3 election: Requested vote from peers c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523), 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165)
I20260709 13:15:13.664763  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:13.664949  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:13.665383  5577 raft_consensus.cc:3055] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.665587  5846 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.665940  5577 raft_consensus.cc:740] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:13.666865  5577 consensus_queue.cc:260] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:13.667833  5577 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.671492  5846 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 3.
I20260709 13:15:13.672741  5616 leader_election.cc:304] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:13.672887  5577 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 3.
I20260709 13:15:13.673527  5929 raft_consensus.cc:2804] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.674037  5929 raft_consensus.cc:697] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:13.674806  5929 consensus_queue.cc:237] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:13.681758  5399 catalog_manager.cc:5697] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 2 to 3, leader changed from c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.789829  5909 raft_consensus.cc:993] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386: : Instructing follower c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:13.790285  5929 raft_consensus.cc:1081] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Signalling peer c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:13.791735  5577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:34076
I20260709 13:15:13.792220  5577 raft_consensus.cc:493] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.792577  5577 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.798938  5577 raft_consensus.cc:515] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:13.800773  5577 leader_election.cc:290] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 3 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:13.801868  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:13.801893  5649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071a230265da4ca0865fb4cf6be13ea9" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:13.802817  5846 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.802850  5649 raft_consensus.cc:3055] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.803406  5649 raft_consensus.cc:740] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:13.804358  5649 consensus_queue.cc:260] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:13.805748  5649 raft_consensus.cc:3060] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.810829  5846 raft_consensus.cc:2468] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 3.
I20260709 13:15:13.812287  5542 leader_election.cc:304] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:13.813055  5649 raft_consensus.cc:2468] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 3.
I20260709 13:15:13.813167  5926 raft_consensus.cc:2804] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.813846  5926 raft_consensus.cc:697] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:13.814839  5926 consensus_queue.cc:237] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:13.822829  5399 catalog_manager.cc:5697] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 2 to 3, leader changed from a1ff46d6092a4139b815792d98865386 (127.26.202.3) to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.057435  5846 raft_consensus.cc:1275] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:14.058969  5909 consensus_queue.cc:1048] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.070149  5577 raft_consensus.cc:1275] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:14.071761  5935 consensus_queue.cc:1048] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.084533  5774 raft_consensus.cc:993] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55: : Instructing follower a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:14.085143  5926 raft_consensus.cc:1081] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Signalling peer a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:14.086771  5649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:15:14.087357  5649 raft_consensus.cc:493] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.087677  5649 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.094609  5649 raft_consensus.cc:515] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.096385  5649 leader_election.cc:290] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 3 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:14.097316  5845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:14.097669  5577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bef056819f146bcb3e5121aacc32b39" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:14.097954  5845 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.098382  5577 raft_consensus.cc:3055] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:14.098702  5577 raft_consensus.cc:740] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:14.099514  5577 consensus_queue.cc:260] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.100585  5577 raft_consensus.cc:3060] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.103555  5845 raft_consensus.cc:2468] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 3.
I20260709 13:15:14.104768  5616 leader_election.cc:304] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:14.105733  5935 raft_consensus.cc:2804] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:14.106206  5935 raft_consensus.cc:697] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:14.106714  5577 raft_consensus.cc:2468] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 3.
I20260709 13:15:14.106940  5935 consensus_queue.cc:237] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.114951  5398 catalog_manager.cc:5697] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 2 to 3, leader changed from c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:14.281112  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:14.398227  5651 raft_consensus.cc:1275] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:14.399542  5926 consensus_queue.cc:1048] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.407922  5845 raft_consensus.cc:1275] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:14.409638  5942 consensus_queue.cc:1048] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.619872 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:14.627811  5651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
mode: GRACEFUL
new_leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:46624
I20260709 13:15:14.628404  5651 raft_consensus.cc:606] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Received request to transfer leadership to TS c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:14.631333  5651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
mode: GRACEFUL
new_leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:46624
I20260709 13:15:14.631816  5651 raft_consensus.cc:606] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Received request to transfer leadership to TS c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:14.634574  5577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fae69f0e08cd4fc59615404e810ebae6"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
mode: GRACEFUL
new_leader_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:15:14.635080  5577 raft_consensus.cc:606] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Received request to transfer leadership to TS a1ff46d6092a4139b815792d98865386
I20260709 13:15:14.636262 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:14.636783 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:14.637377 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:14.678476  5944 raft_consensus.cc:993] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386: : Instructing follower c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:14.679118  5935 raft_consensus.cc:1081] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Signalling peer c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:14.680727  5577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:34076
I20260709 13:15:14.681237  5577 raft_consensus.cc:493] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.681500  5577 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.686108  5577 raft_consensus.cc:515] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.688292  5577 leader_election.cc:290] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 3 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:14.689067  5845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:14.689386  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db384ebddbb4cc5b286364da5177128" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:14.689761  5845 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.690109  5651 raft_consensus.cc:3055] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:14.690464  5651 raft_consensus.cc:740] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:14.691243  5651 consensus_queue.cc:260] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.692624  5651 raft_consensus.cc:3060] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.695737  5846 raft_consensus.cc:1275] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:14.697149  5845 raft_consensus.cc:2468] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 3.
I20260709 13:15:14.697768  5944 consensus_queue.cc:1048] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.699708  5542 leader_election.cc:304] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:14.699817  5651 raft_consensus.cc:2468] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 3.
I20260709 13:15:14.701233  5926 raft_consensus.cc:2804] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:14.701715  5926 raft_consensus.cc:697] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:14.702706  5926 consensus_queue.cc:237] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.703423  5577 raft_consensus.cc:1275] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:14.706578  5935 consensus_queue.cc:1048] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.714855  5399 catalog_manager.cc:5697] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 2 to 3, leader changed from a1ff46d6092a4139b815792d98865386 (127.26.202.3) to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.719209  5935 raft_consensus.cc:993] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386: : Instructing follower c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:14.720309  5945 raft_consensus.cc:1081] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Signalling peer c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:14.726864  5574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:34076
I20260709 13:15:14.727478  5574 raft_consensus.cc:493] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.727865  5574 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:14.736167  5574 raft_consensus.cc:515] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.738277  5574 leader_election.cc:290] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 4 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775)
I20260709 13:15:14.739133  5845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:14.739368  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f22e67d11f416d8bda69478df8aca4" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:14.739802  5845 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:14.739956  5651 raft_consensus.cc:3055] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:14.740360  5651 raft_consensus.cc:740] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:14.741094  5651 consensus_queue.cc:260] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.742308  5651 raft_consensus.cc:3060] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:14.745536  5845 raft_consensus.cc:2468] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 4.
I20260709 13:15:14.746851  5542 leader_election.cc:304] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:14.747381  5651 raft_consensus.cc:2468] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 4.
I20260709 13:15:14.747767  5926 raft_consensus.cc:2804] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:14.748384  5926 raft_consensus.cc:697] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:14.749250  5926 consensus_queue.cc:237] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.756651  5399 catalog_manager.cc:5697] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 3 to 4, leader changed from a1ff46d6092a4139b815792d98865386 (127.26.202.3) to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 4 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.907274  5942 raft_consensus.cc:993] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55: : Instructing follower a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:14.907819  5926 raft_consensus.cc:1081] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Signalling peer a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:14.909196  5651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fae69f0e08cd4fc59615404e810ebae6"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:15:14.909724  5651 raft_consensus.cc:493] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.909996  5651 raft_consensus.cc:3060] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.914870  5651 raft_consensus.cc:515] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.916474  5651 leader_election.cc:290] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:14.917331  5845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae69f0e08cd4fc59615404e810ebae6" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:14.917511  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae69f0e08cd4fc59615404e810ebae6" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:14.917969  5845 raft_consensus.cc:3060] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.918056  5574 raft_consensus.cc:3055] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:14.918437  5574 raft_consensus.cc:740] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:14.919227  5574 consensus_queue.cc:260] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.920504  5574 raft_consensus.cc:3060] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.925073  5845 raft_consensus.cc:2468] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:14.926214  5616 leader_election.cc:304] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:14.927127  5935 raft_consensus.cc:2804] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.927129  5574 raft_consensus.cc:2468] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:14.927692  5935 raft_consensus.cc:697] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:14.928781  5935 consensus_queue.cc:237] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:14.937626  5399 catalog_manager.cc:5697] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 1 to 2, leader changed from c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.154279  5651 raft_consensus.cc:1275] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 4 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:15.155970  5774 consensus_queue.cc:1048] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.163070  5845 raft_consensus.cc:1275] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:15.164961  5942 consensus_queue.cc:1048] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:15.166226  5845 raft_consensus.cc:1275] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 4 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:15.169389  5774 consensus_queue.cc:1048] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:15.176801  5651 raft_consensus.cc:1275] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:15.179930  5926 consensus_queue.cc:1048] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:15.282294  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:15.382246  5845 raft_consensus.cc:1275] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:15.383960  5935 consensus_queue.cc:1048] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:15.387004  5574 raft_consensus.cc:1275] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:15.388440  5935 consensus_queue.cc:1048] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:15.643846 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:15.651286  5574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5617a3488177480da431a01e0cf99155"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
mode: GRACEFUL
new_leader_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:15:15.651888  5574 raft_consensus.cc:606] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Received request to transfer leadership to TS a1ff46d6092a4139b815792d98865386
I20260709 13:15:15.654987  5651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
mode: GRACEFUL
new_leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:46624
I20260709 13:15:15.655535  5651 raft_consensus.cc:606] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Received request to transfer leadership to TS c2ff33a1b2cd480aa75922b143ab7b55
I20260709 13:15:15.658120  5574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
mode: GRACEFUL
new_leader_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:15:15.658574  5574 raft_consensus.cc:606] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Received request to transfer leadership to TS a1ff46d6092a4139b815792d98865386
I20260709 13:15:15.659860 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:15.660396 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:15.660979 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:15.662680  5774 raft_consensus.cc:993] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55: : Instructing follower a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:15.663230  5926 raft_consensus.cc:1081] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Signalling peer a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:15.664832  5651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5617a3488177480da431a01e0cf99155"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:15:15.665316  5651 raft_consensus.cc:493] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.665592  5651 raft_consensus.cc:3060] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.670197  5651 raft_consensus.cc:515] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:15.671638  5651 leader_election.cc:290] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:15.672513  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:15.672878  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5617a3488177480da431a01e0cf99155" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:15.673233  5846 raft_consensus.cc:3060] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.673540  5574 raft_consensus.cc:3055] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:15.673857  5574 raft_consensus.cc:740] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:15.674644  5574 consensus_queue.cc:260] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:15.675724  5574 raft_consensus.cc:3060] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.678495  5846 raft_consensus.cc:2468] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:15.679843  5616 leader_election.cc:304] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:15.680735  5960 raft_consensus.cc:2804] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:15.681290  5960 raft_consensus.cc:697] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:15.681414  5574 raft_consensus.cc:2468] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:15.682355  5960 consensus_queue.cc:237] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:15.691720  5398 catalog_manager.cc:5697] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 1 to 2, leader changed from c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.838721  5935 raft_consensus.cc:993] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: : Instructing follower c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:15.839231  5960 raft_consensus.cc:1081] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Signalling peer c2ff33a1b2cd480aa75922b143ab7b55 to start an election
I20260709 13:15:15.840682  5574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09"
dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
 from {username='slave'} at 127.0.0.1:34076
I20260709 13:15:15.841130  5574 raft_consensus.cc:493] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.841357  5574 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.845736  5574 raft_consensus.cc:515] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:15.847330  5574 leader_election.cc:290] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 4 election: Requested vote from peers a1ff46d6092a4139b815792d98865386 (127.26.202.3:39775), 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165)
I20260709 13:15:15.848187  5651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1ff46d6092a4139b815792d98865386"
I20260709 13:15:15.848546  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f5cffa266914dc8b8c846ae682e2e09" candidate_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:15.848778  5651 raft_consensus.cc:3055] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:15.849149  5846 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.849198  5651 raft_consensus.cc:740] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:15.849987  5651 consensus_queue.cc:260] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:15.850926  5651 raft_consensus.cc:3060] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.855262  5846 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 4.
I20260709 13:15:15.855785  5651 raft_consensus.cc:2468] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2ff33a1b2cd480aa75922b143ab7b55 in term 4.
I20260709 13:15:15.856447  5542 leader_election.cc:304] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, c2ff33a1b2cd480aa75922b143ab7b55; no voters: 
I20260709 13:15:15.857295  5926 raft_consensus.cc:2804] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:15.857724  5926 raft_consensus.cc:697] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 LEADER]: Becoming Leader. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:15.858486  5926 consensus_queue.cc:237] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } }
I20260709 13:15:15.865283  5398 catalog_manager.cc:5697] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 reported cstate change: term changed from 3 to 4, leader changed from a1ff46d6092a4139b815792d98865386 (127.26.202.3) to c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2). New cstate: current_term: 4 leader_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.050060  5774 raft_consensus.cc:993] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55: : Instructing follower a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:16.050554  5774 raft_consensus.cc:1081] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Signalling peer a1ff46d6092a4139b815792d98865386 to start an election
I20260709 13:15:16.052079  5651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb"
dest_uuid: "a1ff46d6092a4139b815792d98865386"
 from {username='slave'} at 127.0.0.1:46594
I20260709 13:15:16.052554  5651 raft_consensus.cc:493] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.052816  5651 raft_consensus.cc:3060] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.058267  5651 raft_consensus.cc:515] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:16.059948  5651 leader_election.cc:290] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Requested vote from peers 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165), c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523)
I20260709 13:15:16.060899  5846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44a969eee104434bb4647dcd6486b3cc"
I20260709 13:15:16.061285  5574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea9728262c5d40adbe8b6f99d9f27eeb" candidate_uuid: "a1ff46d6092a4139b815792d98865386" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2ff33a1b2cd480aa75922b143ab7b55"
I20260709 13:15:16.061534  5846 raft_consensus.cc:3060] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.062012  5574 raft_consensus.cc:3055] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.062325  5574 raft_consensus.cc:740] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2ff33a1b2cd480aa75922b143ab7b55, State: Running, Role: LEADER
I20260709 13:15:16.063083  5574 consensus_queue.cc:260] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:16.064081  5574 raft_consensus.cc:3060] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.066764  5846 raft_consensus.cc:2468] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:16.067957  5616 leader_election.cc:304] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a969eee104434bb4647dcd6486b3cc, a1ff46d6092a4139b815792d98865386; no voters: 
I20260709 13:15:16.068888  5960 raft_consensus.cc:2804] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.069622  5960 raft_consensus.cc:697] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Becoming Leader. State: Replica: a1ff46d6092a4139b815792d98865386, State: Running, Role: LEADER
I20260709 13:15:16.069850  5574 raft_consensus.cc:2468] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1ff46d6092a4139b815792d98865386 in term 2.
I20260709 13:15:16.070549  5960 consensus_queue.cc:237] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } }
I20260709 13:15:16.078282  5398 catalog_manager.cc:5697] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 reported cstate change: term changed from 1 to 2, leader changed from c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2) to a1ff46d6092a4139b815792d98865386 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "a1ff46d6092a4139b815792d98865386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:16.087132  5574 raft_consensus.cc:1275] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:16.088320  5960 consensus_queue.cc:1048] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:16.099992  5846 raft_consensus.cc:1275] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:16.102061  5935 consensus_queue.cc:1048] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:16.266968  5846 raft_consensus.cc:1275] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 4 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:16.268436  5774 consensus_queue.cc:1048] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:16.283250  5651 raft_consensus.cc:1275] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 4 FOLLOWER]: Refusing update from remote peer c2ff33a1b2cd480aa75922b143ab7b55: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:15:16.283418  5448 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:15:16.285211  5774 consensus_queue.cc:1048] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1ff46d6092a4139b815792d98865386" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:16.454492  5574 raft_consensus.cc:1275] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:16.456015  5971 consensus_queue.cc:1048] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ff33a1b2cd480aa75922b143ab7b55" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 33523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:16.467600  5846 raft_consensus.cc:1275] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Refusing update from remote peer a1ff46d6092a4139b815792d98865386: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:16.469135  5971 consensus_queue.cc:1048] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a969eee104434bb4647dcd6486b3cc" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 40165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:16.668296 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:16.698676 27432 tablet_server.cc:179] TabletServer@127.26.202.1:40165 shutting down...
I20260709 13:15:16.726399 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:16.727216 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.728075 27432 raft_consensus.cc:2243] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.728658 27432 raft_consensus.cc:2272] T 8fcb4de792964fb4a55272eb57c5fe3e P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.730705 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.731289 27432 raft_consensus.cc:2243] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.731734 27432 raft_consensus.cc:2272] T 7f5cffa266914dc8b8c846ae682e2e09 P 44a969eee104434bb4647dcd6486b3cc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.733952 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.734544 27432 raft_consensus.cc:2243] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.734982 27432 raft_consensus.cc:2272] T 5617a3488177480da431a01e0cf99155 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.737484 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.737998 27432 raft_consensus.cc:2243] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.738359 27432 raft_consensus.cc:2272] T fae69f0e08cd4fc59615404e810ebae6 P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.740449 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.741091 27432 raft_consensus.cc:2243] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.741568 27432 raft_consensus.cc:2272] T 95f22e67d11f416d8bda69478df8aca4 P 44a969eee104434bb4647dcd6486b3cc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.743748 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.744267 27432 raft_consensus.cc:2243] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.744688 27432 raft_consensus.cc:2272] T 071a230265da4ca0865fb4cf6be13ea9 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.747155 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.747825 27432 raft_consensus.cc:2243] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.748302 27432 raft_consensus.cc:2272] T 0860a05280034829bf2312ed6739890d P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.750828 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.751397 27432 raft_consensus.cc:2243] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.751856 27432 raft_consensus.cc:2272] T ea9728262c5d40adbe8b6f99d9f27eeb P 44a969eee104434bb4647dcd6486b3cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.754451 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.755084 27432 raft_consensus.cc:2243] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.755556 27432 raft_consensus.cc:2272] T 3db384ebddbb4cc5b286364da5177128 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.757629 27432 tablet_replica.cc:333] stopping tablet replica
I20260709 13:15:16.758174 27432 raft_consensus.cc:2243] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.758677 27432 raft_consensus.cc:2272] T 1bef056819f146bcb3e5121aacc32b39 P 44a969eee104434bb4647dcd6486b3cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.791378 27432 tablet_server.cc:196] TabletServer@127.26.202.1:40165 shutdown complete.
W20260709 13:15:16.808627  5542 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111) [suppressed 87 similar messages]
W20260709 13:15:16.812727  5542 consensus_peers.cc:597] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.826900 27432 tablet_server.cc:179] TabletServer@127.26.202.2:0 shutting down...
W20260709 13:15:16.832254  5616 consensus_peers.cc:597] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.834745  5542 consensus_peers.cc:597] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.847476  5616 consensus_peers.cc:597] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 -> Peer c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523): Couldn't send request to peer c2ff33a1b2cd480aa75922b143ab7b55. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.857903  5616 consensus_peers.cc:597] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.859354  5542 consensus_peers.cc:597] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:16.878527  5616 consensus_peers.cc:597] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 -> Peer c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523): Couldn't send request to peer c2ff33a1b2cd480aa75922b143ab7b55. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.879949 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:16.880962 27432 tablet_replica.cc:333] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.882030 27432 raft_consensus.cc:2243] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:16.882097  5616 consensus_peers.cc:597] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 -> Peer c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523): Couldn't send request to peer c2ff33a1b2cd480aa75922b143ab7b55. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.882622 27432 raft_consensus.cc:2272] T 1bef056819f146bcb3e5121aacc32b39 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.885113 27432 tablet_replica.cc:333] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.885911 27432 raft_consensus.cc:2243] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.886787 27432 raft_consensus.cc:2272] T 95f22e67d11f416d8bda69478df8aca4 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.889108 27432 tablet_replica.cc:333] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.889751 27432 raft_consensus.cc:2243] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.890308 27432 raft_consensus.cc:2272] T 8fcb4de792964fb4a55272eb57c5fe3e P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.892750 27432 tablet_replica.cc:333] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.893571 27432 raft_consensus.cc:2243] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.894627 27432 raft_consensus.cc:2272] T 3db384ebddbb4cc5b286364da5177128 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.897580 27432 tablet_replica.cc:333] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
W20260709 13:15:16.897768  5542 consensus_peers.cc:597] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.898432 27432 raft_consensus.cc:2243] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.899247 27432 raft_consensus.cc:2272] T ea9728262c5d40adbe8b6f99d9f27eeb P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.902067 27432 tablet_replica.cc:333] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.902678 27432 raft_consensus.cc:2243] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.903214 27432 raft_consensus.cc:2272] T 0860a05280034829bf2312ed6739890d P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.905547 27432 tablet_replica.cc:333] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.906085 27432 raft_consensus.cc:2243] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.906867 27432 raft_consensus.cc:2272] T 071a230265da4ca0865fb4cf6be13ea9 P c2ff33a1b2cd480aa75922b143ab7b55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.909308 27432 tablet_replica.cc:333] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.909962 27432 raft_consensus.cc:2243] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.910450 27432 raft_consensus.cc:2272] T 5617a3488177480da431a01e0cf99155 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.914059 27432 tablet_replica.cc:333] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.914727 27432 raft_consensus.cc:2243] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:16.915208 27432 raft_consensus.cc:2272] T fae69f0e08cd4fc59615404e810ebae6 P c2ff33a1b2cd480aa75922b143ab7b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.917659 27432 tablet_replica.cc:333] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55: stopping tablet replica
I20260709 13:15:16.918197 27432 raft_consensus.cc:2243] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:16.919044 27432 raft_consensus.cc:2272] T 7f5cffa266914dc8b8c846ae682e2e09 P c2ff33a1b2cd480aa75922b143ab7b55 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:16.944871 27432 tablet_server.cc:196] TabletServer@127.26.202.2:0 shutdown complete.
I20260709 13:15:16.973307 27432 tablet_server.cc:179] TabletServer@127.26.202.3:0 shutting down...
I20260709 13:15:17.006528 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:17.007429 27432 tablet_replica.cc:333] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.008445 27432 raft_consensus.cc:2243] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:15:17.009429  5616 consensus_peers.cc:597] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 -> Peer c2ff33a1b2cd480aa75922b143ab7b55 (127.26.202.2:33523): Couldn't send request to peer c2ff33a1b2cd480aa75922b143ab7b55. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:33523: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.009526 27432 raft_consensus.cc:2272] T 1bef056819f146bcb3e5121aacc32b39 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.012130 27432 tablet_replica.cc:333] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.012687 27432 raft_consensus.cc:2243] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.013165 27432 raft_consensus.cc:2272] T 3db384ebddbb4cc5b286364da5177128 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.016052 27432 tablet_replica.cc:333] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.016630 27432 raft_consensus.cc:2243] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.017189 27432 raft_consensus.cc:2272] T 95f22e67d11f416d8bda69478df8aca4 P a1ff46d6092a4139b815792d98865386 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:17.018991  5616 consensus_peers.cc:597] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 -> Peer 44a969eee104434bb4647dcd6486b3cc (127.26.202.1:40165): Couldn't send request to peer 44a969eee104434bb4647dcd6486b3cc. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:40165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.019905 27432 tablet_replica.cc:333] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.020499 27432 raft_consensus.cc:2243] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.021274 27432 raft_consensus.cc:2272] T 5617a3488177480da431a01e0cf99155 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.023937 27432 tablet_replica.cc:333] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.024482 27432 raft_consensus.cc:2243] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.025245 27432 raft_consensus.cc:2272] T fae69f0e08cd4fc59615404e810ebae6 P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.027266 27432 tablet_replica.cc:333] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.027740 27432 raft_consensus.cc:2243] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.028651 27432 raft_consensus.cc:2272] T ea9728262c5d40adbe8b6f99d9f27eeb P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.031746 27432 tablet_replica.cc:333] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.032238 27432 raft_consensus.cc:2243] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.032620 27432 raft_consensus.cc:2272] T 071a230265da4ca0865fb4cf6be13ea9 P a1ff46d6092a4139b815792d98865386 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.034611 27432 tablet_replica.cc:333] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.035112 27432 raft_consensus.cc:2243] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.035853 27432 raft_consensus.cc:2272] T 0860a05280034829bf2312ed6739890d P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.038573 27432 tablet_replica.cc:333] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.039109 27432 raft_consensus.cc:2243] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.039940 27432 raft_consensus.cc:2272] T 8fcb4de792964fb4a55272eb57c5fe3e P a1ff46d6092a4139b815792d98865386 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.042101 27432 tablet_replica.cc:333] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386: stopping tablet replica
I20260709 13:15:17.042604 27432 raft_consensus.cc:2243] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:17.043002 27432 raft_consensus.cc:2272] T 7f5cffa266914dc8b8c846ae682e2e09 P a1ff46d6092a4139b815792d98865386 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.069794 27432 tablet_server.cc:196] TabletServer@127.26.202.3:0 shutdown complete.
I20260709 13:15:17.096108 27432 master.cc:562] Master@127.26.202.62:40125 shutting down...
I20260709 13:15:17.118777 27432 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:17.119297 27432 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:17.119621 27432 tablet_replica.cc:333] T 00000000000000000000000000000000 P 48597f956364486284b33d916d0f6266: stopping tablet replica
I20260709 13:15:17.140534 27432 master.cc:584] Master@127.26.202.62:40125 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13089 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:15:17.186848 27432 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.202.62:35267
I20260709 13:15:17.188022 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.194697  5992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.194712  5991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.195291  5994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.197561 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:17.198590 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.198781 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.198890 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602917198880 us; error 0 us; skew 500 ppm
I20260709 13:15:17.199357 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.202008 27432 webserver.cc:533] Webserver started at http://127.26.202.62:41211/ using document root <none> and password file <none>
I20260709 13:15:17.202468 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.202616 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.202828 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.204005 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/master-0-root/instance:
uuid: "6d95ea9f65d64f50880d150da90c1d61"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-008w"
I20260709 13:15:17.208721 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:17.213188  5999 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.214053 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:17.214344 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/master-0-root
uuid: "6d95ea9f65d64f50880d150da90c1d61"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-008w"
I20260709 13:15:17.214653 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.231236 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.232407 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.272493 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.62:35267
I20260709 13:15:17.272619  6050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.62:35267 every 8 connection(s)
I20260709 13:15:17.276892  6051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.289310  6051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61: Bootstrap starting.
I20260709 13:15:17.294750  6051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.299465  6051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61: No bootstrap required, opened a new log
I20260709 13:15:17.301718  6051 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d95ea9f65d64f50880d150da90c1d61" member_type: VOTER }
I20260709 13:15:17.302150  6051 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.302394  6051 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95ea9f65d64f50880d150da90c1d61, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.302975  6051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d95ea9f65d64f50880d150da90c1d61" member_type: VOTER }
I20260709 13:15:17.303423  6051 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:17.303675  6051 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:17.303979  6051 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.308835  6051 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d95ea9f65d64f50880d150da90c1d61" member_type: VOTER }
I20260709 13:15:17.309417  6051 leader_election.cc:304] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d95ea9f65d64f50880d150da90c1d61; no voters: 
I20260709 13:15:17.310774  6051 leader_election.cc:290] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:17.311159  6054 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.312927  6054 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 1 LEADER]: Becoming Leader. State: Replica: 6d95ea9f65d64f50880d150da90c1d61, State: Running, Role: LEADER
I20260709 13:15:17.313656  6054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d95ea9f65d64f50880d150da90c1d61" member_type: VOTER }
I20260709 13:15:17.313787  6051 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:17.318234  6055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d95ea9f65d64f50880d150da90c1d61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d95ea9f65d64f50880d150da90c1d61" member_type: VOTER } }
I20260709 13:15:17.319021  6055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:17.319129  6056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d95ea9f65d64f50880d150da90c1d61. Latest consensus state: current_term: 1 leader_uuid: "6d95ea9f65d64f50880d150da90c1d61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d95ea9f65d64f50880d150da90c1d61" member_type: VOTER } }
I20260709 13:15:17.320063  6056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:17.324674  6062 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:17.332647  6062 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:17.333804 27432 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:17.343068  6062 catalog_manager.cc:1383] Generated new cluster ID: d9a69eb946934e6eafab19b5e1f72499
I20260709 13:15:17.343456  6062 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:17.369616  6062 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:17.371066  6062 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:17.385694  6062 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61: Generated new TSK 0
I20260709 13:15:17.386492  6062 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:17.400631 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.407128  6072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.408241  6073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.410910 27432 server_base.cc:1061] running on GCE node
W20260709 13:15:17.411309  6075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.412330 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.412647 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.412779 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602917412767 us; error 0 us; skew 500 ppm
I20260709 13:15:17.413329 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.416023 27432 webserver.cc:533] Webserver started at http://127.26.202.1:37205/ using document root <none> and password file <none>
I20260709 13:15:17.416620 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.416822 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.417171 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.418262 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-0-root/instance:
uuid: "c9acd04f9dcf486d980dd3f149a52a36"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-008w"
I20260709 13:15:17.422928 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:17.426884  6080 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.427848 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:15:17.428126 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "c9acd04f9dcf486d980dd3f149a52a36"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-008w"
I20260709 13:15:17.428385 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.447542 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.448882 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.450485 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.453132 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.453347 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.453717 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.453890 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.500916 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:37773
I20260709 13:15:17.501145  6142 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:37773 every 8 connection(s)
I20260709 13:15:17.506496 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.514071  6147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.514933  6148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.519583  6150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.520181 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:17.520370  6143 heartbeater.cc:344] Connected to a master server at 127.26.202.62:35267
I20260709 13:15:17.520875  6143 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:17.521445 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.521731 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.521657  6143 heartbeater.cc:507] Master 127.26.202.62:35267 requested a full tablet report, sending...
I20260709 13:15:17.522166 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602917522142 us; error 0 us; skew 500 ppm
I20260709 13:15:17.522814 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.524276  6016 ts_manager.cc:194] Registered new tserver with Master: c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773)
I20260709 13:15:17.525780 27432 webserver.cc:533] Webserver started at http://127.26.202.2:43369/ using document root <none> and password file <none>
I20260709 13:15:17.526492 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.526526  6016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40732
I20260709 13:15:17.526746 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.527120 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.528472 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-1-root/instance:
uuid: "044a0ed9bbb64a84be83125d6af11cab"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-008w"
I20260709 13:15:17.533380 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:17.537120  6155 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.538151 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:15:17.538509 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-1-root
uuid: "044a0ed9bbb64a84be83125d6af11cab"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-008w"
I20260709 13:15:17.538820 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.560914 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.562244 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.563756 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.566376 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.566746 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.567080 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.567284 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.614817 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.2:37397
I20260709 13:15:17.614975  6217 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.2:37397 every 8 connection(s)
I20260709 13:15:17.620594 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:17.630270  6221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:17.632464  6222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.633546  6218 heartbeater.cc:344] Connected to a master server at 127.26.202.62:35267
I20260709 13:15:17.634042  6218 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:17.634521  6224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:17.634917  6218 heartbeater.cc:507] Master 127.26.202.62:35267 requested a full tablet report, sending...
I20260709 13:15:17.637473  6016 ts_manager.cc:194] Registered new tserver with Master: 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397)
I20260709 13:15:17.638664 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:17.639628  6016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40736
I20260709 13:15:17.639672 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:17.640162 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:17.640532 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602917640411 us; error 0 us; skew 500 ppm
I20260709 13:15:17.641522 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:17.644153 27432 webserver.cc:533] Webserver started at http://127.26.202.3:37641/ using document root <none> and password file <none>
I20260709 13:15:17.644630 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:17.644801 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:17.645079 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:17.646287 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-2-root/instance:
uuid: "5c2c5d5d48794e3db3daff2762acf9da"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-008w"
I20260709 13:15:17.650977 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:17.654655  6229 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.655658 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:15:17.656008 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-2-root
uuid: "5c2c5d5d48794e3db3daff2762acf9da"
format_stamp: "Formatted at 2026-07-09 13:15:17 on dist-test-slave-008w"
I20260709 13:15:17.656315 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602600408833-27432-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:17.669209 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:17.670583 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:17.672125 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:17.674544 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:17.674794 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.675051 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:17.675233 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:17.721211 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.3:38351
I20260709 13:15:17.721313  6291 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.3:38351 every 8 connection(s)
I20260709 13:15:17.735801  6292 heartbeater.cc:344] Connected to a master server at 127.26.202.62:35267
I20260709 13:15:17.736241  6292 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:17.737109  6292 heartbeater.cc:507] Master 127.26.202.62:35267 requested a full tablet report, sending...
I20260709 13:15:17.739302  6016 ts_manager.cc:194] Registered new tserver with Master: 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:17.739579 27432 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015063943s
I20260709 13:15:17.741571  6016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40738
I20260709 13:15:17.768330  6016 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40748:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:17.770530  6016 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:17.824956  6108 tablet_service.cc:1511] Processing CreateTablet for tablet efdbccc3276c48438ea9d76831ccd878 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53ab7e058dc3415e9119c53eb11c8c04]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.826514  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdbccc3276c48438ea9d76831ccd878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.830536  6107 tablet_service.cc:1511] Processing CreateTablet for tablet 3192f9952d6e4b8987cda79de34a8f82 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53ab7e058dc3415e9119c53eb11c8c04]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.831954  6107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3192f9952d6e4b8987cda79de34a8f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.844069  6257 tablet_service.cc:1511] Processing CreateTablet for tablet efdbccc3276c48438ea9d76831ccd878 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53ab7e058dc3415e9119c53eb11c8c04]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.845597  6257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdbccc3276c48438ea9d76831ccd878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.846869  6256 tablet_service.cc:1511] Processing CreateTablet for tablet 3192f9952d6e4b8987cda79de34a8f82 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53ab7e058dc3415e9119c53eb11c8c04]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.847371  6183 tablet_service.cc:1511] Processing CreateTablet for tablet efdbccc3276c48438ea9d76831ccd878 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53ab7e058dc3415e9119c53eb11c8c04]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:17.848330  6256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3192f9952d6e4b8987cda79de34a8f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.848802  6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdbccc3276c48438ea9d76831ccd878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.854321  6182 tablet_service.cc:1511] Processing CreateTablet for tablet 3192f9952d6e4b8987cda79de34a8f82 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53ab7e058dc3415e9119c53eb11c8c04]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:17.855760  6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3192f9952d6e4b8987cda79de34a8f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.900756  6309 tablet_bootstrap.cc:492] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab: Bootstrap starting.
I20260709 13:15:17.902639  6307 tablet_bootstrap.cc:492] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36: Bootstrap starting.
I20260709 13:15:17.902905  6308 tablet_bootstrap.cc:492] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da: Bootstrap starting.
I20260709 13:15:17.907763  6309 tablet_bootstrap.cc:654] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.908439  6308 tablet_bootstrap.cc:654] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.910347  6307 tablet_bootstrap.cc:654] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.913817  6308 tablet_bootstrap.cc:492] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da: No bootstrap required, opened a new log
I20260709 13:15:17.913820  6309 tablet_bootstrap.cc:492] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab: No bootstrap required, opened a new log
I20260709 13:15:17.914657  6308 ts_tablet_manager.cc:1403] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.005s
I20260709 13:15:17.914696  6309 ts_tablet_manager.cc:1403] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 13:15:17.916283  6307 tablet_bootstrap.cc:492] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36: No bootstrap required, opened a new log
I20260709 13:15:17.916864  6307 ts_tablet_manager.cc:1403] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 13:15:17.918267  6309 raft_consensus.cc:359] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.918485  6308 raft_consensus.cc:359] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.919179  6309 raft_consensus.cc:385] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.919342  6308 raft_consensus.cc:385] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.919682  6309 raft_consensus.cc:740] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044a0ed9bbb64a84be83125d6af11cab, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.919688  6308 raft_consensus.cc:740] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.919878  6307 raft_consensus.cc:359] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.920997  6307 raft_consensus.cc:385] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.920679  6309 consensus_queue.cc:260] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.920687  6308 consensus_queue.cc:260] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.921581  6307 raft_consensus.cc:740] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.922683  6307 consensus_queue.cc:260] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.926620  6143 heartbeater.cc:499] Master 127.26.202.62:35267 was elected leader, sending a full tablet report...
I20260709 13:15:17.927397  6307 ts_tablet_manager.cc:1434] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:15:17.929993  6309 ts_tablet_manager.cc:1434] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:15:17.930100  6218 heartbeater.cc:499] Master 127.26.202.62:35267 was elected leader, sending a full tablet report...
I20260709 13:15:17.930613  6308 ts_tablet_manager.cc:1434] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 13:15:17.931052  6292 heartbeater.cc:499] Master 127.26.202.62:35267 was elected leader, sending a full tablet report...
I20260709 13:15:17.932041  6308 tablet_bootstrap.cc:492] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da: Bootstrap starting.
I20260709 13:15:17.934239  6309 tablet_bootstrap.cc:492] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab: Bootstrap starting.
I20260709 13:15:17.939379  6308 tablet_bootstrap.cc:654] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.942260  6309 tablet_bootstrap.cc:654] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.945871  6307 tablet_bootstrap.cc:492] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36: Bootstrap starting.
I20260709 13:15:17.951740  6308 tablet_bootstrap.cc:492] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da: No bootstrap required, opened a new log
I20260709 13:15:17.952466  6308 ts_tablet_manager.cc:1403] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 13:15:17.952965  6309 tablet_bootstrap.cc:492] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab: No bootstrap required, opened a new log
I20260709 13:15:17.953589  6309 ts_tablet_manager.cc:1403] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:15:17.955866  6308 raft_consensus.cc:359] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.956763  6308 raft_consensus.cc:385] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.956415  6309 raft_consensus.cc:359] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.957167  6308 raft_consensus.cc:740] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.957330  6309 raft_consensus.cc:385] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.957947  6309 raft_consensus.cc:740] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044a0ed9bbb64a84be83125d6af11cab, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.958455  6308 consensus_queue.cc:260] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.958819  6309 consensus_queue.cc:260] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.960717  6308 ts_tablet_manager.cc:1434] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:17.960965  6309 ts_tablet_manager.cc:1434] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:17.967074  6307 tablet_bootstrap.cc:654] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.972807  6307 tablet_bootstrap.cc:492] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36: No bootstrap required, opened a new log
I20260709 13:15:17.973312  6307 ts_tablet_manager.cc:1403] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.005s
I20260709 13:15:17.975718  6307 raft_consensus.cc:359] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.976437  6307 raft_consensus.cc:385] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.976684  6307 raft_consensus.cc:740] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.977409  6307 consensus_queue.cc:260] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:17.979084  6307 ts_tablet_manager.cc:1434] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:18.065250  6314 raft_consensus.cc:493] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.065815  6314 raft_consensus.cc:515] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.067904  6314 leader_election.cc:290] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773), 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397)
I20260709 13:15:18.078816  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdbccc3276c48438ea9d76831ccd878" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36" is_pre_election: true
I20260709 13:15:18.079556  6118 raft_consensus.cc:2468] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 0.
I20260709 13:15:18.080037  6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdbccc3276c48438ea9d76831ccd878" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044a0ed9bbb64a84be83125d6af11cab" is_pre_election: true
I20260709 13:15:18.080762  6193 raft_consensus.cc:2468] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 0.
I20260709 13:15:18.080873  6231 leader_election.cc:304] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c2c5d5d48794e3db3daff2762acf9da, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.081835  6314 raft_consensus.cc:2804] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.082217  6314 raft_consensus.cc:493] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.082540  6314 raft_consensus.cc:3060] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.088155  6314 raft_consensus.cc:515] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.089938  6314 leader_election.cc:290] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 1 election: Requested vote from peers c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773), 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397)
I20260709 13:15:18.090914  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdbccc3276c48438ea9d76831ccd878" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
I20260709 13:15:18.091177  6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdbccc3276c48438ea9d76831ccd878" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
I20260709 13:15:18.091540  6118 raft_consensus.cc:3060] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.091773  6193 raft_consensus.cc:3060] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.097401  6193 raft_consensus.cc:2468] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 1.
I20260709 13:15:18.097638  6118 raft_consensus.cc:2468] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 1.
I20260709 13:15:18.098512  6231 leader_election.cc:304] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044a0ed9bbb64a84be83125d6af11cab, 5c2c5d5d48794e3db3daff2762acf9da; no voters: 
I20260709 13:15:18.099268  6314 raft_consensus.cc:2804] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.100221  6314 raft_consensus.cc:697] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Becoming Leader. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Running, Role: LEADER
I20260709 13:15:18.101157  6314 consensus_queue.cc:237] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.109531  6016 catalog_manager.cc:5697] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3). New cstate: current_term: 1 leader_uuid: "5c2c5d5d48794e3db3daff2762acf9da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.161692  6315 raft_consensus.cc:493] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.162315  6315 raft_consensus.cc:515] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.164453  6315 leader_election.cc:290] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397), 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:18.176846  6267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3192f9952d6e4b8987cda79de34a8f82" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da" is_pre_election: true
I20260709 13:15:18.177143  6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3192f9952d6e4b8987cda79de34a8f82" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044a0ed9bbb64a84be83125d6af11cab" is_pre_election: true
I20260709 13:15:18.177628  6267 raft_consensus.cc:2468] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 0.
I20260709 13:15:18.177783  6193 raft_consensus.cc:2468] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 0.
I20260709 13:15:18.178954  6084 leader_election.cc:304] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c2c5d5d48794e3db3daff2762acf9da, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.179730  6315 raft_consensus.cc:2804] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.180087  6315 raft_consensus.cc:493] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.180416  6315 raft_consensus.cc:3060] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.186003  6315 raft_consensus.cc:515] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.187889  6315 leader_election.cc:290] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 1 election: Requested vote from peers 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397), 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:18.188802  6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3192f9952d6e4b8987cda79de34a8f82" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
I20260709 13:15:18.188962  6267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3192f9952d6e4b8987cda79de34a8f82" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
I20260709 13:15:18.189507  6193 raft_consensus.cc:3060] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.189596  6267 raft_consensus.cc:3060] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.195195  6193 raft_consensus.cc:2468] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 1.
I20260709 13:15:18.195693  6267 raft_consensus.cc:2468] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 1.
I20260709 13:15:18.196535  6082 leader_election.cc:304] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044a0ed9bbb64a84be83125d6af11cab, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.197407  6315 raft_consensus.cc:2804] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.198553  6315 raft_consensus.cc:697] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 LEADER]: Becoming Leader. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Running, Role: LEADER
I20260709 13:15:18.199380  6315 consensus_queue.cc:237] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.207298  6014 catalog_manager.cc:5697] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "c9acd04f9dcf486d980dd3f149a52a36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.322858  6014 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40756:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:18.325129  6014 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:18.351442  6107 tablet_service.cc:1511] Processing CreateTablet for tablet ae179f0cddf745c98cee8ecbe625df9a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a1b51c982d6542368f3e1ae3edd268b5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:18.352823  6107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae179f0cddf745c98cee8ecbe625df9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.352950  6182 tablet_service.cc:1511] Processing CreateTablet for tablet ae179f0cddf745c98cee8ecbe625df9a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a1b51c982d6542368f3e1ae3edd268b5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:18.355180  6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae179f0cddf745c98cee8ecbe625df9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.355633  6108 tablet_service.cc:1511] Processing CreateTablet for tablet 86e0c095895a4880a90b35648bb097a6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a1b51c982d6542368f3e1ae3edd268b5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:18.356884  6183 tablet_service.cc:1511] Processing CreateTablet for tablet 86e0c095895a4880a90b35648bb097a6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a1b51c982d6542368f3e1ae3edd268b5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:18.358219  6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e0c095895a4880a90b35648bb097a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.353814  6257 tablet_service.cc:1511] Processing CreateTablet for tablet ae179f0cddf745c98cee8ecbe625df9a (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a1b51c982d6542368f3e1ae3edd268b5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:15:18.362437  6257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae179f0cddf745c98cee8ecbe625df9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.356930  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e0c095895a4880a90b35648bb097a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.364923  6256 tablet_service.cc:1511] Processing CreateTablet for tablet 86e0c095895a4880a90b35648bb097a6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a1b51c982d6542368f3e1ae3edd268b5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:15:18.366256  6256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e0c095895a4880a90b35648bb097a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:18.369958  6307 tablet_bootstrap.cc:492] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36: Bootstrap starting.
I20260709 13:15:18.378069  6307 tablet_bootstrap.cc:654] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.379413  6308 tablet_bootstrap.cc:492] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da: Bootstrap starting.
I20260709 13:15:18.386399  6308 tablet_bootstrap.cc:654] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.392771  6309 tablet_bootstrap.cc:492] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab: Bootstrap starting.
I20260709 13:15:18.396193  6307 tablet_bootstrap.cc:492] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36: No bootstrap required, opened a new log
I20260709 13:15:18.396759  6308 tablet_bootstrap.cc:492] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da: No bootstrap required, opened a new log
I20260709 13:15:18.396868  6307 ts_tablet_manager.cc:1403] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.001s
I20260709 13:15:18.397341  6308 ts_tablet_manager.cc:1403] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:15:18.400098  6309 tablet_bootstrap.cc:654] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.400425  6307 raft_consensus.cc:359] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.401293  6307 raft_consensus.cc:385] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.400844  6308 raft_consensus.cc:359] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.401643  6307 raft_consensus.cc:740] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.401854  6308 raft_consensus.cc:385] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.402323  6308 raft_consensus.cc:740] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.403012  6308 consensus_queue.cc:260] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.402626  6307 consensus_queue.cc:260] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.405373  6307 ts_tablet_manager.cc:1434] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:15:18.405560  6308 ts_tablet_manager.cc:1434] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:15:18.406586  6308 tablet_bootstrap.cc:492] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da: Bootstrap starting.
I20260709 13:15:18.406586  6307 tablet_bootstrap.cc:492] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36: Bootstrap starting.
I20260709 13:15:18.408685  6309 tablet_bootstrap.cc:492] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab: No bootstrap required, opened a new log
I20260709 13:15:18.409224  6309 ts_tablet_manager.cc:1403] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:15:18.412518  6309 raft_consensus.cc:359] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.413291  6309 raft_consensus.cc:385] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.413614  6309 raft_consensus.cc:740] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044a0ed9bbb64a84be83125d6af11cab, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.414464  6309 consensus_queue.cc:260] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.415223  6308 tablet_bootstrap.cc:654] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.421593  6309 ts_tablet_manager.cc:1434] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:18.422858  6309 tablet_bootstrap.cc:492] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab: Bootstrap starting.
I20260709 13:15:18.424091  6307 tablet_bootstrap.cc:654] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.430189  6309 tablet_bootstrap.cc:654] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.436465  6308 tablet_bootstrap.cc:492] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da: No bootstrap required, opened a new log
I20260709 13:15:18.437094  6308 ts_tablet_manager.cc:1403] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.009s
I20260709 13:15:18.437964  6307 tablet_bootstrap.cc:492] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36: No bootstrap required, opened a new log
I20260709 13:15:18.438555  6307 ts_tablet_manager.cc:1403] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.003s
I20260709 13:15:18.441354  6308 raft_consensus.cc:359] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.442175  6308 raft_consensus.cc:385] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.442503  6308 raft_consensus.cc:740] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.441628  6307 raft_consensus.cc:359] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.443125  6307 raft_consensus.cc:385] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.443475  6307 raft_consensus.cc:740] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.443423  6308 consensus_queue.cc:260] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.444590  6307 consensus_queue.cc:260] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.445950  6308 ts_tablet_manager.cc:1434] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:15:18.446942  6309 tablet_bootstrap.cc:492] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab: No bootstrap required, opened a new log
I20260709 13:15:18.447348  6307 ts_tablet_manager.cc:1434] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:18.447464  6309 ts_tablet_manager.cc:1403] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:15:18.450984  6313 raft_consensus.cc:493] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.451017  6309 raft_consensus.cc:359] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.451925  6309 raft_consensus.cc:385] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.452232  6309 raft_consensus.cc:740] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044a0ed9bbb64a84be83125d6af11cab, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.451601  6313 raft_consensus.cc:515] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.453051  6309 consensus_queue.cc:260] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.456564  6313 leader_election.cc:290] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773), 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:18.459085  6309 ts_tablet_manager.cc:1434] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 13:15:18.480429  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a" candidate_uuid: "044a0ed9bbb64a84be83125d6af11cab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36" is_pre_election: true
I20260709 13:15:18.481407  6314 raft_consensus.cc:493] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.481864  6118 raft_consensus.cc:2468] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 044a0ed9bbb64a84be83125d6af11cab in term 0.
I20260709 13:15:18.482460  6267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a" candidate_uuid: "044a0ed9bbb64a84be83125d6af11cab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da" is_pre_election: true
I20260709 13:15:18.483273  6157 leader_election.cc:304] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044a0ed9bbb64a84be83125d6af11cab, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.484169  6267 raft_consensus.cc:2468] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 044a0ed9bbb64a84be83125d6af11cab in term 0.
I20260709 13:15:18.482030  6314 raft_consensus.cc:515] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.485307  6338 raft_consensus.cc:2804] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.485898  6338 raft_consensus.cc:493] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.486253  6338 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.486907  6314 leader_election.cc:290] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773), 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397)
I20260709 13:15:18.487555  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0c095895a4880a90b35648bb097a6" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36" is_pre_election: true
I20260709 13:15:18.487979  6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0c095895a4880a90b35648bb097a6" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044a0ed9bbb64a84be83125d6af11cab" is_pre_election: true
I20260709 13:15:18.488277  6118 raft_consensus.cc:2468] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 0.
I20260709 13:15:18.488639  6193 raft_consensus.cc:2468] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 0.
I20260709 13:15:18.489622  6231 leader_election.cc:304] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c2c5d5d48794e3db3daff2762acf9da, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.490446  6314 raft_consensus.cc:2804] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.490902  6314 raft_consensus.cc:493] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.491231  6314 raft_consensus.cc:3060] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.494632  6338 raft_consensus.cc:515] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.496869  6338 leader_election.cc:290] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [CANDIDATE]: Term 1 election: Requested vote from peers c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773), 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:18.498098  6267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a" candidate_uuid: "044a0ed9bbb64a84be83125d6af11cab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
I20260709 13:15:18.498353  6314 raft_consensus.cc:515] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.498723  6267 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.498769  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a" candidate_uuid: "044a0ed9bbb64a84be83125d6af11cab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
I20260709 13:15:18.499565  6118 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.501358  6314 leader_election.cc:290] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 1 election: Requested vote from peers c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773), 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397)
I20260709 13:15:18.501291  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0c095895a4880a90b35648bb097a6" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
I20260709 13:15:18.502076  6117 raft_consensus.cc:3060] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.502005  6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0c095895a4880a90b35648bb097a6" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
I20260709 13:15:18.502837  6193 raft_consensus.cc:3060] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.508168  6118 raft_consensus.cc:2468] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 044a0ed9bbb64a84be83125d6af11cab in term 1.
I20260709 13:15:18.508273  6267 raft_consensus.cc:2468] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 044a0ed9bbb64a84be83125d6af11cab in term 1.
I20260709 13:15:18.510030  6157 leader_election.cc:304] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044a0ed9bbb64a84be83125d6af11cab, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.511215  6338 raft_consensus.cc:2804] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.511839  6338 raft_consensus.cc:697] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 1 LEADER]: Becoming Leader. State: Replica: 044a0ed9bbb64a84be83125d6af11cab, State: Running, Role: LEADER
I20260709 13:15:18.511883  6193 raft_consensus.cc:2468] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 1.
I20260709 13:15:18.512725  6338 consensus_queue.cc:237] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.513286  6231 leader_election.cc:304] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044a0ed9bbb64a84be83125d6af11cab, 5c2c5d5d48794e3db3daff2762acf9da; no voters: 
I20260709 13:15:18.513969  6117 raft_consensus.cc:2468] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 1.
I20260709 13:15:18.514250  6314 raft_consensus.cc:2804] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.515558  6314 raft_consensus.cc:697] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Becoming Leader. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Running, Role: LEADER
I20260709 13:15:18.516510  6314 consensus_queue.cc:237] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.522392  6013 catalog_manager.cc:5697] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab reported cstate change: term changed from 0 to 1, leader changed from <none> to 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2). New cstate: current_term: 1 leader_uuid: "044a0ed9bbb64a84be83125d6af11cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.524159  6012 catalog_manager.cc:5697] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3). New cstate: current_term: 1 leader_uuid: "5c2c5d5d48794e3db3daff2762acf9da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.573410  6267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efdbccc3276c48438ea9d76831ccd878"
dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
mode: GRACEFUL
new_leader_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
 from {username='slave'} at 127.0.0.1:60034
I20260709 13:15:18.573963  6267 raft_consensus.cc:606] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Received request to transfer leadership to TS c9acd04f9dcf486d980dd3f149a52a36
I20260709 13:15:18.588796  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3192f9952d6e4b8987cda79de34a8f82"
dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
mode: GRACEFUL
new_leader_uuid: "044a0ed9bbb64a84be83125d6af11cab"
 from {username='slave'} at 127.0.0.1:38792
I20260709 13:15:18.589375  6117 raft_consensus.cc:606] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 LEADER]: Received request to transfer leadership to TS 044a0ed9bbb64a84be83125d6af11cab
I20260709 13:15:18.603027  6193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a"
dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
mode: GRACEFUL
new_leader_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
 from {username='slave'} at 127.0.0.1:41050
I20260709 13:15:18.603665  6193 raft_consensus.cc:606] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 1 LEADER]: Received request to transfer leadership to TS c9acd04f9dcf486d980dd3f149a52a36
I20260709 13:15:18.606513  6314 consensus_queue.cc:1048] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.610121  6267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86e0c095895a4880a90b35648bb097a6"
dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
mode: GRACEFUL
new_leader_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
 from {username='slave'} at 127.0.0.1:60034
I20260709 13:15:18.610783  6267 raft_consensus.cc:606] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Received request to transfer leadership to TS c9acd04f9dcf486d980dd3f149a52a36
I20260709 13:15:18.611235  6315 consensus_queue.cc:1048] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.615247  6320 raft_consensus.cc:993] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da: : Instructing follower c9acd04f9dcf486d980dd3f149a52a36 to start an election
I20260709 13:15:18.615962  6314 raft_consensus.cc:1081] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Signalling peer c9acd04f9dcf486d980dd3f149a52a36 to start an election
I20260709 13:15:18.628170  6118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efdbccc3276c48438ea9d76831ccd878"
dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
 from {username='slave'} at 127.0.0.1:38774
I20260709 13:15:18.629149  6118 raft_consensus.cc:493] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.629578  6118 raft_consensus.cc:3060] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.640373  6118 raft_consensus.cc:515] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.642458  6315 raft_consensus.cc:993] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36: : Instructing follower 044a0ed9bbb64a84be83125d6af11cab to start an election
I20260709 13:15:18.642849  6118 leader_election.cc:290] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 2 election: Requested vote from peers 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397), 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:18.642978  6315 raft_consensus.cc:1081] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 LEADER]: Signalling peer 044a0ed9bbb64a84be83125d6af11cab to start an election
I20260709 13:15:18.647912  6314 consensus_queue.cc:1048] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.648188  6267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdbccc3276c48438ea9d76831ccd878" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
I20260709 13:15:18.648458  6192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdbccc3276c48438ea9d76831ccd878" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
I20260709 13:15:18.648861  6267 raft_consensus.cc:3055] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.649219  6192 raft_consensus.cc:3060] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.649334  6267 raft_consensus.cc:740] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Running, Role: LEADER
I20260709 13:15:18.649442  6315 consensus_queue.cc:1048] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.650454  6267 consensus_queue.cc:260] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.651701  6267 raft_consensus.cc:3060] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.653376  6191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3192f9952d6e4b8987cda79de34a8f82"
dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:15:18.661856  6267 raft_consensus.cc:2468] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 2.
I20260709 13:15:18.662674  6192 raft_consensus.cc:2468] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 2.
I20260709 13:15:18.663429  6084 leader_election.cc:304] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c2c5d5d48794e3db3daff2762acf9da, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.664165  6190 raft_consensus.cc:1240] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Rejecting Update request from peer 5c2c5d5d48794e3db3daff2762acf9da for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:18.664639  6315 raft_consensus.cc:2804] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.665251  6315 raft_consensus.cc:697] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Becoming Leader. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Running, Role: LEADER
I20260709 13:15:18.666169  6315 consensus_queue.cc:237] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.666975  6191 raft_consensus.cc:493] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.667461  6191 raft_consensus.cc:3060] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.677802  6191 raft_consensus.cc:515] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.682614  6014 catalog_manager.cc:5697] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 reported cstate change: term changed from 1 to 2, leader changed from 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3) to c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "c9acd04f9dcf486d980dd3f149a52a36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.686146  6191 leader_election.cc:290] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [CANDIDATE]: Term 2 election: Requested vote from peers c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773), 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:18.686431  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3192f9952d6e4b8987cda79de34a8f82" candidate_uuid: "044a0ed9bbb64a84be83125d6af11cab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
I20260709 13:15:18.687172  6118 raft_consensus.cc:3055] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.687554  6118 raft_consensus.cc:740] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Running, Role: LEADER
I20260709 13:15:18.688597  6266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3192f9952d6e4b8987cda79de34a8f82" candidate_uuid: "044a0ed9bbb64a84be83125d6af11cab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
I20260709 13:15:18.688445  6118 consensus_queue.cc:260] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.689412  6266 raft_consensus.cc:3060] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.689968  6118 raft_consensus.cc:3060] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.700054  6118 raft_consensus.cc:2468] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 044a0ed9bbb64a84be83125d6af11cab in term 2.
I20260709 13:15:18.701215  6157 leader_election.cc:304] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044a0ed9bbb64a84be83125d6af11cab, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.700707  6266 raft_consensus.cc:2468] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 044a0ed9bbb64a84be83125d6af11cab in term 2.
I20260709 13:15:18.702124  6338 raft_consensus.cc:2804] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.702656  6338 raft_consensus.cc:697] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 2 LEADER]: Becoming Leader. State: Replica: 044a0ed9bbb64a84be83125d6af11cab, State: Running, Role: LEADER
I20260709 13:15:18.703521  6338 consensus_queue.cc:237] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.710641  6013 catalog_manager.cc:5697] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab reported cstate change: term changed from 1 to 2, leader changed from c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1) to 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2). New cstate: current_term: 2 leader_uuid: "044a0ed9bbb64a84be83125d6af11cab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.931949  6314 consensus_queue.cc:1048] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.942998  6314 consensus_queue.cc:1048] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.945808  6338 consensus_queue.cc:1048] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.955973  6314 raft_consensus.cc:993] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da: : Instructing follower c9acd04f9dcf486d980dd3f149a52a36 to start an election
I20260709 13:15:18.956477  6314 raft_consensus.cc:1081] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Signalling peer c9acd04f9dcf486d980dd3f149a52a36 to start an election
I20260709 13:15:18.958300  6117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86e0c095895a4880a90b35648bb097a6"
dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
 from {username='slave'} at 127.0.0.1:38774
I20260709 13:15:18.958971  6117 raft_consensus.cc:493] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.959292  6338 raft_consensus.cc:993] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab: : Instructing follower c9acd04f9dcf486d980dd3f149a52a36 to start an election
I20260709 13:15:18.959420  6117 raft_consensus.cc:3060] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.960322  6338 raft_consensus.cc:1081] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 1 LEADER]: Signalling peer c9acd04f9dcf486d980dd3f149a52a36 to start an election
I20260709 13:15:18.962875  6118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a"
dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
 from {username='slave'} at 127.0.0.1:38784
I20260709 13:15:18.963565  6118 raft_consensus.cc:493] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.964048  6118 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.968449  6117 raft_consensus.cc:515] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.972355  6117 leader_election.cc:290] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 2 election: Requested vote from peers 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397), 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:18.973053  6266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0c095895a4880a90b35648bb097a6" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
I20260709 13:15:18.973752  6266 raft_consensus.cc:3055] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.974392  6266 raft_consensus.cc:740] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Running, Role: LEADER
I20260709 13:15:18.975167  6118 raft_consensus.cc:515] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.975512  6266 consensus_queue.cc:260] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.977093  6266 raft_consensus.cc:3060] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.978382  6191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0c095895a4880a90b35648bb097a6" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
I20260709 13:15:18.978389  6357 consensus_queue.cc:1048] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.979271  6191 raft_consensus.cc:3060] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.978536  6267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
I20260709 13:15:18.980427  6267 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.981877  6118 leader_election.cc:290] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 2 election: Requested vote from peers 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397), 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3:38351)
I20260709 13:15:18.990110  6191 raft_consensus.cc:2468] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 2.
I20260709 13:15:18.991847  6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a" candidate_uuid: "c9acd04f9dcf486d980dd3f149a52a36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
I20260709 13:15:18.992556  6193 raft_consensus.cc:3055] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.992908  6193 raft_consensus.cc:740] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 044a0ed9bbb64a84be83125d6af11cab, State: Running, Role: LEADER
I20260709 13:15:18.992753  6082 leader_election.cc:304] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044a0ed9bbb64a84be83125d6af11cab, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:18.994068  6315 raft_consensus.cc:2804] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.994031  6193 consensus_queue.cc:260] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:18.994676  6315 raft_consensus.cc:697] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Becoming Leader. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Running, Role: LEADER
I20260709 13:15:18.995590  6193 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.995949  6315 consensus_queue.cc:237] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:19.003438  6193 raft_consensus.cc:2468] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 2.
I20260709 13:15:19.004123  6267 raft_consensus.cc:2468] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 2.
I20260709 13:15:19.004616  6082 leader_election.cc:304] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044a0ed9bbb64a84be83125d6af11cab, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:19.005061  6265 raft_consensus.cc:1240] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Rejecting Update request from peer 044a0ed9bbb64a84be83125d6af11cab for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:19.005666  6315 raft_consensus.cc:2804] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:19.006187  6315 raft_consensus.cc:697] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Becoming Leader. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Running, Role: LEADER
I20260709 13:15:19.007041  6315 consensus_queue.cc:237] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:19.010624  6013 catalog_manager.cc:5697] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 reported cstate change: term changed from 1 to 2, leader changed from 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3) to c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "c9acd04f9dcf486d980dd3f149a52a36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.013058  6266 raft_consensus.cc:2468] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9acd04f9dcf486d980dd3f149a52a36 in term 2.
I20260709 13:15:19.024312  6013 catalog_manager.cc:5697] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 reported cstate change: term changed from 1 to 2, leader changed from 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2) to c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "c9acd04f9dcf486d980dd3f149a52a36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.153630  6266 raft_consensus.cc:1275] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Refusing update from remote peer 044a0ed9bbb64a84be83125d6af11cab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.155148  6338 consensus_queue.cc:1048] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.157334  6193 raft_consensus.cc:1275] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Refusing update from remote peer c9acd04f9dcf486d980dd3f149a52a36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.159039  6315 consensus_queue.cc:1048] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.162955 27432 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:15:19.166644  6118 raft_consensus.cc:1275] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Refusing update from remote peer 044a0ed9bbb64a84be83125d6af11cab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.168540  6356 consensus_queue.cc:1048] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.170122 27432 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:15:19.170715 27432 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:15:19.177096  6267 raft_consensus.cc:1275] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Refusing update from remote peer c9acd04f9dcf486d980dd3f149a52a36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.178634  6359 consensus_queue.cc:1048] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.203706  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a"
dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
mode: GRACEFUL
new_leader_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:15:19.204241  6118 raft_consensus.cc:606] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Received request to transfer leadership to TS 5c2c5d5d48794e3db3daff2762acf9da
I20260709 13:15:19.205452 27432 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:15:19.482317  6193 raft_consensus.cc:1275] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Refusing update from remote peer c9acd04f9dcf486d980dd3f149a52a36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.483909  6359 consensus_queue.cc:1048] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.492048  6267 raft_consensus.cc:1275] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Refusing update from remote peer c9acd04f9dcf486d980dd3f149a52a36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.493603  6315 consensus_queue.cc:1048] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.506040  6267 raft_consensus.cc:1275] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Refusing update from remote peer c9acd04f9dcf486d980dd3f149a52a36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.507542  6324 consensus_queue.cc:1048] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.515434  6315 raft_consensus.cc:993] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36: : Instructing follower 5c2c5d5d48794e3db3daff2762acf9da to start an election
I20260709 13:15:19.516013  6315 raft_consensus.cc:1081] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Signalling peer 5c2c5d5d48794e3db3daff2762acf9da to start an election
I20260709 13:15:19.519235  6266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a"
dest_uuid: "5c2c5d5d48794e3db3daff2762acf9da"
 from {username='slave'} at 127.0.0.1:60010
I20260709 13:15:19.519958  6266 raft_consensus.cc:493] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:19.520412  6266 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.521185  6193 raft_consensus.cc:1275] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Refusing update from remote peer c9acd04f9dcf486d980dd3f149a52a36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.522734  6315 consensus_queue.cc:1048] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.528872  6266 raft_consensus.cc:515] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:19.534101  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9acd04f9dcf486d980dd3f149a52a36"
I20260709 13:15:19.534786  6118 raft_consensus.cc:3055] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:19.535152  6118 raft_consensus.cc:740] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9acd04f9dcf486d980dd3f149a52a36, State: Running, Role: LEADER
I20260709 13:15:19.535972  6118 consensus_queue.cc:260] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:19.537197  6118 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.537683  6266 leader_election.cc:290] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 3 election: Requested vote from peers c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1:37773), 044a0ed9bbb64a84be83125d6af11cab (127.26.202.2:37397)
I20260709 13:15:19.539093  6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae179f0cddf745c98cee8ecbe625df9a" candidate_uuid: "5c2c5d5d48794e3db3daff2762acf9da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "044a0ed9bbb64a84be83125d6af11cab"
I20260709 13:15:19.539772  6193 raft_consensus.cc:3060] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.543785  6118 raft_consensus.cc:2468] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 3.
I20260709 13:15:19.545186  6231 leader_election.cc:304] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c2c5d5d48794e3db3daff2762acf9da, c9acd04f9dcf486d980dd3f149a52a36; no voters: 
I20260709 13:15:19.546025  6320 raft_consensus.cc:2804] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:19.546546  6193 raft_consensus.cc:2468] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c2c5d5d48794e3db3daff2762acf9da in term 3.
I20260709 13:15:19.547111  6320 raft_consensus.cc:697] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 3 LEADER]: Becoming Leader. State: Replica: 5c2c5d5d48794e3db3daff2762acf9da, State: Running, Role: LEADER
I20260709 13:15:19.547963  6320 consensus_queue.cc:237] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } }
I20260709 13:15:19.554689  6013 catalog_manager.cc:5697] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da reported cstate change: term changed from 2 to 3, leader changed from c9acd04f9dcf486d980dd3f149a52a36 (127.26.202.1) to 5c2c5d5d48794e3db3daff2762acf9da (127.26.202.3). New cstate: current_term: 3 leader_uuid: "5c2c5d5d48794e3db3daff2762acf9da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9acd04f9dcf486d980dd3f149a52a36" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 37773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "044a0ed9bbb64a84be83125d6af11cab" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c2c5d5d48794e3db3daff2762acf9da" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 38351 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.570791 27432 tablet_server.cc:179] TabletServer@127.26.202.1:0 shutting down...
I20260709 13:15:19.607692 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:19.608428 27432 tablet_replica.cc:333] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36: stopping tablet replica
I20260709 13:15:19.609210 27432 raft_consensus.cc:2243] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.610103 27432 raft_consensus.cc:2272] T 86e0c095895a4880a90b35648bb097a6 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.612728 27432 tablet_replica.cc:333] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36: stopping tablet replica
I20260709 13:15:19.613369 27432 raft_consensus.cc:2243] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.614491 27432 raft_consensus.cc:2272] T efdbccc3276c48438ea9d76831ccd878 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.617329 27432 tablet_replica.cc:333] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36: stopping tablet replica
I20260709 13:15:19.617929 27432 raft_consensus.cc:2243] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.618383 27432 raft_consensus.cc:2272] T ae179f0cddf745c98cee8ecbe625df9a P c9acd04f9dcf486d980dd3f149a52a36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.620869 27432 tablet_replica.cc:333] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36: stopping tablet replica
I20260709 13:15:19.621490 27432 raft_consensus.cc:2243] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.621970 27432 raft_consensus.cc:2272] T 3192f9952d6e4b8987cda79de34a8f82 P c9acd04f9dcf486d980dd3f149a52a36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.646709 27432 tablet_server.cc:196] TabletServer@127.26.202.1:0 shutdown complete.
I20260709 13:15:19.660908 27432 tablet_server.cc:179] TabletServer@127.26.202.2:0 shutting down...
I20260709 13:15:19.681702 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:19.682564 27432 tablet_replica.cc:333] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab: stopping tablet replica
I20260709 13:15:19.683182 27432 raft_consensus.cc:2243] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.683673 27432 raft_consensus.cc:2272] T 86e0c095895a4880a90b35648bb097a6 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.686295 27432 tablet_replica.cc:333] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab: stopping tablet replica
I20260709 13:15:19.686924 27432 raft_consensus.cc:2243] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.687419 27432 raft_consensus.cc:2272] T ae179f0cddf745c98cee8ecbe625df9a P 044a0ed9bbb64a84be83125d6af11cab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.689890 27432 tablet_replica.cc:333] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab: stopping tablet replica
I20260709 13:15:19.690449 27432 raft_consensus.cc:2243] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.691280 27432 raft_consensus.cc:2272] T 3192f9952d6e4b8987cda79de34a8f82 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.693831 27432 tablet_replica.cc:333] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab: stopping tablet replica
I20260709 13:15:19.694392 27432 raft_consensus.cc:2243] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.694852 27432 raft_consensus.cc:2272] T efdbccc3276c48438ea9d76831ccd878 P 044a0ed9bbb64a84be83125d6af11cab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.719350 27432 tablet_server.cc:196] TabletServer@127.26.202.2:0 shutdown complete.
I20260709 13:15:19.732725 27432 tablet_server.cc:179] TabletServer@127.26.202.3:0 shutting down...
I20260709 13:15:19.755792 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:19.756507 27432 tablet_replica.cc:333] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da: stopping tablet replica
I20260709 13:15:19.757220 27432 raft_consensus.cc:2243] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.757697 27432 raft_consensus.cc:2272] T 86e0c095895a4880a90b35648bb097a6 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.760078 27432 tablet_replica.cc:333] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da: stopping tablet replica
I20260709 13:15:19.760612 27432 raft_consensus.cc:2243] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.761323 27432 pending_rounds.cc:70] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da: Trying to abort 1 pending ops.
I20260709 13:15:19.761502 27432 pending_rounds.cc:77] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637558476378112 op_type: NO_OP noop_request { }
I20260709 13:15:19.761766 27432 raft_consensus.cc:2889] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:19.762020 27432 raft_consensus.cc:2272] T ae179f0cddf745c98cee8ecbe625df9a P 5c2c5d5d48794e3db3daff2762acf9da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.764415 27432 tablet_replica.cc:333] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da: stopping tablet replica
I20260709 13:15:19.764945 27432 raft_consensus.cc:2243] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.765503 27432 raft_consensus.cc:2272] T 3192f9952d6e4b8987cda79de34a8f82 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.767820 27432 tablet_replica.cc:333] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da: stopping tablet replica
I20260709 13:15:19.768291 27432 raft_consensus.cc:2243] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:19.768736 27432 raft_consensus.cc:2272] T efdbccc3276c48438ea9d76831ccd878 P 5c2c5d5d48794e3db3daff2762acf9da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.793490 27432 tablet_server.cc:196] TabletServer@127.26.202.3:0 shutdown complete.
I20260709 13:15:19.807830 27432 master.cc:562] Master@127.26.202.62:35267 shutting down...
I20260709 13:15:19.826273 27432 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:19.826897 27432 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:19.827204 27432 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d95ea9f65d64f50880d150da90c1d61: stopping tablet replica
I20260709 13:15:19.847265 27432 master.cc:584] Master@127.26.202.62:35267 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2690 ms)
[----------] 6 tests from LeaderRebalancerTest (319289 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:15:19.877348 27432 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.202.62:41675
I20260709 13:15:19.878504 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:19.883826  6367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.884454  6368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.885401  6370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:19.886992 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:19.888007 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:19.888190 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:19.888373 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602919888358 us; error 0 us; skew 500 ppm
I20260709 13:15:19.888967 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:19.891757 27432 webserver.cc:533] Webserver started at http://127.26.202.62:43285/ using document root <none> and password file <none>
I20260709 13:15:19.892282 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:19.892462 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:19.892737 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:19.893859 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/master-0-root/instance:
uuid: "13858a8fb3e54a45a8957f3ee81126db"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-008w"
I20260709 13:15:19.898638 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:15:19.902295  6375 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.903060 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:15:19.903373 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/master-0-root
uuid: "13858a8fb3e54a45a8957f3ee81126db"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-008w"
I20260709 13:15:19.903627 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:19.915613 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:19.916675 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:19.954608 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.62:41675
I20260709 13:15:19.954802  6426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.62:41675 every 8 connection(s)
I20260709 13:15:19.958495  6427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:19.971786  6427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db: Bootstrap starting.
I20260709 13:15:19.976583  6427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:19.980757  6427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db: No bootstrap required, opened a new log
I20260709 13:15:19.983088  6427 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13858a8fb3e54a45a8957f3ee81126db" member_type: VOTER }
I20260709 13:15:19.983677  6427 raft_consensus.cc:385] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:19.983875  6427 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13858a8fb3e54a45a8957f3ee81126db, State: Initialized, Role: FOLLOWER
I20260709 13:15:19.984488  6427 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13858a8fb3e54a45a8957f3ee81126db" member_type: VOTER }
I20260709 13:15:19.984935  6427 raft_consensus.cc:399] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:19.985163  6427 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:19.985373  6427 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:19.990231  6427 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13858a8fb3e54a45a8957f3ee81126db" member_type: VOTER }
I20260709 13:15:19.990762  6427 leader_election.cc:304] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13858a8fb3e54a45a8957f3ee81126db; no voters: 
I20260709 13:15:19.991864  6427 leader_election.cc:290] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:19.992215  6430 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:19.993709  6430 raft_consensus.cc:697] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 1 LEADER]: Becoming Leader. State: Replica: 13858a8fb3e54a45a8957f3ee81126db, State: Running, Role: LEADER
I20260709 13:15:19.994396  6430 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13858a8fb3e54a45a8957f3ee81126db" member_type: VOTER }
I20260709 13:15:19.994779  6427 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:19.997224  6432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13858a8fb3e54a45a8957f3ee81126db. Latest consensus state: current_term: 1 leader_uuid: "13858a8fb3e54a45a8957f3ee81126db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13858a8fb3e54a45a8957f3ee81126db" member_type: VOTER } }
I20260709 13:15:19.997176  6431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13858a8fb3e54a45a8957f3ee81126db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13858a8fb3e54a45a8957f3ee81126db" member_type: VOTER } }
I20260709 13:15:19.997946  6432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:19.998023  6431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:20.002487  6435 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:20.007975  6435 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:20.012308 27432 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:20.017791  6435 catalog_manager.cc:1383] Generated new cluster ID: 748d349a9e2a49a4b5f9cb3717b7fa4c
I20260709 13:15:20.018180  6435 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:20.047926  6435 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:20.049254  6435 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:20.061422  6435 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db: Generated new TSK 0
I20260709 13:15:20.062166  6435 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:20.079095 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:20.085485  6448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:20.086215  6449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:20.087946  6451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:20.088209 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:20.089320 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:20.089555 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:20.089754 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602920089737 us; error 0 us; skew 500 ppm
I20260709 13:15:20.090299 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:20.092808 27432 webserver.cc:533] Webserver started at http://127.26.202.1:42531/ using document root <none> and password file <none>
I20260709 13:15:20.093367 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:20.093583 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:20.093885 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:20.095014 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-0-root/instance:
uuid: "2b4acb020cdc4e3fad469821f9128f04"
format_stamp: "Formatted at 2026-07-09 13:15:20 on dist-test-slave-008w"
I20260709 13:15:20.099838 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:20.103878  6456 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.105108 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:20.105428 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "2b4acb020cdc4e3fad469821f9128f04"
format_stamp: "Formatted at 2026-07-09 13:15:20 on dist-test-slave-008w"
I20260709 13:15:20.105917 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:20.135541 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:20.136852 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:20.138466 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:20.140957 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:20.141281 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.141577 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:20.141790 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.184516 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:45277
I20260709 13:15:20.184648  6518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:45277 every 8 connection(s)
I20260709 13:15:20.189900 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:20.197546  6523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:20.199525  6524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:20.203059  6526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:20.205175 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:20.205101  6519 heartbeater.cc:344] Connected to a master server at 127.26.202.62:41675
I20260709 13:15:20.205987  6519 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:20.206452 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:20.206725 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:20.206790  6519 heartbeater.cc:507] Master 127.26.202.62:41675 requested a full tablet report, sending...
I20260709 13:15:20.206997 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602920206975 us; error 0 us; skew 500 ppm
I20260709 13:15:20.207700 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:20.209520  6392 ts_manager.cc:194] Registered new tserver with Master: 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277)
I20260709 13:15:20.210575 27432 webserver.cc:533] Webserver started at http://127.26.202.2:46141/ using document root <none> and password file <none>
I20260709 13:15:20.211208 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:20.211464 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:20.211589  6392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38916
I20260709 13:15:20.211740 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:20.213321 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-1-root/instance:
uuid: "b19a4869870b47ca90ef4294221c224b"
format_stamp: "Formatted at 2026-07-09 13:15:20 on dist-test-slave-008w"
I20260709 13:15:20.217777 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:20.221220  6531 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.222147 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:20.222565 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-1-root
uuid: "b19a4869870b47ca90ef4294221c224b"
format_stamp: "Formatted at 2026-07-09 13:15:20 on dist-test-slave-008w"
I20260709 13:15:20.222874 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:20.235250 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:20.236374 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:20.237895 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:20.240214 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:20.240465 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.240711 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:20.240906 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.280814 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.2:39943
I20260709 13:15:20.280898  6593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.2:39943 every 8 connection(s)
I20260709 13:15:20.286180 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:20.294981  6598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:20.296088  6597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:20.298731 27432 server_base.cc:1061] running on GCE node
W20260709 13:15:20.298995  6600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:20.300134  6594 heartbeater.cc:344] Connected to a master server at 127.26.202.62:41675
I20260709 13:15:20.300294 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:20.300623  6594 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:20.300693 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:20.301110 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602920301084 us; error 0 us; skew 500 ppm
I20260709 13:15:20.301651  6594 heartbeater.cc:507] Master 127.26.202.62:41675 requested a full tablet report, sending...
I20260709 13:15:20.301769 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:20.304409  6392 ts_manager.cc:194] Registered new tserver with Master: b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:20.304908 27432 webserver.cc:533] Webserver started at http://127.26.202.3:46037/ using document root <none> and password file <none>
I20260709 13:15:20.305655 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:20.305905 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:20.306249 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:20.306481  6392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38932
I20260709 13:15:20.307945 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-2-root/instance:
uuid: "8f246c6bee1d4eb585388786ade7a309"
format_stamp: "Formatted at 2026-07-09 13:15:20 on dist-test-slave-008w"
I20260709 13:15:20.312821 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:20.316619  6605 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.317523 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:20.317853 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-2-root
uuid: "8f246c6bee1d4eb585388786ade7a309"
format_stamp: "Formatted at 2026-07-09 13:15:20 on dist-test-slave-008w"
I20260709 13:15:20.318162 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602600408833-27432-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:20.334610 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:20.335701 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:20.337695 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:20.340839 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:20.341126 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:15:20.341459 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:20.341619 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:20.380935 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.3:39413
I20260709 13:15:20.381145  6667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.3:39413 every 8 connection(s)
I20260709 13:15:20.395242  6668 heartbeater.cc:344] Connected to a master server at 127.26.202.62:41675
I20260709 13:15:20.395787  6668 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:20.396750  6668 heartbeater.cc:507] Master 127.26.202.62:41675 requested a full tablet report, sending...
I20260709 13:15:20.399155  6392 ts_manager.cc:194] Registered new tserver with Master: 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:20.400148 27432 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015952501s
I20260709 13:15:20.400754  6392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38936
I20260709 13:15:20.427825  6392 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38946:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:20.430498  6392 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:20.499172  6633 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6286e3a4db45049a75e4887579e688 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:20.500674  6633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6286e3a4db45049a75e4887579e688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.502229  6558 tablet_service.cc:1511] Processing CreateTablet for tablet 6078cc3c40c64a28b1a0d23ea69108fd (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:20.503778  6558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6078cc3c40c64a28b1a0d23ea69108fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.505852  6632 tablet_service.cc:1511] Processing CreateTablet for tablet 6078cc3c40c64a28b1a0d23ea69108fd (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:20.507648  6559 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6286e3a4db45049a75e4887579e688 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:20.508356  6632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6078cc3c40c64a28b1a0d23ea69108fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.509078  6559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6286e3a4db45049a75e4887579e688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.511080  6557 tablet_service.cc:1511] Processing CreateTablet for tablet d57e073710fc4658902ee43a1fa72378 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:20.512621  6557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57e073710fc4658902ee43a1fa72378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.513631  6631 tablet_service.cc:1511] Processing CreateTablet for tablet d57e073710fc4658902ee43a1fa72378 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:20.515162  6631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57e073710fc4658902ee43a1fa72378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.517724  6556 tablet_service.cc:1511] Processing CreateTablet for tablet fd75a1e5fbe445a2a3841270d62c8a6b (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:20.519261  6556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd75a1e5fbe445a2a3841270d62c8a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.543804  6484 tablet_service.cc:1511] Processing CreateTablet for tablet 8d6286e3a4db45049a75e4887579e688 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:20.546516  6484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d6286e3a4db45049a75e4887579e688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.547554  6683 tablet_bootstrap.cc:492] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:20.550177  6633 tablet_service.cc:1511] Processing CreateTablet for tablet fd75a1e5fbe445a2a3841270d62c8a6b (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:20.552170  6633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd75a1e5fbe445a2a3841270d62c8a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.555934  6559 tablet_service.cc:1511] Processing CreateTablet for tablet 92bf03ad93694d5989574a672f2069c4 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:20.557483  6559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92bf03ad93694d5989574a672f2069c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.558415  6683 tablet_bootstrap.cc:654] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.561074  6555 tablet_service.cc:1511] Processing CreateTablet for tablet cd95a2403523421f99ae03f6ad413951 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:20.562687  6555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd95a2403523421f99ae03f6ad413951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.553550  6684 tablet_bootstrap.cc:492] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:20.564563  6483 tablet_service.cc:1511] Processing CreateTablet for tablet 6078cc3c40c64a28b1a0d23ea69108fd (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:20.567860  6481 tablet_service.cc:1511] Processing CreateTablet for tablet fd75a1e5fbe445a2a3841270d62c8a6b (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:20.569999  6480 tablet_service.cc:1511] Processing CreateTablet for tablet 92bf03ad93694d5989574a672f2069c4 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:20.572594  6482 tablet_service.cc:1511] Processing CreateTablet for tablet d57e073710fc4658902ee43a1fa72378 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:20.574672  6479 tablet_service.cc:1511] Processing CreateTablet for tablet cd95a2403523421f99ae03f6ad413951 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:20.579146  6684 tablet_bootstrap.cc:654] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.581591  6483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6078cc3c40c64a28b1a0d23ea69108fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.585417  6481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd75a1e5fbe445a2a3841270d62c8a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.589397  6480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92bf03ad93694d5989574a672f2069c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.593367  6482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57e073710fc4658902ee43a1fa72378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.593631  6633 tablet_service.cc:1511] Processing CreateTablet for tablet cd95a2403523421f99ae03f6ad413951 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:20.595074  6633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd95a2403523421f99ae03f6ad413951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.598196  6478 tablet_service.cc:1511] Processing CreateTablet for tablet 7f213fecb16e4b27896f7d09f642647c (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:20.599709  6478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f213fecb16e4b27896f7d09f642647c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.599431  6632 tablet_service.cc:1511] Processing CreateTablet for tablet 92bf03ad93694d5989574a672f2069c4 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:20.600997  6632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92bf03ad93694d5989574a672f2069c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.601358  6479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd95a2403523421f99ae03f6ad413951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.614333  6556 tablet_service.cc:1511] Processing CreateTablet for tablet 7f213fecb16e4b27896f7d09f642647c (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:20.616604  6556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f213fecb16e4b27896f7d09f642647c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.634138  6631 tablet_service.cc:1511] Processing CreateTablet for tablet 7f213fecb16e4b27896f7d09f642647c (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:20.635738  6631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f213fecb16e4b27896f7d09f642647c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.636775  6477 tablet_service.cc:1511] Processing CreateTablet for tablet c21c9065cbd94e2dad794e892c8210d0 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:20.638232  6477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21c9065cbd94e2dad794e892c8210d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.639750  6559 tablet_service.cc:1511] Processing CreateTablet for tablet c21c9065cbd94e2dad794e892c8210d0 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:20.641360  6559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21c9065cbd94e2dad794e892c8210d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.661419  6630 tablet_service.cc:1511] Processing CreateTablet for tablet c21c9065cbd94e2dad794e892c8210d0 (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:20.662987  6630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21c9065cbd94e2dad794e892c8210d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.675709  6683 tablet_bootstrap.cc:492] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:20.676349  6683 ts_tablet_manager.cc:1403] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.034s
I20260709 13:15:20.676446  6476 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea10ed64a394b9b817b16ff98f9e4fd (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:20.677930  6476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea10ed64a394b9b817b16ff98f9e4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.679134  6554 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea10ed64a394b9b817b16ff98f9e4fd (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:20.679632  6683 raft_consensus.cc:359] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:20.680444  6683 raft_consensus.cc:385] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.680546  6554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea10ed64a394b9b817b16ff98f9e4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.684643  6629 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea10ed64a394b9b817b16ff98f9e4fd (DEFAULT_TABLE table=test-workload [id=fbc469ab33c24bf8b788ab79d3d1d6eb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:20.686088  6629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea10ed64a394b9b817b16ff98f9e4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.680785  6683 raft_consensus.cc:740] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.689098  6683 consensus_queue.cc:260] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:20.693102  6687 tablet_bootstrap.cc:492] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:20.734498  6594 heartbeater.cc:499] Master 127.26.202.62:41675 was elected leader, sending a full tablet report...
I20260709 13:15:20.731491  6684 tablet_bootstrap.cc:492] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:20.737427  6684 ts_tablet_manager.cc:1403] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.184s	user 0.023s	sys 0.033s
I20260709 13:15:20.740402  6684 raft_consensus.cc:359] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.741178  6684 raft_consensus.cc:385] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.741492  6684 raft_consensus.cc:740] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.742264  6684 consensus_queue.cc:260] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.742381  6683 ts_tablet_manager.cc:1434] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.066s	user 0.015s	sys 0.003s
I20260709 13:15:20.744333  6683 tablet_bootstrap.cc:492] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:20.750684  6683 tablet_bootstrap.cc:654] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.750877  6687 tablet_bootstrap.cc:654] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.759672  6668 heartbeater.cc:499] Master 127.26.202.62:41675 was elected leader, sending a full tablet report...
I20260709 13:15:20.761777  6683 tablet_bootstrap.cc:492] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:20.762362  6683 ts_tablet_manager.cc:1403] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.010s
I20260709 13:15:20.763758  6684 ts_tablet_manager.cc:1434] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.009s
I20260709 13:15:20.764936  6684 tablet_bootstrap.cc:492] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:20.765512  6687 tablet_bootstrap.cc:492] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:20.766055  6687 ts_tablet_manager.cc:1403] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.000s
I20260709 13:15:20.767014  6683 raft_consensus.cc:359] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.767886  6683 raft_consensus.cc:385] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.768198  6683 raft_consensus.cc:740] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.769207  6683 consensus_queue.cc:260] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.769454  6687 raft_consensus.cc:359] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.770670  6687 raft_consensus.cc:385] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.771034  6687 raft_consensus.cc:740] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.771425  6683 ts_tablet_manager.cc:1434] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:15:20.771735  6684 tablet_bootstrap.cc:654] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.771979  6687 consensus_queue.cc:260] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.772596  6683 tablet_bootstrap.cc:492] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:20.780555  6519 heartbeater.cc:499] Master 127.26.202.62:41675 was elected leader, sending a full tablet report...
I20260709 13:15:20.781682  6687 ts_tablet_manager.cc:1434] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:15:20.781600  6683 tablet_bootstrap.cc:654] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.783139  6687 tablet_bootstrap.cc:492] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:20.795807  6684 tablet_bootstrap.cc:492] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:20.796170  6692 raft_consensus.cc:493] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.796778  6684 ts_tablet_manager.cc:1403] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.013s
I20260709 13:15:20.798830  6687 tablet_bootstrap.cc:654] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.796902  6692 raft_consensus.cc:515] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.801613  6684 raft_consensus.cc:359] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:20.802762  6684 raft_consensus.cc:385] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.803211  6684 raft_consensus.cc:740] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.804540  6684 consensus_queue.cc:260] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:20.807847  6684 ts_tablet_manager.cc:1434] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:20.809199  6684 tablet_bootstrap.cc:492] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:20.816586  6684 tablet_bootstrap.cc:654] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.816635  6692 leader_election.cc:290] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:20.832301  6687 tablet_bootstrap.cc:492] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:20.838320  6687 ts_tablet_manager.cc:1403] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.004s
I20260709 13:15:20.839140  6683 tablet_bootstrap.cc:492] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:20.839744  6683 ts_tablet_manager.cc:1403] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.027s
I20260709 13:15:20.841603  6687 raft_consensus.cc:359] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.842365  6683 raft_consensus.cc:359] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.842720  6684 tablet_bootstrap.cc:492] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:20.842661  6687 raft_consensus.cc:385] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.843302  6683 raft_consensus.cc:385] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.843617  6687 raft_consensus.cc:740] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.843756  6684 ts_tablet_manager.cc:1403] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.012s
I20260709 13:15:20.843909  6683 raft_consensus.cc:740] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.844556  6687 consensus_queue.cc:260] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.845118  6683 consensus_queue.cc:260] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.847052  6687 ts_tablet_manager.cc:1434] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:20.847172  6684 raft_consensus.cc:359] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.848004  6684 raft_consensus.cc:385] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.848174  6687 tablet_bootstrap.cc:492] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:20.851001  6688 raft_consensus.cc:493] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.853842  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bf03ad93694d5989574a672f2069c4" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:20.854413  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bf03ad93694d5989574a672f2069c4" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:20.855371  6569 raft_consensus.cc:2468] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 0.
I20260709 13:15:20.848347  6684 raft_consensus.cc:740] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.850451  6683 ts_tablet_manager.cc:1434] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:20.856504  6684 consensus_queue.cc:260] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
W20260709 13:15:20.857121  6458 leader_election.cc:343] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.855157  6688 raft_consensus.cc:515] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:20.859191  6684 ts_tablet_manager.cc:1434] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:15:20.860013  6688 leader_election.cc:290] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413), 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277)
I20260709 13:15:20.860292  6684 tablet_bootstrap.cc:492] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:20.861279  6687 tablet_bootstrap.cc:654] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.864339  6459 leader_election.cc:304] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:20.865267  6692 raft_consensus.cc:2804] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.865655  6692 raft_consensus.cc:493] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.866003  6692 raft_consensus.cc:3060] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.867363  6684 tablet_bootstrap.cc:654] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.874734  6692 raft_consensus.cc:515] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.879120  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bf03ad93694d5989574a672f2069c4" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
W20260709 13:15:20.881186  6458 leader_election.cc:343] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.883473  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bf03ad93694d5989574a672f2069c4" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:20.884370  6569 raft_consensus.cc:3060] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.887171  6683 tablet_bootstrap.cc:492] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:20.891479  6688 raft_consensus.cc:493] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.892148  6688 raft_consensus.cc:515] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.895654  6688 leader_election.cc:290] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:20.901540  6692 leader_election.cc:290] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:20.904263  6569 raft_consensus.cc:2468] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:20.906229  6459 leader_election.cc:304] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:20.908115  6692 raft_consensus.cc:2804] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.912045  6687 tablet_bootstrap.cc:492] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:20.912839  6687 ts_tablet_manager.cc:1403] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.018s
I20260709 13:15:20.916013  6683 tablet_bootstrap.cc:654] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.916461  6684 tablet_bootstrap.cc:492] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:20.916388  6687 raft_consensus.cc:359] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:20.920514  6687 raft_consensus.cc:385] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.920629  6684 ts_tablet_manager.cc:1403] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.061s	user 0.028s	sys 0.028s
I20260709 13:15:20.919149  6689 raft_consensus.cc:493] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.920976  6687 raft_consensus.cc:740] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.921348  6689 raft_consensus.cc:515] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.922077  6687 consensus_queue.cc:260] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:20.923820  6684 raft_consensus.cc:359] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.924803  6684 raft_consensus.cc:385] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:20.925225  6684 raft_consensus.cc:740] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:20.925383  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:20.925865  6703 raft_consensus.cc:493] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.926079  6684 consensus_queue.cc:260] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.926595  6703 raft_consensus.cc:515] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.924083  6689 leader_election.cc:290] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:20.924741  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6286e3a4db45049a75e4887579e688" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:20.931656  6643 raft_consensus.cc:2468] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:20.932612  6687 ts_tablet_manager.cc:1434] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.014s
I20260709 13:15:20.935412  6687 tablet_bootstrap.cc:492] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:20.926101  6642 raft_consensus.cc:2468] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:20.937909  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd95a2403523421f99ae03f6ad413951" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:20.939494  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6286e3a4db45049a75e4887579e688" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:20.940456  6494 raft_consensus.cc:2468] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:20.941740  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:20.942129  6684 ts_tablet_manager.cc:1434] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.013s
W20260709 13:15:20.943032  6458 leader_election.cc:343] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.943467  6684 tablet_bootstrap.cc:492] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:20.944597  6535 leader_election.cc:304] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:20.945732  6688 raft_consensus.cc:2804] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.945784  6533 leader_election.cc:304] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:20.946040  6687 tablet_bootstrap.cc:654] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:20.946825  6535 leader_election.cc:343] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.947220  6688 raft_consensus.cc:493] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.947623  6688 raft_consensus.cc:3060] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.951432  6684 tablet_bootstrap.cc:654] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:20.919479  6692 raft_consensus.cc:697] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:20.954314  6692 consensus_queue.cc:237] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:20.956455  6688 raft_consensus.cc:515] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:20.960325  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6286e3a4db45049a75e4887579e688" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:20.960999  6493 raft_consensus.cc:3060] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:20.970357  6493 raft_consensus.cc:2468] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:20.971972  6535 leader_election.cc:304] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:20.975894  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd95a2403523421f99ae03f6ad413951" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
W20260709 13:15:20.978314  6459 leader_election.cc:343] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.978999  6459 leader_election.cc:304] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04; no voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b
I20260709 13:15:20.979869  6704 raft_consensus.cc:2749] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:20.983822  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:20.985889  6708 raft_consensus.cc:2804] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:20.986549  6708 raft_consensus.cc:493] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.986996  6708 raft_consensus.cc:3060] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:20.990239  6609 leader_election.cc:343] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.990674  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:20.995780  6703 leader_election.cc:290] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
W20260709 13:15:20.996538  6608 leader_election.cc:343] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:20.997130  6688 leader_election.cc:290] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Requested vote from peers 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413), 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277)
I20260709 13:15:20.997283  6608 leader_election.cc:304] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309; no voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b
I20260709 13:15:20.994419  6712 raft_consensus.cc:2804] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:20.998692  6712 raft_consensus.cc:697] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:20.998771  6705 raft_consensus.cc:2749] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:21.008198  6440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:15:21.000695  6533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.3:39413, user_credentials={real_user=slave}} blocked reactor thread for 54780.5us
I20260709 13:15:21.012497  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6286e3a4db45049a75e4887579e688" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.013182  6642 raft_consensus.cc:3060] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.015900  6708 raft_consensus.cc:515] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.017527  6712 consensus_queue.cc:237] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:21.019234  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.018781  6391 catalog_manager.cc:5697] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.019639  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:21.019963  6643 raft_consensus.cc:3060] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:21.021072  6535 leader_election.cc:343] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.023550  6708 leader_election.cc:290] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.027520  6684 tablet_bootstrap.cc:492] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:21.028129  6684 ts_tablet_manager.cc:1403] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.031s
I20260709 13:15:21.031139  6684 raft_consensus.cc:359] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.030789  6389 catalog_manager.cc:5697] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 0 to 1, leader changed from <none> to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 1 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.031860  6684 raft_consensus.cc:385] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.032205  6684 raft_consensus.cc:740] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.033105  6684 consensus_queue.cc:260] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.035485  6684 ts_tablet_manager.cc:1434] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:21.036067  6687 tablet_bootstrap.cc:492] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:21.036523  6684 tablet_bootstrap.cc:492] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:21.036669  6687 ts_tablet_manager.cc:1403] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.027s
I20260709 13:15:21.032577  6642 raft_consensus.cc:2468] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:21.041497  6687 raft_consensus.cc:359] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.042019  6643 raft_consensus.cc:2468] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:21.042431  6687 raft_consensus.cc:385] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.042924  6687 raft_consensus.cc:740] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.043402  6533 leader_election.cc:304] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:21.043882  6687 consensus_queue.cc:260] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.044724  6712 raft_consensus.cc:2804] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.045281  6684 tablet_bootstrap.cc:654] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.045310  6712 raft_consensus.cc:697] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:21.046729  6687 ts_tablet_manager.cc:1434] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 13:15:21.046454  6712 consensus_queue.cc:237] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.047922  6687 tablet_bootstrap.cc:492] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:21.060092  6683 tablet_bootstrap.cc:492] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:21.060667  6683 ts_tablet_manager.cc:1403] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.174s	user 0.019s	sys 0.002s
I20260709 13:15:21.064293  6687 tablet_bootstrap.cc:654] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.064853  6692 raft_consensus.cc:493] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.065407  6692 raft_consensus.cc:515] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.066177  6684 tablet_bootstrap.cc:492] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:21.066917  6684 ts_tablet_manager.cc:1403] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.007s
I20260709 13:15:21.064088  6683 raft_consensus.cc:359] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.067708  6692 leader_election.cc:290] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.068131  6683 raft_consensus.cc:385] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.068447  6683 raft_consensus.cc:740] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.069267  6683 consensus_queue.cc:260] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.069538  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57e073710fc4658902ee43a1fa72378" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:21.070640  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57e073710fc4658902ee43a1fa72378" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:21.070533  6684 raft_consensus.cc:359] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
W20260709 13:15:21.071197  6459 leader_election.cc:343] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.071467  6684 raft_consensus.cc:385] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.071619  6642 raft_consensus.cc:2468] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 0.
I20260709 13:15:21.072026  6683 ts_tablet_manager.cc:1434] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:21.073263  6683 tablet_bootstrap.cc:492] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:21.073318  6458 leader_election.cc:304] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: b19a4869870b47ca90ef4294221c224b
I20260709 13:15:21.074872  6692 raft_consensus.cc:2804] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.075318  6692 raft_consensus.cc:493] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.075758  6692 raft_consensus.cc:3060] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.071815  6684 raft_consensus.cc:740] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.082281  6684 consensus_queue.cc:260] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.086239  6683 tablet_bootstrap.cc:654] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.087086  6692 raft_consensus.cc:515] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.094959  6684 ts_tablet_manager.cc:1434] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:15:21.095479  6692 leader_election.cc:290] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.098276  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57e073710fc4658902ee43a1fa72378" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.099193  6642 raft_consensus.cc:3060] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.099651  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57e073710fc4658902ee43a1fa72378" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
W20260709 13:15:21.102967  6459 leader_election.cc:343] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.104856  6684 tablet_bootstrap.cc:492] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:21.113219  6391 catalog_manager.cc:5697] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 0 to 1, leader changed from <none> to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 1 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.117533  6687 tablet_bootstrap.cc:492] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:21.118377  6687 ts_tablet_manager.cc:1403] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.013s
I20260709 13:15:21.122303  6687 raft_consensus.cc:359] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.122980  6684 tablet_bootstrap.cc:654] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.123515  6687 raft_consensus.cc:385] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.123974  6687 raft_consensus.cc:740] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.123210  6642 raft_consensus.cc:2468] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:21.125761  6458 leader_election.cc:304] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: b19a4869870b47ca90ef4294221c224b
I20260709 13:15:21.126672  6703 raft_consensus.cc:2804] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.127157  6703 raft_consensus.cc:697] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:21.126019  6683 tablet_bootstrap.cc:492] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:21.128364  6683 ts_tablet_manager.cc:1403] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.011s
I20260709 13:15:21.128134  6703 consensus_queue.cc:237] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.131520  6683 raft_consensus.cc:359] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.132267  6683 raft_consensus.cc:385] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.132597  6683 raft_consensus.cc:740] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.133481  6683 consensus_queue.cc:260] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.136088  6683 ts_tablet_manager.cc:1434] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:15:21.137176  6683 tablet_bootstrap.cc:492] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:21.127144  6687 consensus_queue.cc:260] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.142786  6692 raft_consensus.cc:493] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.143466  6692 raft_consensus.cc:515] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.144497  6683 tablet_bootstrap.cc:654] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.148969  6687 ts_tablet_manager.cc:1434] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:15:21.150120  6687 tablet_bootstrap.cc:492] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:21.150583  6692 leader_election.cc:290] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.151882  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:21.156104  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:21.157698  6642 raft_consensus.cc:2393] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4acb020cdc4e3fad469821f9128f04 in current term 1: Already voted for candidate b19a4869870b47ca90ef4294221c224b in this term.
I20260709 13:15:21.161546  6458 leader_election.cc:304] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04; no voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b
I20260709 13:15:21.163362  6703 raft_consensus.cc:3060] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.163726  6687 tablet_bootstrap.cc:654] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.168726  6684 tablet_bootstrap.cc:492] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:21.169269  6684 ts_tablet_manager.cc:1403] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.032s
I20260709 13:15:21.172317  6684 raft_consensus.cc:359] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.173101  6684 raft_consensus.cc:385] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.173386  6684 raft_consensus.cc:740] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.173429  6389 catalog_manager.cc:5697] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.174343  6684 consensus_queue.cc:260] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.184321  6684 ts_tablet_manager.cc:1434] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:21.190279  6703 raft_consensus.cc:2749] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.192781  6684 tablet_bootstrap.cc:492] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:21.193655  6712 raft_consensus.cc:493] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.194253  6712 raft_consensus.cc:515] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.198406  6683 tablet_bootstrap.cc:492] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:21.198817  6687 tablet_bootstrap.cc:492] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:21.199064  6683 ts_tablet_manager.cc:1403] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.029s
I20260709 13:15:21.199146  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd95a2403523421f99ae03f6ad413951" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:21.199436  6687 ts_tablet_manager.cc:1403] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.017s
I20260709 13:15:21.199963  6642 raft_consensus.cc:2468] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:21.201123  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd95a2403523421f99ae03f6ad413951" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:21.201829  6493 raft_consensus.cc:2468] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:21.202652  6683 raft_consensus.cc:359] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.203195  6535 leader_election.cc:304] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.203445  6683 raft_consensus.cc:385] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.204025  6683 raft_consensus.cc:740] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.203265  6687 raft_consensus.cc:359] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.204689  6687 raft_consensus.cc:385] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.204182  6708 raft_consensus.cc:2804] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.205107  6687 raft_consensus.cc:740] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.204958  6683 consensus_queue.cc:260] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.205745  6684 tablet_bootstrap.cc:654] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.206401  6687 consensus_queue.cc:260] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.207625  6683 ts_tablet_manager.cc:1434] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:15:21.208755  6683 tablet_bootstrap.cc:492] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:21.209523  6687 ts_tablet_manager.cc:1434] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:21.210630  6687 tablet_bootstrap.cc:492] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:21.215751  6683 tablet_bootstrap.cc:654] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.219656  6687 tablet_bootstrap.cc:654] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.222532  6684 tablet_bootstrap.cc:492] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:21.223116  6684 ts_tablet_manager.cc:1403] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.000s
I20260709 13:15:21.227033  6684 raft_consensus.cc:359] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.228096  6684 raft_consensus.cc:385] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.228478  6684 raft_consensus.cc:740] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.229815  6684 consensus_queue.cc:260] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.205966  6712 leader_election.cc:290] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.205590  6708 raft_consensus.cc:493] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.232012  6708 raft_consensus.cc:3060] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.233759  6712 raft_consensus.cc:493] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.234361  6712 raft_consensus.cc:515] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.238405  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57e073710fc4658902ee43a1fa72378" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:21.239516  6683 tablet_bootstrap.cc:492] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:21.240360  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57e073710fc4658902ee43a1fa72378" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:21.241413  6642 raft_consensus.cc:2393] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b19a4869870b47ca90ef4294221c224b in current term 1: Already voted for candidate 2b4acb020cdc4e3fad469821f9128f04 in this term.
I20260709 13:15:21.242372  6684 ts_tablet_manager.cc:1434] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:15:21.242861  6535 leader_election.cc:304] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b19a4869870b47ca90ef4294221c224b; no voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:21.243800  6684 tablet_bootstrap.cc:492] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:21.243907  6688 raft_consensus.cc:3060] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.247856  6687 tablet_bootstrap.cc:492] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:21.248680  6687 ts_tablet_manager.cc:1403] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.015s
I20260709 13:15:21.249135  6712 leader_election.cc:290] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.250702  6708 raft_consensus.cc:515] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.252542  6687 raft_consensus.cc:359] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.253575  6687 raft_consensus.cc:385] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.253834  6708 leader_election.cc:290] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.253990  6687 raft_consensus.cc:740] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.254979  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd95a2403523421f99ae03f6ad413951" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.255609  6642 raft_consensus.cc:3060] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.255316  6687 consensus_queue.cc:260] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.258527  6687 ts_tablet_manager.cc:1434] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:21.259724  6687 tablet_bootstrap.cc:492] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:21.261423  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd95a2403523421f99ae03f6ad413951" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:21.261948  6684 tablet_bootstrap.cc:654] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.262183  6493 raft_consensus.cc:3060] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.268285  6687 tablet_bootstrap.cc:654] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.252544  6688 raft_consensus.cc:2749] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.240362  6683 ts_tablet_manager.cc:1403] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 13:15:21.273904  6493 raft_consensus.cc:2468] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:21.273999  6683 raft_consensus.cc:359] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.275549  6535 leader_election.cc:304] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.277966  6688 raft_consensus.cc:2804] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.278184  6684 tablet_bootstrap.cc:492] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:21.278800  6684 ts_tablet_manager.cc:1403] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.006s
I20260709 13:15:21.278720  6688 raft_consensus.cc:697] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:21.280009  6642 raft_consensus.cc:2468] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:21.280786  6683 raft_consensus.cc:385] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.281332  6683 raft_consensus.cc:740] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.280022  6688 consensus_queue.cc:237] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.282400  6684 raft_consensus.cc:359] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.283555  6684 raft_consensus.cc:385] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.282670  6683 consensus_queue.cc:260] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.283881  6684 raft_consensus.cc:740] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.283977  6687 tablet_bootstrap.cc:492] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:21.284623  6687 ts_tablet_manager.cc:1403] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 13:15:21.284838  6684 consensus_queue.cc:260] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.286568  6683 ts_tablet_manager.cc:1434] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:15:21.287724  6687 raft_consensus.cc:359] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.288560  6687 raft_consensus.cc:385] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.288568  6683 tablet_bootstrap.cc:492] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:21.291944  6705 raft_consensus.cc:493] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.292532  6705 raft_consensus.cc:515] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.288940  6687 raft_consensus.cc:740] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.295027  6687 consensus_queue.cc:260] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.296257  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:21.297072  6493 raft_consensus.cc:2468] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 0.
I20260709 13:15:21.297631  6687 ts_tablet_manager.cc:1434] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:21.298650  6687 tablet_bootstrap.cc:492] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:21.298471  6609 leader_election.cc:304] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:21.299431  6689 raft_consensus.cc:2804] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.299597  6683 tablet_bootstrap.cc:654] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.299789  6689 raft_consensus.cc:493] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.300315  6689 raft_consensus.cc:3060] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.305764  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:21.306248  6687 tablet_bootstrap.cc:654] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:21.307539  6608 leader_election.cc:343] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.308123  6705 leader_election.cc:290] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:21.312299  6684 ts_tablet_manager.cc:1434] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:15:21.313443  6683 tablet_bootstrap.cc:492] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:21.313964  6683 ts_tablet_manager.cc:1403] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.000s
I20260709 13:15:21.309857  6389 catalog_manager.cc:5697] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 0 to 1, leader changed from <none> to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 1 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.318486  6683 raft_consensus.cc:359] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.320089  6683 raft_consensus.cc:385] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.320274  6689 raft_consensus.cc:515] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.320782  6683 raft_consensus.cc:740] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.322182  6683 consensus_queue.cc:260] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.324645  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:21.325404  6493 raft_consensus.cc:3060] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.326527  6683 ts_tablet_manager.cc:1434] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:21.330307  6683 tablet_bootstrap.cc:492] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:21.333339  6493 raft_consensus.cc:2468] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 1.
I20260709 13:15:21.334857  6609 leader_election.cc:304] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:21.335829  6705 raft_consensus.cc:2804] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.339284  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:21.338115  6689 leader_election.cc:290] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
W20260709 13:15:21.340883  6608 leader_election.cc:343] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:21.342847  6683 tablet_bootstrap.cc:654] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.345748  6705 raft_consensus.cc:697] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:21.347144  6687 tablet_bootstrap.cc:492] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:21.347801  6687 ts_tablet_manager.cc:1403] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.017s
I20260709 13:15:21.347134  6705 consensus_queue.cc:237] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.350845  6687 raft_consensus.cc:359] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.351365  6683 tablet_bootstrap.cc:492] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:21.351464  6687 raft_consensus.cc:385] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.352240  6683 ts_tablet_manager.cc:1403] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:15:21.352205  6687 raft_consensus.cc:740] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.353421  6687 consensus_queue.cc:260] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.355809  6687 ts_tablet_manager.cc:1434] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:21.355826  6683 raft_consensus.cc:359] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.356694  6683 raft_consensus.cc:385] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.356976  6683 raft_consensus.cc:740] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.357841  6683 consensus_queue.cc:260] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.357908  6389 catalog_manager.cc:5697] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.360006  6683 ts_tablet_manager.cc:1434] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:21.370268  6703 consensus_queue.cc:1048] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.375007  6688 raft_consensus.cc:493] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.375614  6688 raft_consensus.cc:515] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.379539  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:21.380764  6493 raft_consensus.cc:2393] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b19a4869870b47ca90ef4294221c224b in current term 1: Already voted for candidate 8f246c6bee1d4eb585388786ade7a309 in this term.
I20260709 13:15:21.382355  6688 leader_election.cc:290] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.383586  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:21.385650  6533 leader_election.cc:304] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b19a4869870b47ca90ef4294221c224b; no voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:21.386173  6642 raft_consensus.cc:3060] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.386502  6688 raft_consensus.cc:3060] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.394228  6688 raft_consensus.cc:2749] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:21.396402  6692 consensus_queue.cc:1048] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.479112  6688 raft_consensus.cc:493] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.480098  6688 raft_consensus.cc:515] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.485056  6688 leader_election.cc:290] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.485954  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea10ed64a394b9b817b16ff98f9e4fd" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:21.487401  6493 raft_consensus.cc:2468] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:21.487744  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea10ed64a394b9b817b16ff98f9e4fd" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:21.489065  6642 raft_consensus.cc:2468] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:21.489306  6535 leader_election.cc:304] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.490588  6688 raft_consensus.cc:2804] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.490923  6688 raft_consensus.cc:493] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.491204  6688 raft_consensus.cc:3060] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.491616  6708 consensus_queue.cc:1048] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.501941  6688 raft_consensus.cc:515] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.509721  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea10ed64a394b9b817b16ff98f9e4fd" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:21.510365  6493 raft_consensus.cc:3060] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.511041  6708 consensus_queue.cc:1048] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.513070  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea10ed64a394b9b817b16ff98f9e4fd" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.513677  6688 leader_election.cc:290] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.513828  6643 raft_consensus.cc:3060] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.527896  6643 raft_consensus.cc:2468] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:21.529503  6533 leader_election.cc:304] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.529646  6493 raft_consensus.cc:2468] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:21.530683  6688 raft_consensus.cc:2804] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.531339  6688 raft_consensus.cc:697] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:21.532848  6688 consensus_queue.cc:237] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.534816  6745 consensus_queue.cc:1048] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.535317  6712 raft_consensus.cc:493] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.536070  6712 raft_consensus.cc:515] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.538854  6712 leader_election.cc:290] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.542897  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:21.543962  6494 raft_consensus.cc:2468] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:21.544544  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:21.545552  6643 raft_consensus.cc:2468] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:21.545862  6535 leader_election.cc:304] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.548197  6688 raft_consensus.cc:2804] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.550529  6688 raft_consensus.cc:493] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.551432  6688 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.549196  6391 catalog_manager.cc:5697] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 0 to 1, leader changed from <none> to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 1 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.563127  6745 consensus_queue.cc:1048] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.562983  6688 raft_consensus.cc:515] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.567045  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:21.567391  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.567782  6494 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.568279  6642 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.588662  6688 leader_election.cc:290] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.589365  6494 raft_consensus.cc:2468] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:21.590673  6535 leader_election.cc:304] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.590998  6642 raft_consensus.cc:2468] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:21.591964  6688 raft_consensus.cc:2804] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.592716  6688 raft_consensus.cc:697] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:21.593654  6688 consensus_queue.cc:237] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.599756  6692 consensus_queue.cc:1048] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.604700  6391 catalog_manager.cc:5697] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 0 to 1, leader changed from <none> to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 1 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.610242  6704 raft_consensus.cc:493] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.611131  6704 raft_consensus.cc:515] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.614439  6704 leader_election.cc:290] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.615041  6704 consensus_queue.cc:1048] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.615399  6568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:21.615741  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:21.616494  6568 raft_consensus.cc:2468] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 0.
I20260709 13:15:21.616660  6642 raft_consensus.cc:2468] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 0.
I20260709 13:15:21.618296  6459 leader_election.cc:304] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.619334  6752 raft_consensus.cc:2804] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:21.619762  6752 raft_consensus.cc:493] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.620186  6752 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.634042  6752 raft_consensus.cc:515] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.637519  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:21.638229  6569 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.638365  6752 leader_election.cc:290] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.639595  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.640368  6642 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.648001  6642 raft_consensus.cc:2468] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:21.649228  6569 raft_consensus.cc:2468] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:21.649326  6458 leader_election.cc:304] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:21.650388  6752 raft_consensus.cc:2804] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.650967  6752 raft_consensus.cc:697] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:21.651878  6752 consensus_queue.cc:237] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.660251  6391 catalog_manager.cc:5697] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.670732  6688 consensus_queue.cc:1048] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.687137  6688 consensus_queue.cc:1048] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.715716  6569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d6286e3a4db45049a75e4887579e688"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
mode: GRACEFUL
new_leader_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:21.716576  6569 raft_consensus.cc:606] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Received request to transfer leadership to TS 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:21.729869  6569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
mode: GRACEFUL
new_leader_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:21.730365  6569 raft_consensus.cc:606] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Received request to transfer leadership to TS 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:21.741351  6569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
mode: GRACEFUL
new_leader_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:21.742091  6569 raft_consensus.cc:606] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Received request to transfer leadership to TS 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:21.761515  6494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92bf03ad93694d5989574a672f2069c4"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
mode: GRACEFUL
new_leader_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:42628
I20260709 13:15:21.762192  6494 raft_consensus.cc:606] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Received request to transfer leadership to TS b19a4869870b47ca90ef4294221c224b
I20260709 13:15:21.774231  6692 raft_consensus.cc:993] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04: : Instructing follower b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:21.774806  6752 raft_consensus.cc:1081] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Signalling peer b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:21.776571  6569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92bf03ad93694d5989574a672f2069c4"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:40512
I20260709 13:15:21.777172  6569 raft_consensus.cc:493] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.777498  6569 raft_consensus.cc:3060] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.782511  6642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
mode: GRACEFUL
new_leader_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:60204
I20260709 13:15:21.783383  6642 raft_consensus.cc:606] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Received request to transfer leadership to TS b19a4869870b47ca90ef4294221c224b
I20260709 13:15:21.784601  6569 raft_consensus.cc:515] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.787314  6569 leader_election.cc:290] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.787837  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bf03ad93694d5989574a672f2069c4" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:21.787998  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92bf03ad93694d5989574a672f2069c4" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.788614  6494 raft_consensus.cc:3055] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.788818  6642 raft_consensus.cc:3060] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.788913  6494 raft_consensus.cc:740] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:21.790218  6494 consensus_queue.cc:260] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.791589  6494 raft_consensus.cc:3060] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.795065  6493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
mode: GRACEFUL
new_leader_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:42628
I20260709 13:15:21.795982  6493 raft_consensus.cc:606] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Received request to transfer leadership to TS b19a4869870b47ca90ef4294221c224b
I20260709 13:15:21.797986  6642 raft_consensus.cc:2468] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:21.800310  6533 leader_election.cc:304] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.801457  6688 raft_consensus.cc:2804] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.801970  6688 raft_consensus.cc:697] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:21.803035  6688 consensus_queue.cc:237] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.804636  6494 raft_consensus.cc:2468] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:21.807510  6569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea10ed64a394b9b817b16ff98f9e4fd"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
mode: GRACEFUL
new_leader_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:21.808403  6569 raft_consensus.cc:606] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Received request to transfer leadership to TS 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:21.813468  6389 catalog_manager.cc:5697] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 1 to 2, leader changed from 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1) to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 2 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.870405  6705 consensus_queue.cc:1048] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:21.875512  6761 consensus_queue.cc:1048] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:21.888896  6705 raft_consensus.cc:993] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309: : Instructing follower b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:21.894794  6764 raft_consensus.cc:1081] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Signalling peer b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:21.896597  6569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:40524
I20260709 13:15:21.897234  6569 raft_consensus.cc:493] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.897604  6569 raft_consensus.cc:3060] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.906036  6569 raft_consensus.cc:515] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.907759  6569 leader_election.cc:290] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.908818  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:21.909047  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f213fecb16e4b27896f7d09f642647c" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.909616  6494 raft_consensus.cc:3060] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.909616  6642 raft_consensus.cc:3055] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.910254  6642 raft_consensus.cc:740] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:21.911352  6642 consensus_queue.cc:260] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.912863  6642 raft_consensus.cc:3060] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.918555  6494 raft_consensus.cc:2468] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:21.920085  6535 leader_election.cc:304] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:21.920946  6688 raft_consensus.cc:2804] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.921324  6642 raft_consensus.cc:2468] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:21.921583  6688 raft_consensus.cc:697] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:21.922621  6688 consensus_queue.cc:237] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.930096  6391 catalog_manager.cc:5697] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 1 to 2, leader changed from 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3) to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 2 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.949249  6745 raft_consensus.cc:993] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b: : Instructing follower 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:21.949836  6688 raft_consensus.cc:1081] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Signalling peer 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:21.951793  6494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:42614
I20260709 13:15:21.952454  6494 raft_consensus.cc:493] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.952911  6494 raft_consensus.cc:3060] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.958642  6494 raft_consensus.cc:515] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.960429  6494 leader_election.cc:290] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:21.961472  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:21.961638  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd75a1e5fbe445a2a3841270d62c8a6b" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:21.962227  6569 raft_consensus.cc:3055] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:21.962313  6642 raft_consensus.cc:3060] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.962563  6569 raft_consensus.cc:740] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:21.963505  6569 consensus_queue.cc:260] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.964498  6569 raft_consensus.cc:3060] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.968335  6642 raft_consensus.cc:2468] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:21.969638  6569 raft_consensus.cc:2468] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:21.969892  6458 leader_election.cc:304] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:21.970989  6752 raft_consensus.cc:2804] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:21.971529  6752 raft_consensus.cc:697] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:21.972664  6752 consensus_queue.cc:237] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:21.983647  6391 catalog_manager.cc:5697] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 1 to 2, leader changed from b19a4869870b47ca90ef4294221c224b (127.26.202.2) to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.992739  6688 consensus_queue.cc:1048] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.000859  6745 raft_consensus.cc:993] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b: : Instructing follower 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:22.001646  6708 raft_consensus.cc:1081] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Signalling peer 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:22.004496  6643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ea10ed64a394b9b817b16ff98f9e4fd"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:15:22.005244  6643 raft_consensus.cc:493] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.005720  6643 raft_consensus.cc:3060] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.009037  6745 consensus_queue.cc:1048] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.015563  6643 raft_consensus.cc:515] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.024685  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea10ed64a394b9b817b16ff98f9e4fd" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:22.025393  6494 raft_consensus.cc:3060] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.026033  6643 leader_election.cc:290] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:22.028175  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea10ed64a394b9b817b16ff98f9e4fd" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:22.029085  6569 raft_consensus.cc:3055] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.029440  6569 raft_consensus.cc:740] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:22.030264  6569 consensus_queue.cc:260] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.031602  6569 raft_consensus.cc:3060] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.034277  6494 raft_consensus.cc:2468] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 2.
I20260709 13:15:22.035933  6609 leader_election.cc:304] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:22.036891  6764 raft_consensus.cc:2804] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.037496  6764 raft_consensus.cc:697] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:22.038429  6764 consensus_queue.cc:237] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.039186  6569 raft_consensus.cc:2468] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 2.
I20260709 13:15:22.043480  6745 consensus_queue.cc:1048] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.047298  6389 catalog_manager.cc:5697] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 1 to 2, leader changed from b19a4869870b47ca90ef4294221c224b (127.26.202.2) to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.056717  6745 consensus_queue.cc:1048] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.064870  6708 raft_consensus.cc:993] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b: : Instructing follower 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:22.065552  6745 raft_consensus.cc:1081] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Signalling peer 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:22.067123  6494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:42614
I20260709 13:15:22.067704  6494 raft_consensus.cc:493] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.068107  6494 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.073318  6494 raft_consensus.cc:515] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.075465  6494 leader_election.cc:290] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:22.076855  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:22.077447  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:22.077764  6569 raft_consensus.cc:3055] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.078151  6643 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.078262  6569 raft_consensus.cc:740] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:22.079269  6569 consensus_queue.cc:260] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.080679  6569 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.084479  6752 consensus_queue.cc:1048] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:22.086596  6643 raft_consensus.cc:2468] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:22.088928  6458 leader_election.cc:304] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:22.088892  6569 raft_consensus.cc:2468] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:22.091377  6752 raft_consensus.cc:2804] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.091959  6752 raft_consensus.cc:697] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:22.093204  6703 raft_consensus.cc:993] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04: : Instructing follower b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:22.093130  6752 consensus_queue.cc:237] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.093755  6703 raft_consensus.cc:1081] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Signalling peer b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:22.097023  6569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:40512
I20260709 13:15:22.098687  6569 raft_consensus.cc:493] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.099095  6569 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.101819  6703 consensus_queue.cc:1048] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.103087  6389 catalog_manager.cc:5697] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 1 to 2, leader changed from b19a4869870b47ca90ef4294221c224b (127.26.202.2) to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.107756  6569 raft_consensus.cc:515] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.109268  6568 raft_consensus.cc:1240] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Rejecting Update request from peer 2b4acb020cdc4e3fad469821f9128f04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:22.116566  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:22.116618  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:22.117201  6494 raft_consensus.cc:3055] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.117424  6643 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.117579  6494 raft_consensus.cc:740] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:22.119045  6494 consensus_queue.cc:260] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.120041  6569 leader_election.cc:290] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:22.120182  6692 consensus_queue.cc:1059] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:22.124105  6494 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.126083  6643 raft_consensus.cc:2468] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:22.127676  6533 leader_election.cc:304] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:22.128960  6688 raft_consensus.cc:2804] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.129462  6688 raft_consensus.cc:697] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:22.130414  6688 consensus_queue.cc:237] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:22.133881  6494 raft_consensus.cc:2468] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:22.142930  6389 catalog_manager.cc:5697] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 1 to 2, leader changed from 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1) to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 2 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.170243  6708 raft_consensus.cc:993] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b: : Instructing follower 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:22.170782  6688 raft_consensus.cc:1081] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Signalling peer 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:22.172499  6494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d6286e3a4db45049a75e4887579e688"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:42614
I20260709 13:15:22.173207  6494 raft_consensus.cc:493] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:22.173733  6494 raft_consensus.cc:3060] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.179486  6494 raft_consensus.cc:515] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:22.181556  6494 leader_election.cc:290] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:22.182732  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6286e3a4db45049a75e4887579e688" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:22.182688  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d6286e3a4db45049a75e4887579e688" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:22.183636  6643 raft_consensus.cc:3060] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.183671  6569 raft_consensus.cc:3055] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:22.184233  6569 raft_consensus.cc:740] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:22.185408  6569 consensus_queue.cc:260] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:22.186895  6569 raft_consensus.cc:3060] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.192078  6643 raft_consensus.cc:2468] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:22.193861  6458 leader_election.cc:304] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:22.194839  6703 raft_consensus.cc:2804] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:22.194809  6569 raft_consensus.cc:2468] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:22.195703  6703 raft_consensus.cc:697] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:22.196638  6703 consensus_queue.cc:237] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } }
I20260709 13:15:22.203187  6389 catalog_manager.cc:5697] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 1 to 2, leader changed from b19a4869870b47ca90ef4294221c224b (127.26.202.2) to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.266956  6643 raft_consensus.cc:1275] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.268299  6688 consensus_queue.cc:1048] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.277989  6494 raft_consensus.cc:1275] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.279937  6708 consensus_queue.cc:1048] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.440935  6569 raft_consensus.cc:1275] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.442668  6764 consensus_queue.cc:1048] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.450457  6494 raft_consensus.cc:1275] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.452855  6764 consensus_queue.cc:1048] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.486117  6643 raft_consensus.cc:1275] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.753278  6643 raft_consensus.cc:1275] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.754462  6642 raft_consensus.cc:1275] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.755131  6703 consensus_queue.cc:1048] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.756646  6703 consensus_queue.cc:1048] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.771315  6643 raft_consensus.cc:1275] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.776899  6567 raft_consensus.cc:1275] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.778578  6703 consensus_queue.cc:1048] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.779953  6703 consensus_queue.cc:1048] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.782621  6494 raft_consensus.cc:1275] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.784650  6688 consensus_queue.cc:1048] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.793094  6493 raft_consensus.cc:1275] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.794705  6688 consensus_queue.cc:1048] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.795053  6568 raft_consensus.cc:1275] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.797736  6772 consensus_queue.cc:1048] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.820820  6641 raft_consensus.cc:1275] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.824000  6708 consensus_queue.cc:1048] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.825672  6708 consensus_queue.cc:1048] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:22.836450  6569 raft_consensus.cc:1275] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:22.838373  6772 consensus_queue.cc:1048] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:23.857496  6590 debug-util.cc:398] Leaking SignalData structure 0x7b08003d06a0 after lost signal to thread 27435
W20260709 13:15:23.858671  6590 debug-util.cc:398] Leaking SignalData structure 0x7b0800166580 after lost signal to thread 6426
W20260709 13:15:23.859740  6590 debug-util.cc:398] Leaking SignalData structure 0x7b080035e8e0 after lost signal to thread 6518
W20260709 13:15:23.860678  6590 debug-util.cc:398] Leaking SignalData structure 0x7b08002edd60 after lost signal to thread 6593
W20260709 13:15:23.861618  6590 debug-util.cc:398] Leaking SignalData structure 0x7b080028fe60 after lost signal to thread 6667
I20260709 13:15:24.943691  6391 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41606:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:24.946444  6391 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:25.017627  6476 tablet_service.cc:1511] Processing CreateTablet for tablet 4473e66fabe14a439c92324bda1427e8 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:25.018901  6556 tablet_service.cc:1511] Processing CreateTablet for tablet 4473e66fabe14a439c92324bda1427e8 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:25.020744  6556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4473e66fabe14a439c92324bda1427e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.048079  6483 tablet_service.cc:1511] Processing CreateTablet for tablet 9b802be150aa45d3af15a06828c9979a (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:25.022017  6629 tablet_service.cc:1511] Processing CreateTablet for tablet 4473e66fabe14a439c92324bda1427e8 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:25.049891  6629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4473e66fabe14a439c92324bda1427e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.024796  6630 tablet_service.cc:1511] Processing CreateTablet for tablet a30bd813962f4a84b631622d206710f8 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:25.051733  6630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30bd813962f4a84b631622d206710f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.055344  6477 tablet_service.cc:1511] Processing CreateTablet for tablet 832edd74379340c0a1a63675821534d9 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:25.025643  6476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4473e66fabe14a439c92324bda1427e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:25.058705  6440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:25.058905  6627 tablet_service.cc:1511] Processing CreateTablet for tablet 9b802be150aa45d3af15a06828c9979a (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:25.059456  6626 tablet_service.cc:1511] Processing CreateTablet for tablet 832edd74379340c0a1a63675821534d9 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:25.060513  6627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b802be150aa45d3af15a06828c9979a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.028308  6633 tablet_service.cc:1511] Processing CreateTablet for tablet 21d9e05e5c8d4a2db744d868554d4397 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:25.062376  6626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 832edd74379340c0a1a63675821534d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.062824  6625 tablet_service.cc:1511] Processing CreateTablet for tablet 3fde82c6b12a472b8339d17114123ce5 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:25.064225  6625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fde82c6b12a472b8339d17114123ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.031049  6484 tablet_service.cc:1511] Processing CreateTablet for tablet 21d9e05e5c8d4a2db744d868554d4397 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:25.032840  6632 tablet_service.cc:1511] Processing CreateTablet for tablet e3b98c4cfe574dcba5d8356367831556 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:25.066191  6484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d9e05e5c8d4a2db744d868554d4397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.065469  6633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d9e05e5c8d4a2db744d868554d4397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.035590  6559 tablet_service.cc:1511] Processing CreateTablet for tablet a30bd813962f4a84b631622d206710f8 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:25.068234  6632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b98c4cfe574dcba5d8356367831556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.068881  6559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30bd813962f4a84b631622d206710f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.036099  6558 tablet_service.cc:1511] Processing CreateTablet for tablet e3b98c4cfe574dcba5d8356367831556 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:25.070348  6477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 832edd74379340c0a1a63675821534d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.070797  6558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b98c4cfe574dcba5d8356367831556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.072506  6483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b802be150aa45d3af15a06828c9979a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.037809  6554 tablet_service.cc:1511] Processing CreateTablet for tablet 21d9e05e5c8d4a2db744d868554d4397 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:25.073907  6554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d9e05e5c8d4a2db744d868554d4397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.040809  6479 tablet_service.cc:1511] Processing CreateTablet for tablet 45a318e03384479ea1531150cfbea717 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:25.076654  6479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a318e03384479ea1531150cfbea717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.078564  6553 tablet_service.cc:1511] Processing CreateTablet for tablet 9b802be150aa45d3af15a06828c9979a (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:25.040897  6631 tablet_service.cc:1511] Processing CreateTablet for tablet 45a318e03384479ea1531150cfbea717 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:25.080052  6553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b802be150aa45d3af15a06828c9979a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.081066  6631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a318e03384479ea1531150cfbea717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.082752  6552 tablet_service.cc:1511] Processing CreateTablet for tablet 832edd74379340c0a1a63675821534d9 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:25.043609  6555 tablet_service.cc:1511] Processing CreateTablet for tablet 45a318e03384479ea1531150cfbea717 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:25.044211  6628 tablet_service.cc:1511] Processing CreateTablet for tablet 135acbefaee24d58a2be915d0a6feef2 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:25.086480  6628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135acbefaee24d58a2be915d0a6feef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.088096  6481 tablet_service.cc:1511] Processing CreateTablet for tablet 3fde82c6b12a472b8339d17114123ce5 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:25.045625  6482 tablet_service.cc:1511] Processing CreateTablet for tablet 135acbefaee24d58a2be915d0a6feef2 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:25.089577  6481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fde82c6b12a472b8339d17114123ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.029021  6478 tablet_service.cc:1511] Processing CreateTablet for tablet a30bd813962f4a84b631622d206710f8 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:25.090881  6478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30bd813962f4a84b631622d206710f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.033584  6480 tablet_service.cc:1511] Processing CreateTablet for tablet e3b98c4cfe574dcba5d8356367831556 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:25.093775  6480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b98c4cfe574dcba5d8356367831556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.080070  6557 tablet_service.cc:1511] Processing CreateTablet for tablet 135acbefaee24d58a2be915d0a6feef2 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:25.096905  6482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135acbefaee24d58a2be915d0a6feef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.084663  6552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 832edd74379340c0a1a63675821534d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.102736  6551 tablet_service.cc:1511] Processing CreateTablet for tablet 3fde82c6b12a472b8339d17114123ce5 (DEFAULT_TABLE table=soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:25.104374  6551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fde82c6b12a472b8339d17114123ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.105350  6555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a318e03384479ea1531150cfbea717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.112179  6557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135acbefaee24d58a2be915d0a6feef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.276580  6791 tablet_bootstrap.cc:492] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:25.284210  6792 tablet_bootstrap.cc:492] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.307332  6791 tablet_bootstrap.cc:654] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.311057  6792 tablet_bootstrap.cc:654] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.310274  6793 tablet_bootstrap.cc:492] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.335794  6793 tablet_bootstrap.cc:654] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.339610  6792 tablet_bootstrap.cc:492] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.340260  6792 ts_tablet_manager.cc:1403] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.021s
I20260709 13:15:25.340561  6791 tablet_bootstrap.cc:492] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:25.341312  6791 ts_tablet_manager.cc:1403] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.016s
I20260709 13:15:25.345522  6791 raft_consensus.cc:359] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.346386  6791 raft_consensus.cc:385] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.346724  6791 raft_consensus.cc:740] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.347736  6791 consensus_queue.cc:260] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.350247  6793 tablet_bootstrap.cc:492] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.350822  6791 ts_tablet_manager.cc:1434] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:15:25.350934  6793 ts_tablet_manager.cc:1403] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.011s
I20260709 13:15:25.352298  6791 tablet_bootstrap.cc:492] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:25.354598  6793 raft_consensus.cc:359] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.355460  6793 raft_consensus.cc:385] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.355830  6793 raft_consensus.cc:740] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.356595  6793 consensus_queue.cc:260] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.359227  6793 ts_tablet_manager.cc:1434] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:15:25.366027  6791 tablet_bootstrap.cc:654] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.346984  6792 raft_consensus.cc:359] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.368894  6792 raft_consensus.cc:385] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.369282  6792 raft_consensus.cc:740] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.370086  6792 consensus_queue.cc:260] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.382406  6793 tablet_bootstrap.cc:492] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.382699  6791 tablet_bootstrap.cc:492] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:25.383373  6792 ts_tablet_manager.cc:1434] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.002s
I20260709 13:15:25.384498  6792 tablet_bootstrap.cc:492] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.383409  6791 ts_tablet_manager.cc:1403] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 13:15:25.391047  6793 tablet_bootstrap.cc:654] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.393213  6791 raft_consensus.cc:359] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.394240  6791 raft_consensus.cc:385] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.394564  6791 raft_consensus.cc:740] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.397492  6792 tablet_bootstrap.cc:654] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.403610  6793 tablet_bootstrap.cc:492] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.404337  6793 ts_tablet_manager.cc:1403] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 13:15:25.408437  6793 raft_consensus.cc:359] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.409614  6793 raft_consensus.cc:385] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.409516  6791 consensus_queue.cc:260] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.410789  6793 raft_consensus.cc:740] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.411860  6793 consensus_queue.cc:260] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.412628  6792 tablet_bootstrap.cc:492] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.413589  6792 ts_tablet_manager.cc:1403] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.013s
I20260709 13:15:25.417294  6792 raft_consensus.cc:359] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.418119  6792 raft_consensus.cc:385] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.418411  6792 raft_consensus.cc:740] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.419165  6792 consensus_queue.cc:260] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.421931  6792 ts_tablet_manager.cc:1434] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:15:25.422506  6793 ts_tablet_manager.cc:1434] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:15:25.426442  6792 tablet_bootstrap.cc:492] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.430938  6793 tablet_bootstrap.cc:492] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.434912  6792 tablet_bootstrap.cc:654] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.445575  6791 ts_tablet_manager.cc:1434] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 13:15:25.450188  6793 tablet_bootstrap.cc:654] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.451974  6792 tablet_bootstrap.cc:492] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.452608  6792 ts_tablet_manager.cc:1403] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:15:25.455524  6791 tablet_bootstrap.cc:492] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:25.455859  6792 raft_consensus.cc:359] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.456753  6792 raft_consensus.cc:385] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.457111  6792 raft_consensus.cc:740] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.457947  6792 consensus_queue.cc:260] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.459846  6792 ts_tablet_manager.cc:1434] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:15:25.460954  6792 tablet_bootstrap.cc:492] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.469419  6791 tablet_bootstrap.cc:654] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.469523  6792 tablet_bootstrap.cc:654] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.476851  6793 tablet_bootstrap.cc:492] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.477413  6793 ts_tablet_manager.cc:1403] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.013s
I20260709 13:15:25.478709  6791 tablet_bootstrap.cc:492] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:25.479334  6791 ts_tablet_manager.cc:1403] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:15:25.480703  6793 raft_consensus.cc:359] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.481616  6793 raft_consensus.cc:385] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.481925  6793 raft_consensus.cc:740] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.482746  6793 consensus_queue.cc:260] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.482944  6791 raft_consensus.cc:359] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.485558  6793 ts_tablet_manager.cc:1434] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:25.486595  6791 raft_consensus.cc:385] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.488018  6791 raft_consensus.cc:740] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.487494  6793 tablet_bootstrap.cc:492] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.489100  6791 consensus_queue.cc:260] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.491655  6791 ts_tablet_manager.cc:1434] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:15:25.492749  6791 tablet_bootstrap.cc:492] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:25.485916  6792 tablet_bootstrap.cc:492] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.493448  6792 ts_tablet_manager.cc:1403] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.006s
I20260709 13:15:25.496939  6792 raft_consensus.cc:359] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.497757  6792 raft_consensus.cc:385] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.498082  6792 raft_consensus.cc:740] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.499841  6791 tablet_bootstrap.cc:654] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.503779  6793 tablet_bootstrap.cc:654] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.507615  6792 consensus_queue.cc:260] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.510546  6792 ts_tablet_manager.cc:1434] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:25.512203  6792 tablet_bootstrap.cc:492] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.519598  6792 tablet_bootstrap.cc:654] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.523075  6775 raft_consensus.cc:493] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.523355  6793 tablet_bootstrap.cc:492] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.524008  6793 ts_tablet_manager.cc:1403] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.008s
I20260709 13:15:25.523700  6775 raft_consensus.cc:515] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.526505  6775 leader_election.cc:290] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.527660  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30bd813962f4a84b631622d206710f8" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:25.527495  6793 raft_consensus.cc:359] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.539597  6793 raft_consensus.cc:385] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.539655  6642 raft_consensus.cc:2468] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 0.
I20260709 13:15:25.540124  6793 raft_consensus.cc:740] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.541079  6793 consensus_queue.cc:260] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.541517  6458 leader_election.cc:304] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:25.534564  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30bd813962f4a84b631622d206710f8" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
W20260709 13:15:25.546267  6459 leader_election.cc:343] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.552299  6775 raft_consensus.cc:2804] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.553861  6775 raft_consensus.cc:493] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.555194  6775 raft_consensus.cc:3060] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.562605  6792 tablet_bootstrap.cc:492] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.563040  6791 tablet_bootstrap.cc:492] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:25.563266  6792 ts_tablet_manager.cc:1403] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.014s
I20260709 13:15:25.563647  6791 ts_tablet_manager.cc:1403] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.071s	user 0.028s	sys 0.011s
I20260709 13:15:25.567302  6792 raft_consensus.cc:359] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.567571  6791 raft_consensus.cc:359] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.568280  6792 raft_consensus.cc:385] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.568635  6791 raft_consensus.cc:385] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.568708  6792 raft_consensus.cc:740] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.569206  6791 raft_consensus.cc:740] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.569738  6792 consensus_queue.cc:260] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.570099  6791 consensus_queue.cc:260] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.573221  6792 ts_tablet_manager.cc:1434] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:15:25.574431  6792 tablet_bootstrap.cc:492] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.578680  6791 ts_tablet_manager.cc:1434] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:15:25.579973  6791 tablet_bootstrap.cc:492] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:25.584532  6775 raft_consensus.cc:515] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.587548  6793 ts_tablet_manager.cc:1434] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.063s	user 0.024s	sys 0.006s
I20260709 13:15:25.591251  6793 tablet_bootstrap.cc:492] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.595867  6791 tablet_bootstrap.cc:654] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.601328  6793 tablet_bootstrap.cc:654] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.604986  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30bd813962f4a84b631622d206710f8" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:25.605715  6569 raft_consensus.cc:3060] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.608588  6808 raft_consensus.cc:493] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.609267  6808 raft_consensus.cc:515] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.604337  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30bd813962f4a84b631622d206710f8" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:25.612062  6791 tablet_bootstrap.cc:492] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:25.611974  6642 raft_consensus.cc:3060] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.613714  6569 raft_consensus.cc:2468] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:25.588680  6792 tablet_bootstrap.cc:654] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.615581  6459 leader_election.cc:304] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:25.617781  6807 raft_consensus.cc:2804] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.618229  6808 leader_election.cc:290] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.618423  6641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fde82c6b12a472b8339d17114123ce5" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:25.619858  6791 ts_tablet_manager.cc:1403] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.008s
I20260709 13:15:25.619918  6775 leader_election.cc:290] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
W20260709 13:15:25.620100  6458 leader_election.cc:343] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.620671  6642 raft_consensus.cc:2468] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:25.622956  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fde82c6b12a472b8339d17114123ce5" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:25.623837  6569 raft_consensus.cc:2468] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 0.
I20260709 13:15:25.625589  6459 leader_election.cc:304] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:25.625867  6791 raft_consensus.cc:359] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.626847  6791 raft_consensus.cc:385] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.627215  6791 raft_consensus.cc:740] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.627434  6807 raft_consensus.cc:697] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:25.628221  6791 consensus_queue.cc:260] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.631865  6775 raft_consensus.cc:2804] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.632403  6775 raft_consensus.cc:493] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.632769  6775 raft_consensus.cc:3060] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.628777  6807 consensus_queue.cc:237] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.641360  6775 raft_consensus.cc:515] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.645902  6791 ts_tablet_manager.cc:1434] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:25.647349  6791 tablet_bootstrap.cc:492] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:25.648578  6792 tablet_bootstrap.cc:492] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.655485  6791 tablet_bootstrap.cc:654] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.660480  6792 ts_tablet_manager.cc:1403] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.002s
I20260709 13:15:25.660764  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fde82c6b12a472b8339d17114123ce5" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:25.661480  6642 raft_consensus.cc:3060] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.661372  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fde82c6b12a472b8339d17114123ce5" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:25.662365  6569 raft_consensus.cc:3060] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.663821  6792 raft_consensus.cc:359] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.664561  6792 raft_consensus.cc:385] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.664822  6792 raft_consensus.cc:740] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.665652  6792 consensus_queue.cc:260] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.669543  6642 raft_consensus.cc:2468] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:25.670867  6458 leader_election.cc:304] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:25.671741  6775 leader_election.cc:290] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.672267  6808 raft_consensus.cc:2804] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.672844  6808 raft_consensus.cc:697] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:25.674111  6808 consensus_queue.cc:237] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.675603  6569 raft_consensus.cc:2468] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:25.679881  6389 catalog_manager.cc:5697] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.684469  6792 ts_tablet_manager.cc:1434] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:15:25.688020  6793 tablet_bootstrap.cc:492] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.688776  6793 ts_tablet_manager.cc:1403] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.098s	user 0.026s	sys 0.015s
I20260709 13:15:25.689158  6792 tablet_bootstrap.cc:492] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.691922  6793 raft_consensus.cc:359] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.692656  6793 raft_consensus.cc:385] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.692938  6793 raft_consensus.cc:740] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.693759  6793 consensus_queue.cc:260] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.696149  6793 ts_tablet_manager.cc:1434] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:25.698300  6792 tablet_bootstrap.cc:654] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.698587  6793 tablet_bootstrap.cc:492] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.699440  6791 tablet_bootstrap.cc:492] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:25.699973  6791 ts_tablet_manager.cc:1403] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.007s
I20260709 13:15:25.703384  6791 raft_consensus.cc:359] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.704253  6791 raft_consensus.cc:385] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.704612  6791 raft_consensus.cc:740] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.705557  6791 consensus_queue.cc:260] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.706161  6793 tablet_bootstrap.cc:654] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.708297  6791 ts_tablet_manager.cc:1434] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:25.717360  6791 tablet_bootstrap.cc:492] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:25.729849  6791 tablet_bootstrap.cc:654] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.729880  6792 tablet_bootstrap.cc:492] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.732447  6793 tablet_bootstrap.cc:492] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.733449  6793 ts_tablet_manager.cc:1403] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.004s
I20260709 13:15:25.736544  6793 raft_consensus.cc:359] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.737303  6793 raft_consensus.cc:385] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.737607  6793 raft_consensus.cc:740] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.738333  6793 consensus_queue.cc:260] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.740931  6793 ts_tablet_manager.cc:1434] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:15:25.740957  6389 catalog_manager.cc:5697] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.742141  6793 tablet_bootstrap.cc:492] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.732890  6792 ts_tablet_manager.cc:1403] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.019s
I20260709 13:15:25.748375  6792 raft_consensus.cc:359] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.749382  6792 raft_consensus.cc:385] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.749764  6792 raft_consensus.cc:740] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.749917  6761 raft_consensus.cc:493] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.750761  6761 raft_consensus.cc:515] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.751336  6792 consensus_queue.cc:260] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.753180  6708 raft_consensus.cc:493] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.753669  6708 raft_consensus.cc:515] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.755964  6708 leader_election.cc:290] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.758612  6793 tablet_bootstrap.cc:654] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.759609  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:25.760396  6493 raft_consensus.cc:2468] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:25.762643  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:25.767307  6535 leader_election.cc:304] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
W20260709 13:15:25.770320  6533 leader_election.cc:343] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.776831  6824 raft_consensus.cc:2804] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.777407  6824 raft_consensus.cc:493] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.777729  6824 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.777973  6792 ts_tablet_manager.cc:1434] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.010s
I20260709 13:15:25.779083  6792 tablet_bootstrap.cc:492] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.780923  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
W20260709 13:15:25.786932  6609 leader_election.cc:343] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.793179  6823 raft_consensus.cc:493] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.791534  6761 leader_election.cc:290] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:25.793742  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:25.793820  6823 raft_consensus.cc:515] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.794553  6569 raft_consensus.cc:2468] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 0.
I20260709 13:15:25.794754  6708 raft_consensus.cc:493] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.798162  6824 raft_consensus.cc:515] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.799625  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135acbefaee24d58a2be915d0a6feef2" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:25.803297  6493 raft_consensus.cc:2468] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 0.
I20260709 13:15:25.804518  6824 leader_election.cc:290] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.801818  6793 tablet_bootstrap.cc:492] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.806466  6793 ts_tablet_manager.cc:1403] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.001s
I20260709 13:15:25.806576  6761 raft_consensus.cc:493] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.801842  6708 raft_consensus.cc:515] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.807701  6609 leader_election.cc:304] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:25.796041  6608 leader_election.cc:304] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:25.809342  6761 raft_consensus.cc:515] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.810424  6793 raft_consensus.cc:359] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.800478  6792 tablet_bootstrap.cc:654] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.813374  6761 leader_election.cc:290] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:25.808593  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:25.811357  6793 raft_consensus.cc:385] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.814669  6793 raft_consensus.cc:740] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.814837  6761 raft_consensus.cc:2804] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.815593  6761 raft_consensus.cc:493] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.816017  6708 leader_election.cc:290] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.815670  6793 consensus_queue.cc:260] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.796552  6823 leader_election.cc:290] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:25.817761  6793 ts_tablet_manager.cc:1434] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:25.818074  6823 raft_consensus.cc:2804] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.818454  6823 raft_consensus.cc:493] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.818812  6823 raft_consensus.cc:3060] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.816697  6761 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.821313  6793 tablet_bootstrap.cc:492] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.822866  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:25.824752  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832edd74379340c0a1a63675821534d9" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:25.838114  6493 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.840592  6791 tablet_bootstrap.cc:492] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:25.843552  6793 tablet_bootstrap.cc:654] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.844084  6808 raft_consensus.cc:493] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:25.845516  6535 leader_election.cc:343] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.845441  6808 raft_consensus.cc:515] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.849980  6808 leader_election.cc:290] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.850651  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:25.850935  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:25.851372  6569 raft_consensus.cc:2468] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 0.
I20260709 13:15:25.852746  6459 leader_election.cc:304] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:25.853777  6808 raft_consensus.cc:2804] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.854200  6808 raft_consensus.cc:493] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.854584  6808 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.856429  6791 ts_tablet_manager.cc:1403] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.146s	user 0.009s	sys 0.013s
I20260709 13:15:25.862375  6791 raft_consensus.cc:359] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.865833  6791 raft_consensus.cc:385] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.867197  6791 raft_consensus.cc:740] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.868630  6791 consensus_queue.cc:260] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.872444  6793 tablet_bootstrap.cc:492] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.873160  6793 ts_tablet_manager.cc:1403] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.007s
W20260709 13:15:25.874437  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39943, user_credentials={real_user=slave}} blocked reactor thread for 77564.7us
I20260709 13:15:25.876253  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135acbefaee24d58a2be915d0a6feef2" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:25.876894  6569 raft_consensus.cc:2468] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 0.
I20260709 13:15:25.878088  6791 ts_tablet_manager.cc:1434] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:15:25.878952  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d9e05e5c8d4a2db744d868554d4397" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:25.878954  6793 raft_consensus.cc:359] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.880300  6793 raft_consensus.cc:385] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.881487  6793 raft_consensus.cc:740] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.881184  6791 tablet_bootstrap.cc:492] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
W20260709 13:15:25.885469  6608 leader_election.cc:343] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.886276  6793 consensus_queue.cc:260] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
W20260709 13:15:25.890488  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.1:45277, user_credentials={real_user=slave}} blocked reactor thread for 82918.6us
I20260709 13:15:25.890780  6793 ts_tablet_manager.cc:1434] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
W20260709 13:15:25.891805  6533 leader_election.cc:343] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.891956  6793 tablet_bootstrap.cc:492] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04: Bootstrap starting.
I20260709 13:15:25.893443  6827 raft_consensus.cc:493] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.894054  6827 raft_consensus.cc:515] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.895812  6492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d9e05e5c8d4a2db744d868554d4397" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:25.896598  6827 leader_election.cc:290] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:25.892547  6808 raft_consensus.cc:515] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.899151  6493 raft_consensus.cc:2468] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:25.896664  6492 raft_consensus.cc:2468] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 0.
I20260709 13:15:25.905040  6808 leader_election.cc:290] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.900506  6792 tablet_bootstrap.cc:492] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.901057  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4473e66fabe14a439c92324bda1427e8" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:25.905416  6535 leader_election.cc:304] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:25.905901  6792 ts_tablet_manager.cc:1403] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.127s	user 0.027s	sys 0.031s
I20260709 13:15:25.905982  6569 raft_consensus.cc:2468] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 0.
I20260709 13:15:25.907873  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:25.903177  6793 tablet_bootstrap.cc:654] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.908202  6826 raft_consensus.cc:2804] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.909556  6792 raft_consensus.cc:359] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.910261  6792 raft_consensus.cc:385] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.899034  6641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832edd74379340c0a1a63675821534d9" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:25.910640  6792 raft_consensus.cc:740] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.907883  6823 raft_consensus.cc:515] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.911032  6641 raft_consensus.cc:2468] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 0.
I20260709 13:15:25.912516  6792 consensus_queue.cc:260] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.909304  6826 raft_consensus.cc:697] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:25.914322  6826 consensus_queue.cc:237] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.915287  6823 leader_election.cc:290] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:25.915338  6792 ts_tablet_manager.cc:1434] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:25.912614  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:25.916433  6569 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.916603  6792 tablet_bootstrap.cc:492] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b: Bootstrap starting.
I20260709 13:15:25.917069  6791 tablet_bootstrap.cc:654] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.919443  6533 leader_election.cc:304] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:25.920343  6492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135acbefaee24d58a2be915d0a6feef2" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:25.920701  6708 raft_consensus.cc:2804] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.921028  6492 raft_consensus.cc:3060] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.921139  6708 raft_consensus.cc:493] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.921535  6708 raft_consensus.cc:3060] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.923844  6792 tablet_bootstrap.cc:654] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.928308  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4473e66fabe14a439c92324bda1427e8" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:25.931087  6808 raft_consensus.cc:493] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.935307  6493 raft_consensus.cc:2468] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 0.
I20260709 13:15:25.931250  6609 leader_election.cc:304] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: b19a4869870b47ca90ef4294221c224b
I20260709 13:15:25.934226  6761 raft_consensus.cc:515] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.935214  6808 raft_consensus.cc:515] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.937758  6569 raft_consensus.cc:2468] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:25.938972  6459 leader_election.cc:304] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:25.939520  6568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b802be150aa45d3af15a06828c9979a" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:25.940243  6775 raft_consensus.cc:2804] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.940783  6775 raft_consensus.cc:697] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
W20260709 13:15:25.941074  6459 leader_election.cc:343] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.941651  6775 consensus_queue.cc:237] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.933634  6492 raft_consensus.cc:2468] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 1.
I20260709 13:15:25.946022  6642 raft_consensus.cc:2393] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4acb020cdc4e3fad469821f9128f04 in current term 1: Already voted for candidate 8f246c6bee1d4eb585388786ade7a309 in this term.
I20260709 13:15:25.944698  6708 raft_consensus.cc:515] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.955006  6791 tablet_bootstrap.cc:492] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:25.955641  6791 ts_tablet_manager.cc:1403] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.009s
I20260709 13:15:25.950117  6823 raft_consensus.cc:2804] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.949522  6608 leader_election.cc:304] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:25.959254  6761 leader_election.cc:290] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:25.959391  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b802be150aa45d3af15a06828c9979a" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309" is_pre_election: true
I20260709 13:15:25.960414  6793 tablet_bootstrap.cc:492] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04: No bootstrap required, opened a new log
I20260709 13:15:25.961124  6793 ts_tablet_manager.cc:1403] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.006s
I20260709 13:15:25.957077  6808 leader_election.cc:290] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.960554  6609 leader_election.cc:304] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:25.967799  6761 raft_consensus.cc:2804] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.968631  6761 raft_consensus.cc:697] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:25.969393  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832edd74379340c0a1a63675821534d9" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:25.969542  6761 consensus_queue.cc:237] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.970160  6643 raft_consensus.cc:3060] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:25.970804  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:39943, user_credentials={real_user=slave}} blocked reactor thread for 58386.3us
I20260709 13:15:25.971894  6791 raft_consensus.cc:359] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.972602  6791 raft_consensus.cc:385] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.972939  6791 raft_consensus.cc:740] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.973636  6791 consensus_queue.cc:260] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.965546  6708 leader_election.cc:290] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:25.972419  6827 raft_consensus.cc:2804] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.968030  6389 catalog_manager.cc:5697] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 0 to 1, leader changed from <none> to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 1 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.975118  6827 raft_consensus.cc:493] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.976092  6791 ts_tablet_manager.cc:1434] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:15:25.974710  6642 raft_consensus.cc:2468] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 0.
I20260709 13:15:25.977770  6791 tablet_bootstrap.cc:492] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309: Bootstrap starting.
I20260709 13:15:25.977887  6492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:25.978717  6458 leader_election.cc:304] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: b19a4869870b47ca90ef4294221c224b
I20260709 13:15:25.979882  6808 raft_consensus.cc:2804] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.980270  6808 raft_consensus.cc:493] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.980664  6808 raft_consensus.cc:3060] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.980346  6793 raft_consensus.cc:359] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.981370  6793 raft_consensus.cc:385] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.981748  6793 raft_consensus.cc:740] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.966727  6792 tablet_bootstrap.cc:492] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b: No bootstrap required, opened a new log
I20260709 13:15:25.982503  6792 ts_tablet_manager.cc:1403] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.018s
I20260709 13:15:25.982638  6793 consensus_queue.cc:260] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.984448  6791 tablet_bootstrap.cc:654] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.976712  6827 raft_consensus.cc:3060] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.990641  6492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832edd74379340c0a1a63675821534d9" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:25.990844  6792 raft_consensus.cc:359] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.991748  6792 raft_consensus.cc:385] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.992070  6792 raft_consensus.cc:740] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.993000  6568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:25.993206  6792 consensus_queue.cc:260] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.993885  6568 raft_consensus.cc:2393] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f246c6bee1d4eb585388786ade7a309 in current term 1: Already voted for candidate 2b4acb020cdc4e3fad469821f9128f04 in this term.
I20260709 13:15:25.991990  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135acbefaee24d58a2be915d0a6feef2" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:25.995235  6569 raft_consensus.cc:3060] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.995641  6792 ts_tablet_manager.cc:1434] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:15:25.956736  6823 raft_consensus.cc:493] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.996975  6823 raft_consensus.cc:3060] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.997738  6808 raft_consensus.cc:515] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:25.997839  6827 raft_consensus.cc:515] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.000869  6827 leader_election.cc:290] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:26.001592  6808 leader_election.cc:290] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:26.002873  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b802be150aa45d3af15a06828c9979a" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:26.003594  6642 raft_consensus.cc:3060] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.003785  6643 raft_consensus.cc:2468] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:25.991395  6492 raft_consensus.cc:3060] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.006492  6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4473e66fabe14a439c92324bda1427e8" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:26.007216  6567 raft_consensus.cc:3060] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.009490  6568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b802be150aa45d3af15a06828c9979a" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:26.010264  6568 raft_consensus.cc:3060] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.010452  6793 ts_tablet_manager.cc:1434] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 13:15:26.013625  6569 raft_consensus.cc:2468] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 1.
I20260709 13:15:26.013625  6642 raft_consensus.cc:2468] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:26.017750  6533 leader_election.cc:304] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:26.019400  6826 raft_consensus.cc:2804] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.019888  6826 raft_consensus.cc:697] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:26.020157  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4473e66fabe14a439c92324bda1427e8" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:26.020851  6493 raft_consensus.cc:3060] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.020144  6458 leader_election.cc:304] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:26.029652  6493 raft_consensus.cc:2468] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 1.
I20260709 13:15:26.031476  6389 catalog_manager.cc:5697] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.033205  6609 leader_election.cc:304] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309; no voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b
I20260709 13:15:26.034030  6761 raft_consensus.cc:2749] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.020777  6826 consensus_queue.cc:237] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.036172  6609 leader_election.cc:304] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:26.038142  6761 raft_consensus.cc:2804] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.041332  6492 raft_consensus.cc:2468] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 1.
I20260709 13:15:26.042127  6761 raft_consensus.cc:697] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:26.043138  6761 consensus_queue.cc:237] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.054872  6568 raft_consensus.cc:2468] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 1.
I20260709 13:15:26.059223  6823 raft_consensus.cc:515] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
W20260709 13:15:26.061141  6440 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:26.062217  6567 raft_consensus.cc:2468] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 1.
I20260709 13:15:26.065636  6391 catalog_manager.cc:5697] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 0 to 1, leader changed from <none> to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 1 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.066496  6389 catalog_manager.cc:5697] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.047588  6808 raft_consensus.cc:2804] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.071915  6492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d9e05e5c8d4a2db744d868554d4397" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:26.072063  6808 raft_consensus.cc:697] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:26.072839  6492 raft_consensus.cc:3060] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.069911  6823 leader_election.cc:290] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:26.084641  6390 catalog_manager.cc:5697] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.087311  6492 raft_consensus.cc:2468] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 1.
I20260709 13:15:26.092185  6609 leader_election.cc:304] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:26.097563  6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d9e05e5c8d4a2db744d868554d4397" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:26.098420  6567 raft_consensus.cc:3060] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.073400  6808 consensus_queue.cc:237] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.105245  6567 raft_consensus.cc:2468] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 1.
I20260709 13:15:26.110224  6827 raft_consensus.cc:2804] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.112010  6827 raft_consensus.cc:697] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:26.115360  6827 consensus_queue.cc:237] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.120805  6791 tablet_bootstrap.cc:492] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309: No bootstrap required, opened a new log
I20260709 13:15:26.121421  6791 ts_tablet_manager.cc:1403] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309: Time spent bootstrapping tablet: real 0.144s	user 0.035s	sys 0.021s
I20260709 13:15:26.125811  6791 raft_consensus.cc:359] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.126932  6791 raft_consensus.cc:385] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.127262  6791 raft_consensus.cc:740] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.127002  6390 catalog_manager.cc:5697] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 1 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.128242  6791 consensus_queue.cc:260] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.130867  6791 ts_tablet_manager.cc:1434] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:26.146045  6390 catalog_manager.cc:5697] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 1 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.182453  6808 consensus_queue.cc:1048] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.203279  6811 consensus_queue.cc:1048] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.233264  6811 consensus_queue.cc:1048] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.246717  6808 consensus_queue.cc:1048] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.263887  6642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4473e66fabe14a439c92324bda1427e8"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
mode: GRACEFUL
new_leader_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:60204
I20260709 13:15:26.264489  6642 raft_consensus.cc:606] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Received request to transfer leadership to TS 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:26.273701  6642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21d9e05e5c8d4a2db744d868554d4397"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
mode: GRACEFUL
new_leader_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:60204
I20260709 13:15:26.274222  6642 raft_consensus.cc:606] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Received request to transfer leadership to TS 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:26.279907  6567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
mode: GRACEFUL
new_leader_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:26.280475  6567 raft_consensus.cc:606] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Received request to transfer leadership to TS 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:26.286293  6492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45a318e03384479ea1531150cfbea717"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
mode: GRACEFUL
new_leader_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:42628
I20260709 13:15:26.287010  6492 raft_consensus.cc:606] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Received request to transfer leadership to TS b19a4869870b47ca90ef4294221c224b
I20260709 13:15:26.292598  6642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "135acbefaee24d58a2be915d0a6feef2"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
mode: GRACEFUL
new_leader_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:60204
I20260709 13:15:26.292737  6827 raft_consensus.cc:493] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.293251  6642 raft_consensus.cc:606] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Received request to transfer leadership to TS b19a4869870b47ca90ef4294221c224b
I20260709 13:15:26.293314  6827 raft_consensus.cc:515] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.295341  6827 leader_election.cc:290] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:26.296677  6492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4acb020cdc4e3fad469821f9128f04" is_pre_election: true
I20260709 13:15:26.297688  6492 raft_consensus.cc:2393] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f246c6bee1d4eb585388786ade7a309 in current term 1: Already voted for candidate b19a4869870b47ca90ef4294221c224b in this term.
I20260709 13:15:26.300678  6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19a4869870b47ca90ef4294221c224b" is_pre_election: true
I20260709 13:15:26.301165  6492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b802be150aa45d3af15a06828c9979a"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
mode: GRACEFUL
new_leader_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:42628
I20260709 13:15:26.301832  6492 raft_consensus.cc:606] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Received request to transfer leadership to TS b19a4869870b47ca90ef4294221c224b
I20260709 13:15:26.302593  6608 leader_election.cc:304] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309; no voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b
I20260709 13:15:26.303975  6827 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.310240  6827 raft_consensus.cc:2749] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.314929  6492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fde82c6b12a472b8339d17114123ce5"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
mode: GRACEFUL
new_leader_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:42628
I20260709 13:15:26.315661  6492 raft_consensus.cc:606] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Received request to transfer leadership to TS 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:26.347077  6708 consensus_queue.cc:1048] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.365388  6708 consensus_queue.cc:1048] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.376147  6827 consensus_queue.cc:1048] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.388574  6823 raft_consensus.cc:993] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309: : Instructing follower b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:26.389122  6761 raft_consensus.cc:1081] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Signalling peer b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:26.391238  6708 raft_consensus.cc:993] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b: : Instructing follower 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:26.391758  6708 raft_consensus.cc:1081] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Signalling peer 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:26.392086  6569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "135acbefaee24d58a2be915d0a6feef2"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:40524
I20260709 13:15:26.393600  6569 raft_consensus.cc:493] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.393987  6569 raft_consensus.cc:3060] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.394639  6493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:42614
I20260709 13:15:26.395279  6493 raft_consensus.cc:493] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.395668  6493 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.402694  6827 consensus_queue.cc:1048] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.404352  6493 raft_consensus.cc:515] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.404933  6569 raft_consensus.cc:515] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.409502  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:26.409749  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135acbefaee24d58a2be915d0a6feef2" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:26.410388  6642 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.407361  6567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:26.418061  6567 raft_consensus.cc:3055] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.418517  6567 raft_consensus.cc:740] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:26.417153  6493 leader_election.cc:290] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:26.419647  6567 consensus_queue.cc:260] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.424302  6567 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.426399  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135acbefaee24d58a2be915d0a6feef2" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:26.427173  6643 raft_consensus.cc:3055] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.427523  6643 raft_consensus.cc:740] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:26.428442  6643 consensus_queue.cc:260] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.429670  6643 raft_consensus.cc:3060] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.433188  6642 raft_consensus.cc:2468] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:26.435089  6458 leader_election.cc:304] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:26.436158  6811 raft_consensus.cc:2804] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.436724  6811 raft_consensus.cc:697] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:26.437680  6811 consensus_queue.cc:237] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.438895  6569 leader_election.cc:290] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:26.442322  6567 raft_consensus.cc:2468] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:26.443397  6643 raft_consensus.cc:2468] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:26.444586  6533 leader_election.cc:304] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 2b4acb020cdc4e3fad469821f9128f04
I20260709 13:15:26.445807  6708 raft_consensus.cc:2804] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.446314  6708 raft_consensus.cc:697] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:26.447136  6708 consensus_queue.cc:237] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.457134  6390 catalog_manager.cc:5697] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 1 to 2, leader changed from b19a4869870b47ca90ef4294221c224b (127.26.202.2) to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.466708  6391 catalog_manager.cc:5697] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 1 to 2, leader changed from 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3) to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 2 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.468906  6827 consensus_queue.cc:1048] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.481647  6761 consensus_queue.cc:1048] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.515313  6811 consensus_queue.cc:1048] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.519579  6761 raft_consensus.cc:993] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309: : Instructing follower 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:26.520193  6828 raft_consensus.cc:1081] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Signalling peer 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:26.522089  6493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4473e66fabe14a439c92324bda1427e8"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:42616
I20260709 13:15:26.522711  6493 raft_consensus.cc:493] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.523144  6493 raft_consensus.cc:3060] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.525319  6811 consensus_queue.cc:1048] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.527226  6811 consensus_queue.cc:1048] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.529958  6808 consensus_queue.cc:1048] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.541564  6493 raft_consensus.cc:515] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.544796  6566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4473e66fabe14a439c92324bda1427e8" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:26.545507  6566 raft_consensus.cc:3060] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.555603  6826 consensus_queue.cc:1048] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.556569  6775 raft_consensus.cc:993] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04: : Instructing follower b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:26.557145  6775 raft_consensus.cc:1081] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Signalling peer b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:26.557261  6828 consensus_queue.cc:1048] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.561380  6565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b802be150aa45d3af15a06828c9979a"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:40512
I20260709 13:15:26.561955  6565 raft_consensus.cc:493] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.562398  6565 raft_consensus.cc:3060] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.590469  6708 consensus_queue.cc:1048] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.623576  6808 raft_consensus.cc:993] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04: : Instructing follower b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:26.624241  6808 raft_consensus.cc:1081] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Signalling peer b19a4869870b47ca90ef4294221c224b to start an election
I20260709 13:15:26.630450  6569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45a318e03384479ea1531150cfbea717"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
 from {username='slave'} at 127.0.0.1:40512
I20260709 13:15:26.631086  6569 raft_consensus.cc:493] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.631596  6569 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.632968  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4473e66fabe14a439c92324bda1427e8" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:26.633667  6643 raft_consensus.cc:3055] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.633952  6643 raft_consensus.cc:740] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:26.634768  6643 consensus_queue.cc:260] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.635892  6643 raft_consensus.cc:3060] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.639971  6827 consensus_queue.cc:1048] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.631485  6493 leader_election.cc:290] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:26.648533  6643 raft_consensus.cc:2468] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:26.650408  6458 leader_election.cc:304] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:26.651513  6811 raft_consensus.cc:2804] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.652040  6811 raft_consensus.cc:697] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:26.652853  6811 consensus_queue.cc:237] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.656121  6823 raft_consensus.cc:993] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309: : Instructing follower 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:26.656718  6823 raft_consensus.cc:1081] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Signalling peer 2b4acb020cdc4e3fad469821f9128f04 to start an election
I20260709 13:15:26.658004  6569 raft_consensus.cc:515] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.658725  6493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21d9e05e5c8d4a2db744d868554d4397"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
 from {username='slave'} at 127.0.0.1:42616
I20260709 13:15:26.659427  6568 raft_consensus.cc:1240] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Rejecting Update request from peer 2b4acb020cdc4e3fad469821f9128f04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:26.659528  6493 raft_consensus.cc:493] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.659997  6493 raft_consensus.cc:3060] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.660715  6565 raft_consensus.cc:515] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.663540  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:26.664191  6494 raft_consensus.cc:3055] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.664487  6494 raft_consensus.cc:740] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:26.665287  6494 consensus_queue.cc:260] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.666443  6494 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:26.666494  6811 consensus_queue.cc:1175] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b19a4869870b47ca90ef4294221c224b" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2b4acb020cdc4e3fad469821f9128f04 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:26.674629  6569 leader_election.cc:290] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:26.675750  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:26.676445  6643 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.677520  6493 raft_consensus.cc:515] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.680464  6493 leader_election.cc:290] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Requested vote from peers b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:26.680648  6569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d9e05e5c8d4a2db744d868554d4397" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:26.681330  6569 raft_consensus.cc:3060] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.682751  6641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d9e05e5c8d4a2db744d868554d4397" candidate_uuid: "2b4acb020cdc4e3fad469821f9128f04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:26.683405  6641 raft_consensus.cc:3055] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.683612  6494 raft_consensus.cc:2468] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:26.683766  6641 raft_consensus.cc:740] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:26.684931  6535 leader_election.cc:304] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:26.685946  6826 raft_consensus.cc:2804] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.685734  6641 consensus_queue.cc:260] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.686474  6826 raft_consensus.cc:697] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:26.687147  6641 raft_consensus.cc:3060] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.687335  6826 consensus_queue.cc:237] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.694180  6569 raft_consensus.cc:2468] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:26.696410  6459 leader_election.cc:304] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:26.697363  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b802be150aa45d3af15a06828c9979a" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:26.698058  6493 raft_consensus.cc:3055] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.698508  6493 raft_consensus.cc:740] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:26.699484  6493 consensus_queue.cc:260] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.700640  6493 raft_consensus.cc:3060] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.650699  6566 raft_consensus.cc:2468] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:26.699491  6807 raft_consensus.cc:2804] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.701949  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b802be150aa45d3af15a06828c9979a" candidate_uuid: "b19a4869870b47ca90ef4294221c224b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
I20260709 13:15:26.702381  6807 raft_consensus.cc:697] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:26.702647  6642 raft_consensus.cc:3060] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.703636  6565 leader_election.cc:290] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3:39413)
I20260709 13:15:26.703424  6807 consensus_queue.cc:237] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.708814  6643 raft_consensus.cc:2468] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:26.708621  6390 catalog_manager.cc:5697] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 1 to 2, leader changed from 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3) to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.712339  6642 raft_consensus.cc:2468] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:26.715415  6493 raft_consensus.cc:2468] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b19a4869870b47ca90ef4294221c224b in term 2.
I20260709 13:15:26.715363  6533 leader_election.cc:304] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:26.716691  6860 raft_consensus.cc:2804] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.717620  6860 raft_consensus.cc:697] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Becoming Leader. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:26.718719  6860 consensus_queue.cc:237] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.723148  6641 raft_consensus.cc:2468] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4acb020cdc4e3fad469821f9128f04 in term 2.
I20260709 13:15:26.730334  6389 catalog_manager.cc:5697] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 1 to 2, leader changed from 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1) to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 2 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.742080  6811 raft_consensus.cc:993] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04: : Instructing follower 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:26.742704  6811 raft_consensus.cc:1081] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Signalling peer 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:26.745543  6641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fde82c6b12a472b8339d17114123ce5"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:60190
I20260709 13:15:26.746121  6641 raft_consensus.cc:493] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.746470  6641 raft_consensus.cc:3060] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.752650  6390 catalog_manager.cc:5697] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 reported cstate change: term changed from 1 to 2, leader changed from 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3) to 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1). New cstate: current_term: 2 leader_uuid: "2b4acb020cdc4e3fad469821f9128f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.754200  6641 raft_consensus.cc:515] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.757447  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fde82c6b12a472b8339d17114123ce5" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:26.757515  6565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fde82c6b12a472b8339d17114123ce5" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:26.758225  6493 raft_consensus.cc:3055] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.758276  6565 raft_consensus.cc:3060] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.758739  6493 raft_consensus.cc:740] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:26.759660  6493 consensus_queue.cc:260] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.760897  6493 raft_consensus.cc:3060] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.761212  6641 leader_election.cc:290] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:26.765291  6565 raft_consensus.cc:2468] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 2.
I20260709 13:15:26.767022  6608 leader_election.cc:304] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:26.767972  6828 raft_consensus.cc:2804] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.768610  6828 raft_consensus.cc:697] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 2 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:26.769714  6828 consensus_queue.cc:237] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:26.775823  6493 raft_consensus.cc:2468] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 2.
I20260709 13:15:26.775367  6389 catalog_manager.cc:5697] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b reported cstate change: term changed from 1 to 2, leader changed from 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1) to b19a4869870b47ca90ef4294221c224b (127.26.202.2). New cstate: current_term: 2 leader_uuid: "b19a4869870b47ca90ef4294221c224b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.782337  6390 catalog_manager.cc:5697] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 1 to 2, leader changed from 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1) to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 2 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.840601  6641 raft_consensus.cc:1275] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.842496  6811 consensus_queue.cc:1048] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.853928  6565 raft_consensus.cc:1275] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.861476  6807 consensus_queue.cc:1048] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.885828  6641 raft_consensus.cc:1275] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.888025  6824 consensus_queue.cc:1048] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:26.899600  6493 raft_consensus.cc:3060] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.908785  6493 raft_consensus.cc:1275] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:26.911460  6824 consensus_queue.cc:1048] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:27.129591  6642 raft_consensus.cc:1275] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.131052  6811 consensus_queue.cc:1048] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.131752  6493 raft_consensus.cc:1275] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.133440  6708 consensus_queue.cc:1048] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.147809  6565 raft_consensus.cc:1275] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.152498  6640 raft_consensus.cc:1275] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.153505  6808 consensus_queue.cc:1048] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:27.162751  6824 consensus_queue.cc:1048] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.178850  6565 raft_consensus.cc:1275] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.180327  6828 consensus_queue.cc:1048] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.188138  6493 raft_consensus.cc:1275] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.189898  6828 consensus_queue.cc:1048] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.219271  6493 raft_consensus.cc:1275] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.220948  6824 consensus_queue.cc:1048] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.230578  6640 raft_consensus.cc:1275] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer b19a4869870b47ca90ef4294221c224b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.233109  6826 consensus_queue.cc:1048] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.266767  6640 raft_consensus.cc:1275] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.268170  6811 consensus_queue.cc:1048] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.276525  6565 raft_consensus.cc:1275] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Refusing update from remote peer 2b4acb020cdc4e3fad469821f9128f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.280189  6807 consensus_queue.cc:1048] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.319409  6390 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41606:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:15:29.342386  6390 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41606:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:15:29.396759 27432 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:15:29.450574  6459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.2:39943, user_credentials={real_user=slave}} blocked reactor thread for 51777.2us
I20260709 13:15:29.543013  6914 tablet.cc:1724] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.556007  6917 tablet.cc:1724] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.561945  6533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:39413, user_credentials={real_user=slave}} blocked reactor thread for 51948.9us
W20260709 13:15:29.578035  6595 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:e3b98c4cfe574dcba5d8356367831556)
W20260709 13:15:29.587301  6595 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:e3b98c4cfe574dcba5d8356367831556)
W20260709 13:15:29.598428  6595 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:e3b98c4cfe574dcba5d8356367831556)
I20260709 13:15:29.578773  6919 tablet.cc:1724] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.564857  6910 tablet.cc:1724] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.606532  6920 tablet.cc:1724] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.579723  6911 tablet.cc:1724] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.623549  6903 log.cc:927] Time spent T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:15:29.674808  6917 tablet.cc:1724] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.702360  6939 tablet.cc:1724] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.703176  6458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:39413, user_credentials={real_user=slave}} blocked reactor thread for 136268us
I20260709 13:15:29.706722  6938 tablet.cc:1724] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:29.701082  6535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.1:45277, user_credentials={real_user=slave}} blocked reactor thread for 125209us
I20260709 13:15:29.715866  6914 tablet.cc:1724] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.590757  6913 tablet.cc:1724] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.736272  6914 tablet.cc:1724] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.757510  6941 tablet.cc:1724] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.787482  6920 tablet.cc:1724] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.790354  6911 tablet.cc:1724] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.792685  6942 tablet.cc:1724] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.807116  6937 tablet.cc:1724] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.795264  6910 tablet.cc:1724] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.797781  6917 tablet.cc:1724] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.818985  6939 tablet.cc:1724] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.821132  6568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45a318e03384479ea1531150cfbea717"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
mode: GRACEFUL
new_leader_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:50118
I20260709 13:15:29.821815  6568 raft_consensus.cc:606] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Received request to transfer leadership to TS 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:29.870476  6910 tablet.cc:1724] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.876099  6942 tablet.cc:1724] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.900537  6919 tablet.cc:1724] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.901413  6914 tablet.cc:1724] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.914135  6910 tablet.cc:1724] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.918527  6493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
mode: GRACEFUL
new_leader_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:37772
I20260709 13:15:29.919373  6493 raft_consensus.cc:606] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Received request to transfer leadership to TS 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:29.923163 27432 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:15:29.925712 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:29.937674  6493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd"
dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
mode: GRACEFUL
new_leader_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:37772
I20260709 13:15:29.938280  6493 raft_consensus.cc:606] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Received request to transfer leadership to TS 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:29.946667  6565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0"
dest_uuid: "b19a4869870b47ca90ef4294221c224b"
mode: GRACEFUL
new_leader_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:50118
I20260709 13:15:29.947322  6565 raft_consensus.cc:606] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Received request to transfer leadership to TS 8f246c6bee1d4eb585388786ade7a309
I20260709 13:15:29.948997 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:29.949671 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:29.960853  6942 tablet.cc:1724] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.965770  6939 tablet.cc:1724] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:29.985220  6391 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db: soft_deleted_table [id=2a8a20709bca4e368a4af87caf177a9f] alter complete (version 1)
I20260709 13:15:30.112325  6925 raft_consensus.cc:993] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b: : Instructing follower 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:30.112993  6926 raft_consensus.cc:1081] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Signalling peer 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:30.114799  6639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:15:30.115327  6639 raft_consensus.cc:493] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.115643  6639 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.120980  6639 raft_consensus.cc:515] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.122956  6639 leader_election.cc:290] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 3 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:30.123893  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:30.124198  6565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21c9065cbd94e2dad794e892c8210d0" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:30.124615  6493 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.124989  6565 raft_consensus.cc:3055] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:30.125438  6565 raft_consensus.cc:740] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:30.126391  6565 consensus_queue.cc:260] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.127974  6565 raft_consensus.cc:3060] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.131660  6493 raft_consensus.cc:2468] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 3.
I20260709 13:15:30.132783  6609 leader_election.cc:304] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:30.133734  6923 raft_consensus.cc:2804] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:30.134238  6923 raft_consensus.cc:697] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 3 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:30.135059  6923 consensus_queue.cc:237] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.138079  6565 raft_consensus.cc:2468] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 3.
I20260709 13:15:30.146741  6391 catalog_manager.cc:5697] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 2 to 3, leader changed from b19a4869870b47ca90ef4294221c224b (127.26.202.2) to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.150882  6925 raft_consensus.cc:993] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b: : Instructing follower 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:30.151501  6925 raft_consensus.cc:1081] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Signalling peer 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:30.153584  6639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45a318e03384479ea1531150cfbea717"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:60196
I20260709 13:15:30.154163  6639 raft_consensus.cc:493] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.154533  6639 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.160859  6639 raft_consensus.cc:515] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.162614  6639 leader_election.cc:290] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 3 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:30.163422  6493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:30.163641  6565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a318e03384479ea1531150cfbea717" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:30.164090  6493 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.164263  6565 raft_consensus.cc:3055] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:30.164670  6565 raft_consensus.cc:740] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b19a4869870b47ca90ef4294221c224b, State: Running, Role: LEADER
I20260709 13:15:30.165380  6565 consensus_queue.cc:260] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.166350  6565 raft_consensus.cc:3060] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.169230  6493 raft_consensus.cc:2468] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 3.
I20260709 13:15:30.170413  6609 leader_election.cc:304] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4acb020cdc4e3fad469821f9128f04, 8f246c6bee1d4eb585388786ade7a309; no voters: 
I20260709 13:15:30.171271  6923 raft_consensus.cc:2804] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:30.171828  6923 raft_consensus.cc:697] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 3 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:30.172083  6565 raft_consensus.cc:2468] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 3.
I20260709 13:15:30.172624  6923 consensus_queue.cc:237] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.179909  6391 catalog_manager.cc:5697] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 2 to 3, leader changed from b19a4869870b47ca90ef4294221c224b (127.26.202.2) to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.275504  6927 raft_consensus.cc:993] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04: : Instructing follower 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:30.276201  6889 raft_consensus.cc:1081] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Signalling peer 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:30.277868  6639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:60190
I20260709 13:15:30.278357  6639 raft_consensus.cc:493] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.278671  6639 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.284200  6639 raft_consensus.cc:515] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.287199  6639 leader_election.cc:290] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 3 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:30.287390  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:30.287547  6565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b98c4cfe574dcba5d8356367831556" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:30.288195  6494 raft_consensus.cc:3055] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:30.288239  6565 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.288659  6494 raft_consensus.cc:740] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:30.289618  6494 consensus_queue.cc:260] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.290983  6494 raft_consensus.cc:3060] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.294893  6565 raft_consensus.cc:2468] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 3.
I20260709 13:15:30.296100  6608 leader_election.cc:304] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:30.296638  6494 raft_consensus.cc:2468] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 3.
I20260709 13:15:30.296837  6923 raft_consensus.cc:2804] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:30.297389  6923 raft_consensus.cc:697] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 3 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:30.298187  6923 consensus_queue.cc:237] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.305384  6391 catalog_manager.cc:5697] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 2 to 3, leader changed from 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1) to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.393852  6927 raft_consensus.cc:993] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04: : Instructing follower 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:30.394321  6889 raft_consensus.cc:1081] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Signalling peer 8f246c6bee1d4eb585388786ade7a309 to start an election
I20260709 13:15:30.395869  6639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd"
dest_uuid: "8f246c6bee1d4eb585388786ade7a309"
 from {username='slave'} at 127.0.0.1:60190
I20260709 13:15:30.396435  6639 raft_consensus.cc:493] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.396704  6639 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.401870  6639 raft_consensus.cc:515] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.403666  6639 leader_election.cc:290] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 3 election: Requested vote from peers 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277), b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943)
I20260709 13:15:30.404642  6494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b4acb020cdc4e3fad469821f9128f04"
I20260709 13:15:30.404877  6565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6078cc3c40c64a28b1a0d23ea69108fd" candidate_uuid: "8f246c6bee1d4eb585388786ade7a309" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b19a4869870b47ca90ef4294221c224b"
I20260709 13:15:30.405331  6494 raft_consensus.cc:3055] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:30.405576  6565 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.405763  6494 raft_consensus.cc:740] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4acb020cdc4e3fad469821f9128f04, State: Running, Role: LEADER
I20260709 13:15:30.406562  6494 consensus_queue.cc:260] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.407523  6494 raft_consensus.cc:3060] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.411234  6565 raft_consensus.cc:2468] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 3.
I20260709 13:15:30.412547  6608 leader_election.cc:304] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f246c6bee1d4eb585388786ade7a309, b19a4869870b47ca90ef4294221c224b; no voters: 
I20260709 13:15:30.413388  6935 raft_consensus.cc:2804] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:30.413620  6494 raft_consensus.cc:2468] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f246c6bee1d4eb585388786ade7a309 in term 3.
I20260709 13:15:30.413852  6935 raft_consensus.cc:697] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 3 LEADER]: Becoming Leader. State: Replica: 8f246c6bee1d4eb585388786ade7a309, State: Running, Role: LEADER
I20260709 13:15:30.414923  6935 consensus_queue.cc:237] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } }
I20260709 13:15:30.426275  6391 catalog_manager.cc:5697] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 reported cstate change: term changed from 2 to 3, leader changed from 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1) to 8f246c6bee1d4eb585388786ade7a309 (127.26.202.3). New cstate: current_term: 3 leader_uuid: "8f246c6bee1d4eb585388786ade7a309" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f246c6bee1d4eb585388786ade7a309" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 39413 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.517761  6494 raft_consensus.cc:1275] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:30.519196  6935 consensus_queue.cc:1048] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.529721  6565 raft_consensus.cc:1275] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:30.531417  6956 consensus_queue.cc:1048] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.598275  6494 raft_consensus.cc:1275] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:30.599603  6956 consensus_queue.cc:1048] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.607400  6565 raft_consensus.cc:1275] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:30.609325  6935 consensus_queue.cc:1048] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.753767  6565 raft_consensus.cc:1275] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:30.755312  6935 consensus_queue.cc:1048] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.766408  6494 raft_consensus.cc:1275] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:30.768230  6956 consensus_queue.cc:1048] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.872759  6565 raft_consensus.cc:1275] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:30.874174  6923 consensus_queue.cc:1048] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19a4869870b47ca90ef4294221c224b" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 39943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.885174  6494 raft_consensus.cc:1275] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Refusing update from remote peer 8f246c6bee1d4eb585388786ade7a309: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:30.886631  6923 consensus_queue.cc:1048] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4acb020cdc4e3fad469821f9128f04" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 45277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.021552 27432 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:15:31.026469 27432 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:15:31.026953 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:31.031669 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:15:31.032120 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:32.069994 27432 tablet_server.cc:179] TabletServer@127.26.202.1:0 shutting down...
W20260709 13:15:32.077260  6535 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:15:32.083017  6535 consensus_peers.cc:597] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.109653 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:32.110672 27432 tablet_replica.cc:333] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.111872 27432 raft_consensus.cc:2243] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.112581 27432 raft_consensus.cc:2272] T 832edd74379340c0a1a63675821534d9 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.115443 27432 tablet_replica.cc:333] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.116127 27432 raft_consensus.cc:2243] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.116704 27432 raft_consensus.cc:2272] T 9b802be150aa45d3af15a06828c9979a P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.119396 27432 tablet_replica.cc:333] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.119968 27432 raft_consensus.cc:2243] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.121129 27432 raft_consensus.cc:2272] T 21d9e05e5c8d4a2db744d868554d4397 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.124790 27432 tablet_replica.cc:333] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.125567 27432 raft_consensus.cc:2243] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.126753 27432 raft_consensus.cc:2272] T a30bd813962f4a84b631622d206710f8 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.130211 27432 tablet_replica.cc:333] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.130980 27432 raft_consensus.cc:2243] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.131848 27432 raft_consensus.cc:2272] T 3fde82c6b12a472b8339d17114123ce5 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.134593 27432 tablet_replica.cc:333] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.135251 27432 raft_consensus.cc:2243] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.135936 27432 raft_consensus.cc:2272] T 45a318e03384479ea1531150cfbea717 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.138607 27432 tablet_replica.cc:333] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.139412 27432 raft_consensus.cc:2243] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.140427 27432 raft_consensus.cc:2272] T fd75a1e5fbe445a2a3841270d62c8a6b P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.143410 27432 tablet_replica.cc:333] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.144029 27432 raft_consensus.cc:2243] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.144572 27432 raft_consensus.cc:2272] T 6078cc3c40c64a28b1a0d23ea69108fd P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.147137 27432 tablet_replica.cc:333] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.147753 27432 raft_consensus.cc:2243] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.148293 27432 raft_consensus.cc:2272] T e3b98c4cfe574dcba5d8356367831556 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.150664 27432 tablet_replica.cc:333] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.151275 27432 raft_consensus.cc:2243] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.151901 27432 raft_consensus.cc:2272] T c21c9065cbd94e2dad794e892c8210d0 P 2b4acb020cdc4e3fad469821f9128f04 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.154500 27432 tablet_replica.cc:333] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.155056 27432 raft_consensus.cc:2243] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.156198 27432 raft_consensus.cc:2272] T d57e073710fc4658902ee43a1fa72378 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.158869 27432 tablet_replica.cc:333] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.159440 27432 raft_consensus.cc:2243] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.160012 27432 raft_consensus.cc:2272] T 7f213fecb16e4b27896f7d09f642647c P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.163293 27432 tablet_replica.cc:333] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.163887 27432 raft_consensus.cc:2243] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.165164 27432 raft_consensus.cc:2272] T 8d6286e3a4db45049a75e4887579e688 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:32.166105  6609 consensus_peers.cc:597] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.168126 27432 tablet_replica.cc:333] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.168906 27432 raft_consensus.cc:2243] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.169504 27432 raft_consensus.cc:2272] T 8ea10ed64a394b9b817b16ff98f9e4fd P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.172864 27432 tablet_replica.cc:333] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.173489 27432 raft_consensus.cc:2243] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.174854 27432 raft_consensus.cc:2272] T 4473e66fabe14a439c92324bda1427e8 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:32.175030  6609 consensus_peers.cc:597] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.179199 27432 tablet_replica.cc:333] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.180228 27432 raft_consensus.cc:2243] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.180936 27432 raft_consensus.cc:2272] T cd95a2403523421f99ae03f6ad413951 P 2b4acb020cdc4e3fad469821f9128f04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.185253 27432 tablet_replica.cc:333] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.186120 27432 raft_consensus.cc:2243] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.187137 27432 raft_consensus.cc:2272] T 135acbefaee24d58a2be915d0a6feef2 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.191063 27432 tablet_replica.cc:333] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04: stopping tablet replica
I20260709 13:15:32.191841 27432 raft_consensus.cc:2243] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.192663 27432 raft_consensus.cc:2272] T 92bf03ad93694d5989574a672f2069c4 P 2b4acb020cdc4e3fad469821f9128f04 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:32.214036  6609 consensus_peers.cc:597] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:32.236936  6460 connection.cc:466] server connection from 127.0.0.1:42614 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42614 (request call id 171) could send its response
W20260709 13:15:32.238214  6535 consensus_peers.cc:597] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:32.238842  6535 consensus_peers.cc:597] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.252832 27432 tablet_server.cc:196] TabletServer@127.26.202.1:0 shutdown complete.
W20260709 13:15:32.301623  6609 consensus_peers.cc:597] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:45277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.302426 27432 tablet_server.cc:179] TabletServer@127.26.202.2:0 shutting down...
W20260709 13:15:32.308019  6608 consensus_peers.cc:597] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 -> Peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Couldn't send request to peer b19a4869870b47ca90ef4294221c224b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:32.317605  6609 consensus_peers.cc:597] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:45277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.340651 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:32.341863 27432 tablet_replica.cc:333] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.343083 27432 raft_consensus.cc:2243] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.344076 27432 raft_consensus.cc:2272] T 9b802be150aa45d3af15a06828c9979a P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.347661 27432 tablet_replica.cc:333] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.348845 27432 raft_consensus.cc:2243] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.349701 27432 raft_consensus.cc:2272] T 21d9e05e5c8d4a2db744d868554d4397 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.353505 27432 tablet_replica.cc:333] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.354089 27432 raft_consensus.cc:2243] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.355013 27432 raft_consensus.cc:2272] T 832edd74379340c0a1a63675821534d9 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.357409 27432 tablet_replica.cc:333] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.357937 27432 raft_consensus.cc:2243] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.358407 27432 raft_consensus.cc:2272] T a30bd813962f4a84b631622d206710f8 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.361075 27432 tablet_replica.cc:333] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.362000 27432 raft_consensus.cc:2243] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.362834 27432 raft_consensus.cc:2272] T 3fde82c6b12a472b8339d17114123ce5 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:32.364089  6608 consensus_peers.cc:597] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 -> Peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Couldn't send request to peer b19a4869870b47ca90ef4294221c224b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.365661 27432 tablet_replica.cc:333] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.366492 27432 raft_consensus.cc:2243] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.367128 27432 raft_consensus.cc:2272] T e3b98c4cfe574dcba5d8356367831556 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.370492 27432 tablet_replica.cc:333] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.371423 27432 raft_consensus.cc:2243] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.372030 27432 raft_consensus.cc:2272] T c21c9065cbd94e2dad794e892c8210d0 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.374841 27432 tablet_replica.cc:333] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.375444 27432 raft_consensus.cc:2243] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.375955 27432 raft_consensus.cc:2272] T 45a318e03384479ea1531150cfbea717 P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.378510 27432 tablet_replica.cc:333] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.379101 27432 raft_consensus.cc:2243] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.379673 27432 raft_consensus.cc:2272] T 6078cc3c40c64a28b1a0d23ea69108fd P b19a4869870b47ca90ef4294221c224b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.382170 27432 tablet_replica.cc:333] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.382771 27432 raft_consensus.cc:2243] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.383381 27432 raft_consensus.cc:2272] T fd75a1e5fbe445a2a3841270d62c8a6b P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.385972 27432 tablet_replica.cc:333] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.386907 27432 raft_consensus.cc:2243] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.387550 27432 raft_consensus.cc:2272] T d57e073710fc4658902ee43a1fa72378 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.390193 27432 tablet_replica.cc:333] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.390776 27432 raft_consensus.cc:2243] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.391270 27432 raft_consensus.cc:2272] T 8d6286e3a4db45049a75e4887579e688 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.394232 27432 tablet_replica.cc:333] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.394834 27432 raft_consensus.cc:2243] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.395838 27432 raft_consensus.cc:2272] T 7f213fecb16e4b27896f7d09f642647c P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.398506 27432 tablet_replica.cc:333] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.399080 27432 raft_consensus.cc:2243] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.399602 27432 raft_consensus.cc:2272] T 8ea10ed64a394b9b817b16ff98f9e4fd P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.402153 27432 tablet_replica.cc:333] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.402726 27432 raft_consensus.cc:2243] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.403338 27432 raft_consensus.cc:2272] T 4473e66fabe14a439c92324bda1427e8 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.405874 27432 tablet_replica.cc:333] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.406419 27432 raft_consensus.cc:2243] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.407404 27432 raft_consensus.cc:2272] T cd95a2403523421f99ae03f6ad413951 P b19a4869870b47ca90ef4294221c224b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.410693 27432 tablet_replica.cc:333] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.411207 27432 raft_consensus.cc:2243] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.412299 27432 raft_consensus.cc:2272] T 135acbefaee24d58a2be915d0a6feef2 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.414915 27432 tablet_replica.cc:333] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b: stopping tablet replica
I20260709 13:15:32.415470 27432 raft_consensus.cc:2243] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.416399 27432 raft_consensus.cc:2272] T 92bf03ad93694d5989574a672f2069c4 P b19a4869870b47ca90ef4294221c224b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:32.463655  6608 consensus_peers.cc:597] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 -> Peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Couldn't send request to peer b19a4869870b47ca90ef4294221c224b. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.482460 27432 tablet_server.cc:196] TabletServer@127.26.202.2:0 shutdown complete.
W20260709 13:15:32.486685  6608 consensus_peers.cc:597] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 -> Peer b19a4869870b47ca90ef4294221c224b (127.26.202.2:39943): Couldn't send request to peer b19a4869870b47ca90ef4294221c224b. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:39943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:32.492301  6609 consensus_peers.cc:597] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 -> Peer 2b4acb020cdc4e3fad469821f9128f04 (127.26.202.1:45277): Couldn't send request to peer 2b4acb020cdc4e3fad469821f9128f04. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:45277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:32.529438 27432 tablet_server.cc:179] TabletServer@127.26.202.3:0 shutting down...
I20260709 13:15:32.569639 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:32.570541 27432 tablet_replica.cc:333] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.571429 27432 raft_consensus.cc:2243] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.572057 27432 raft_consensus.cc:2272] T 9b802be150aa45d3af15a06828c9979a P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.574633 27432 tablet_replica.cc:333] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.575270 27432 raft_consensus.cc:2243] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.575836 27432 raft_consensus.cc:2272] T 832edd74379340c0a1a63675821534d9 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.578285 27432 tablet_replica.cc:333] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.578879 27432 raft_consensus.cc:2243] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.579421 27432 raft_consensus.cc:2272] T 21d9e05e5c8d4a2db744d868554d4397 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.581635 27432 tablet_replica.cc:333] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.582213 27432 raft_consensus.cc:2243] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.583204 27432 raft_consensus.cc:2272] T 3fde82c6b12a472b8339d17114123ce5 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.585582 27432 tablet_replica.cc:333] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.586328 27432 raft_consensus.cc:2243] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.586846 27432 raft_consensus.cc:2272] T a30bd813962f4a84b631622d206710f8 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.589193 27432 tablet_replica.cc:333] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.589804 27432 raft_consensus.cc:2243] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.590920 27432 raft_consensus.cc:2272] T e3b98c4cfe574dcba5d8356367831556 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.594082 27432 tablet_replica.cc:333] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.594938 27432 raft_consensus.cc:2243] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.595943 27432 raft_consensus.cc:2272] T c21c9065cbd94e2dad794e892c8210d0 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.598627 27432 tablet_replica.cc:333] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.599291 27432 raft_consensus.cc:2243] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.599803 27432 raft_consensus.cc:2272] T 92bf03ad93694d5989574a672f2069c4 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.602340 27432 tablet_replica.cc:333] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.602962 27432 raft_consensus.cc:2243] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.603542 27432 raft_consensus.cc:2272] T 135acbefaee24d58a2be915d0a6feef2 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.606262 27432 tablet_replica.cc:333] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.606860 27432 raft_consensus.cc:2243] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.607388 27432 raft_consensus.cc:2272] T 8d6286e3a4db45049a75e4887579e688 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.609836 27432 tablet_replica.cc:333] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.610400 27432 raft_consensus.cc:2243] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.610867 27432 raft_consensus.cc:2272] T 7f213fecb16e4b27896f7d09f642647c P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.613611 27432 tablet_replica.cc:333] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.614390 27432 raft_consensus.cc:2243] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.615470 27432 raft_consensus.cc:2272] T 8ea10ed64a394b9b817b16ff98f9e4fd P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.618079 27432 tablet_replica.cc:333] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.618734 27432 raft_consensus.cc:2243] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.619313 27432 raft_consensus.cc:2272] T 4473e66fabe14a439c92324bda1427e8 P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.621927 27432 tablet_replica.cc:333] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.622611 27432 raft_consensus.cc:2243] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.623129 27432 raft_consensus.cc:2272] T cd95a2403523421f99ae03f6ad413951 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.625635 27432 tablet_replica.cc:333] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.626278 27432 raft_consensus.cc:2243] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.627262 27432 raft_consensus.cc:2272] T 45a318e03384479ea1531150cfbea717 P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.629432 27432 tablet_replica.cc:333] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.630015 27432 raft_consensus.cc:2243] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.630988 27432 raft_consensus.cc:2272] T 6078cc3c40c64a28b1a0d23ea69108fd P 8f246c6bee1d4eb585388786ade7a309 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.633287 27432 tablet_replica.cc:333] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.633827 27432 raft_consensus.cc:2243] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.634387 27432 raft_consensus.cc:2272] T fd75a1e5fbe445a2a3841270d62c8a6b P 8f246c6bee1d4eb585388786ade7a309 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.636708 27432 tablet_replica.cc:333] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309: stopping tablet replica
I20260709 13:15:32.637270 27432 raft_consensus.cc:2243] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.637756 27432 raft_consensus.cc:2272] T d57e073710fc4658902ee43a1fa72378 P 8f246c6bee1d4eb585388786ade7a309 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.686546 27432 tablet_server.cc:196] TabletServer@127.26.202.3:0 shutdown complete.
I20260709 13:15:32.772912 27432 master.cc:562] Master@127.26.202.62:41675 shutting down...
I20260709 13:15:32.803403 27432 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:32.804195 27432 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.804597 27432 tablet_replica.cc:333] T 00000000000000000000000000000000 P 13858a8fb3e54a45a8957f3ee81126db: stopping tablet replica
W20260709 13:15:33.763549  6423 debug-util.cc:398] Leaking SignalData structure 0x7b0800085ae0 after lost signal to thread 27435
W20260709 13:15:33.825598 27432 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6423)
W20260709 13:15:34.826198 27432 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 6423)
W20260709 13:15:35.826656 27432 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 6423)
I20260709 13:15:35.971769 27432 master.cc:584] Master@127.26.202.62:41675 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (16153 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:15:36.031232 27432 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.202.62:45955
I20260709 13:15:36.032361 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:36.038484  6973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:36.038915  6972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:36.039161  6975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:36.039963 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:36.040969 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:36.041239 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:36.041420 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602936041408 us; error 0 us; skew 500 ppm
I20260709 13:15:36.041931 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:36.044577 27432 webserver.cc:533] Webserver started at http://127.26.202.62:33313/ using document root <none> and password file <none>
I20260709 13:15:36.045210 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:36.045396 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:36.045698 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:36.046864 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/master-0-root/instance:
uuid: "21d60a52cd0042fa960a68a28ad137d0"
format_stamp: "Formatted at 2026-07-09 13:15:36 on dist-test-slave-008w"
I20260709 13:15:36.051779 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:36.055253  6980 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.056166 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:36.056478 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/master-0-root
uuid: "21d60a52cd0042fa960a68a28ad137d0"
format_stamp: "Formatted at 2026-07-09 13:15:36 on dist-test-slave-008w"
I20260709 13:15:36.056777 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:36.074314 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:36.075553 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:36.115819 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.62:45955
I20260709 13:15:36.115940  7031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.62:45955 every 8 connection(s)
I20260709 13:15:36.119954  7032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.144614  7032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0: Bootstrap starting.
I20260709 13:15:36.150853  7032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.157338  7032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0: No bootstrap required, opened a new log
I20260709 13:15:36.159984  7032 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d60a52cd0042fa960a68a28ad137d0" member_type: VOTER }
I20260709 13:15:36.160434  7032 raft_consensus.cc:385] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.160640  7032 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d60a52cd0042fa960a68a28ad137d0, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.161264  7032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d60a52cd0042fa960a68a28ad137d0" member_type: VOTER }
I20260709 13:15:36.161713  7032 raft_consensus.cc:399] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:36.161918  7032 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:36.162144  7032 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.167065  7032 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d60a52cd0042fa960a68a28ad137d0" member_type: VOTER }
I20260709 13:15:36.167564  7032 leader_election.cc:304] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21d60a52cd0042fa960a68a28ad137d0; no voters: 
I20260709 13:15:36.168753  7032 leader_election.cc:290] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:36.169121  7035 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.170506  7035 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 1 LEADER]: Becoming Leader. State: Replica: 21d60a52cd0042fa960a68a28ad137d0, State: Running, Role: LEADER
I20260709 13:15:36.171149  7035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d60a52cd0042fa960a68a28ad137d0" member_type: VOTER }
I20260709 13:15:36.171857  7032 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:36.176288  7036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21d60a52cd0042fa960a68a28ad137d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d60a52cd0042fa960a68a28ad137d0" member_type: VOTER } }
I20260709 13:15:36.177304  7037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21d60a52cd0042fa960a68a28ad137d0. Latest consensus state: current_term: 1 leader_uuid: "21d60a52cd0042fa960a68a28ad137d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21d60a52cd0042fa960a68a28ad137d0" member_type: VOTER } }
I20260709 13:15:36.177284  7036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:36.178000  7037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:36.180408  7044 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:36.187354  7044 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:36.188483 27432 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:36.197075  7044 catalog_manager.cc:1383] Generated new cluster ID: 437d422c1de94c01ba5273bab3aef9e7
I20260709 13:15:36.197398  7044 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:36.211158  7044 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:36.212577  7044 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:36.226565  7044 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0: Generated new TSK 0
I20260709 13:15:36.227197  7044 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:36.255502 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:36.261997  7053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:36.263085  7054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:36.265410  7056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:36.265529 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:36.267602 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:36.267832 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:36.267994 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602936267976 us; error 0 us; skew 500 ppm
I20260709 13:15:36.268574 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:36.270925 27432 webserver.cc:533] Webserver started at http://127.26.202.1:36615/ using document root <none> and password file <none>
I20260709 13:15:36.271405 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:36.271615 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:36.271896 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:36.273171 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-0-root/instance:
uuid: "e43bc14318064a41861c1d052983ad2e"
format_stamp: "Formatted at 2026-07-09 13:15:36 on dist-test-slave-008w"
I20260709 13:15:36.277912 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:15:36.281555  7061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.282421 27432 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:15:36.282733 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-0-root
uuid: "e43bc14318064a41861c1d052983ad2e"
format_stamp: "Formatted at 2026-07-09 13:15:36 on dist-test-slave-008w"
I20260709 13:15:36.283023 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:36.299757 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:36.301187 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:36.302866 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:36.305467 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:36.305716 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.305972 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:36.306177 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.352351 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.1:36959
I20260709 13:15:36.352573  7123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.1:36959 every 8 connection(s)
I20260709 13:15:36.358292 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:36.367445  7128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:36.369786  7129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:36.371963  7131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:36.373792 27432 server_base.cc:1061] running on GCE node
I20260709 13:15:36.375180  7124 heartbeater.cc:344] Connected to a master server at 127.26.202.62:45955
I20260709 13:15:36.375406 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:36.375667  7124 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:36.375797 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:36.376151 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602936376131 us; error 0 us; skew 500 ppm
I20260709 13:15:36.376643  7124 heartbeater.cc:507] Master 127.26.202.62:45955 requested a full tablet report, sending...
I20260709 13:15:36.376827 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:36.379114  6997 ts_manager.cc:194] Registered new tserver with Master: e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959)
I20260709 13:15:36.380088 27432 webserver.cc:533] Webserver started at http://127.26.202.2:36809/ using document root <none> and password file <none>
I20260709 13:15:36.380743 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:36.380977 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:36.381372 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:36.381363  6997 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34572
I20260709 13:15:36.383126 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-1-root/instance:
uuid: "74ce1c22402c4b91844372d1b9ba67b3"
format_stamp: "Formatted at 2026-07-09 13:15:36 on dist-test-slave-008w"
I20260709 13:15:36.388442 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:36.392554  7136 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.393396 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:15:36.393841 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-1-root
uuid: "74ce1c22402c4b91844372d1b9ba67b3"
format_stamp: "Formatted at 2026-07-09 13:15:36 on dist-test-slave-008w"
I20260709 13:15:36.394181 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:36.430291 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:36.431507 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:36.433100 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:36.435490 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:36.435765 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.436084 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:36.436326 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.482795 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.2:45387
I20260709 13:15:36.482894  7198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.2:45387 every 8 connection(s)
I20260709 13:15:36.488210 27432 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:36.496641  7202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:36.498018  7203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:36.501641 27432 server_base.cc:1061] running on GCE node
W20260709 13:15:36.502529  7206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:36.502725  7199 heartbeater.cc:344] Connected to a master server at 127.26.202.62:45955
I20260709 13:15:36.503387  7199 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:36.503861 27432 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:36.504180 27432 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:36.504390 27432 hybrid_clock.cc:648] HybridClock initialized: now 1783602936504371 us; error 0 us; skew 500 ppm
I20260709 13:15:36.504421  7199 heartbeater.cc:507] Master 127.26.202.62:45955 requested a full tablet report, sending...
I20260709 13:15:36.505327 27432 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:36.507001  6997 ts_manager.cc:194] Registered new tserver with Master: 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:36.508296 27432 webserver.cc:533] Webserver started at http://127.26.202.3:33361/ using document root <none> and password file <none>
I20260709 13:15:36.509117 27432 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:36.508962  6997 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34586
I20260709 13:15:36.509610 27432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:36.510011 27432 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:36.511409 27432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-2-root/instance:
uuid: "14c4cd7930244b0fb0af262aba6bedba"
format_stamp: "Formatted at 2026-07-09 13:15:36 on dist-test-slave-008w"
I20260709 13:15:36.516331 27432 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:36.520453  7210 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.521464 27432 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:36.521754 27432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-2-root
uuid: "14c4cd7930244b0fb0af262aba6bedba"
format_stamp: "Formatted at 2026-07-09 13:15:36 on dist-test-slave-008w"
I20260709 13:15:36.522117 27432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_ceXnh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602600408833-27432-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:36.551503 27432 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:36.552708 27432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:36.554246 27432 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:36.556676 27432 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:36.556936 27432 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.557214 27432 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:36.557392 27432 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:36.602224 27432 rpc_server.cc:307] RPC server started. Bound to: 127.26.202.3:44961
I20260709 13:15:36.602304  7272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.202.3:44961 every 8 connection(s)
I20260709 13:15:36.617292  7273 heartbeater.cc:344] Connected to a master server at 127.26.202.62:45955
I20260709 13:15:36.617695  7273 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:36.618553  7273 heartbeater.cc:507] Master 127.26.202.62:45955 requested a full tablet report, sending...
I20260709 13:15:36.620824  6997 ts_manager.cc:194] Registered new tserver with Master: 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:36.621063 27432 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015650112s
I20260709 13:15:36.622766  6997 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34596
I20260709 13:15:36.650604  6997 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34608:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:36.653821  6997 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:36.728891  7089 tablet_service.cc:1511] Processing CreateTablet for tablet 69f955f19cbc40f7a28d0309253d013d (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:36.730504  7089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f955f19cbc40f7a28d0309253d013d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.734499  7088 tablet_service.cc:1511] Processing CreateTablet for tablet dfea64d5bd1e4237a3c3910a02e7532e (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:36.735965  7088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea64d5bd1e4237a3c3910a02e7532e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.738729  7087 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6e4f758e694e1281a8cd953df6ac6f (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:36.740283  7087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6e4f758e694e1281a8cd953df6ac6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.747004  7238 tablet_service.cc:1511] Processing CreateTablet for tablet 69f955f19cbc40f7a28d0309253d013d (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:36.748000  7086 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d22f892c8479db58f0fb5cc09cc07 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:36.748567  7238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f955f19cbc40f7a28d0309253d013d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.749457  7086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d22f892c8479db58f0fb5cc09cc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.754232  7085 tablet_service.cc:1511] Processing CreateTablet for tablet 9c7374b52bef457387ca7baaaeb0c05d (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:36.755663  7085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c7374b52bef457387ca7baaaeb0c05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.758757  7237 tablet_service.cc:1511] Processing CreateTablet for tablet dfea64d5bd1e4237a3c3910a02e7532e (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:36.760231  7237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea64d5bd1e4237a3c3910a02e7532e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.760353  7084 tablet_service.cc:1511] Processing CreateTablet for tablet e28722f0fff74de380cfc72c6ffe04e4 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:36.761801  7084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28722f0fff74de380cfc72c6ffe04e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.766414  7083 tablet_service.cc:1511] Processing CreateTablet for tablet 72d4ae8c7a0d4fcd8772e0507f3cbf33 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:36.767927  7083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d4ae8c7a0d4fcd8772e0507f3cbf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.770805  7082 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa8aa2a6d2a4932933904a51ae6b0e2 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:36.772248  7082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa8aa2a6d2a4932933904a51ae6b0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.772528  7235 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d22f892c8479db58f0fb5cc09cc07 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:36.774085  7235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d22f892c8479db58f0fb5cc09cc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.770817  7236 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6e4f758e694e1281a8cd953df6ac6f (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:36.775748  7236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6e4f758e694e1281a8cd953df6ac6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.783284  7081 tablet_service.cc:1511] Processing CreateTablet for tablet c652b53f69344c3da288ee8f6da3a147 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:36.783419  7234 tablet_service.cc:1511] Processing CreateTablet for tablet 9c7374b52bef457387ca7baaaeb0c05d (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:36.784821  7081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c652b53f69344c3da288ee8f6da3a147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.785689  7234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c7374b52bef457387ca7baaaeb0c05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.788344  7289 tablet_bootstrap.cc:492] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:36.797757  7289 tablet_bootstrap.cc:654] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.802155  7233 tablet_service.cc:1511] Processing CreateTablet for tablet e28722f0fff74de380cfc72c6ffe04e4 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:36.804230  7233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28722f0fff74de380cfc72c6ffe04e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.818691  7232 tablet_service.cc:1511] Processing CreateTablet for tablet 72d4ae8c7a0d4fcd8772e0507f3cbf33 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:36.820899  7232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d4ae8c7a0d4fcd8772e0507f3cbf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.831172  7231 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa8aa2a6d2a4932933904a51ae6b0e2 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:36.832727  7231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa8aa2a6d2a4932933904a51ae6b0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.838233  7230 tablet_service.cc:1511] Processing CreateTablet for tablet c652b53f69344c3da288ee8f6da3a147 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:36.839726  7230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c652b53f69344c3da288ee8f6da3a147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.874215  7163 tablet_service.cc:1511] Processing CreateTablet for tablet dfea64d5bd1e4237a3c3910a02e7532e (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:36.876191  7163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfea64d5bd1e4237a3c3910a02e7532e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.878273  7162 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6e4f758e694e1281a8cd953df6ac6f (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:36.879961  7162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6e4f758e694e1281a8cd953df6ac6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.876984  7164 tablet_service.cc:1511] Processing CreateTablet for tablet 69f955f19cbc40f7a28d0309253d013d (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:36.882578  7161 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d22f892c8479db58f0fb5cc09cc07 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:36.880304  7156 tablet_service.cc:1511] Processing CreateTablet for tablet c652b53f69344c3da288ee8f6da3a147 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:36.886315  7158 tablet_service.cc:1511] Processing CreateTablet for tablet 72d4ae8c7a0d4fcd8772e0507f3cbf33 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:36.889899  7157 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa8aa2a6d2a4932933904a51ae6b0e2 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:36.893335  7159 tablet_service.cc:1511] Processing CreateTablet for tablet e28722f0fff74de380cfc72c6ffe04e4 (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:36.896570  7160 tablet_service.cc:1511] Processing CreateTablet for tablet 9c7374b52bef457387ca7baaaeb0c05d (DEFAULT_TABLE table=test-workload [id=9341046093da46dead58567cbee4a85e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:36.883108  7164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69f955f19cbc40f7a28d0309253d013d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.902074  7160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c7374b52bef457387ca7baaaeb0c05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.905273  7161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d22f892c8479db58f0fb5cc09cc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.905977  7157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa8aa2a6d2a4932933904a51ae6b0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.909408  7158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d4ae8c7a0d4fcd8772e0507f3cbf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.914393  7159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28722f0fff74de380cfc72c6ffe04e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.917538  7156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c652b53f69344c3da288ee8f6da3a147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:36.939510  7291 tablet_bootstrap.cc:492] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:36.961333  7291 tablet_bootstrap.cc:654] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:37.081210  6984 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.202.3:44961, user_credentials={real_user=slave}} blocked reactor thread for 72221.2us
I20260709 13:15:37.086052  7291 tablet_bootstrap.cc:492] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.086232  7289 tablet_bootstrap.cc:492] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.086688  7291 ts_tablet_manager.cc:1403] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.035s
I20260709 13:15:37.086980  7289 ts_tablet_manager.cc:1403] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.299s	user 0.070s	sys 0.094s
I20260709 13:15:37.090345  7291 raft_consensus.cc:359] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.090582  7289 raft_consensus.cc:359] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.091216  7291 raft_consensus.cc:385] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.091405  7289 raft_consensus.cc:385] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.091610  7291 raft_consensus.cc:740] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.091761  7289 raft_consensus.cc:740] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.092515  7291 consensus_queue.cc:260] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.092599  7289 consensus_queue.cc:260] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.107910  7288 tablet_bootstrap.cc:492] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.126045  7288 tablet_bootstrap.cc:654] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.139899  7288 tablet_bootstrap.cc:492] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.141340  7288 ts_tablet_manager.cc:1403] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.014s
I20260709 13:15:37.143388  7291 ts_tablet_manager.cc:1434] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.056s	user 0.024s	sys 0.029s
I20260709 13:15:37.144476  7124 heartbeater.cc:499] Master 127.26.202.62:45955 was elected leader, sending a full tablet report...
I20260709 13:15:37.144788  7199 heartbeater.cc:499] Master 127.26.202.62:45955 was elected leader, sending a full tablet report...
I20260709 13:15:37.145380  7291 tablet_bootstrap.cc:492] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:37.149791  7289 ts_tablet_manager.cc:1434] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.062s	user 0.031s	sys 0.022s
I20260709 13:15:37.151060  7289 tablet_bootstrap.cc:492] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:37.150804  7288 raft_consensus.cc:359] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.151693  7288 raft_consensus.cc:385] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.152014  7288 raft_consensus.cc:740] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.152391  7291 tablet_bootstrap.cc:654] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.152947  7288 consensus_queue.cc:260] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.159778  7289 tablet_bootstrap.cc:654] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.162165  7291 tablet_bootstrap.cc:492] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.162860  7291 ts_tablet_manager.cc:1403] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 13:15:37.167136  7291 raft_consensus.cc:359] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.169924  7273 heartbeater.cc:499] Master 127.26.202.62:45955 was elected leader, sending a full tablet report...
I20260709 13:15:37.171027  7291 raft_consensus.cc:385] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.171571  7291 raft_consensus.cc:740] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.172761  7291 consensus_queue.cc:260] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.175520  7291 ts_tablet_manager.cc:1434] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:37.176975  7291 tablet_bootstrap.cc:492] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:37.180263  7289 tablet_bootstrap.cc:492] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.180950  7289 ts_tablet_manager.cc:1403] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.009s
W20260709 13:15:37.183108  7045 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:37.170159  7288 ts_tablet_manager.cc:1434] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.009s
I20260709 13:15:37.184861  7291 tablet_bootstrap.cc:654] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.184549  7289 raft_consensus.cc:359] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.185897  7289 raft_consensus.cc:385] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.186086  7288 tablet_bootstrap.cc:492] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.186331  7289 raft_consensus.cc:740] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.187446  7289 consensus_queue.cc:260] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.190488  7289 ts_tablet_manager.cc:1434] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:15:37.191311  7291 tablet_bootstrap.cc:492] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.191569  7289 tablet_bootstrap.cc:492] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:37.191955  7291 ts_tablet_manager.cc:1403] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:15:37.194335  7288 tablet_bootstrap.cc:654] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.195922  7291 raft_consensus.cc:359] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.196938  7291 raft_consensus.cc:385] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.197304  7291 raft_consensus.cc:740] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.198405  7291 consensus_queue.cc:260] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.200806  7289 tablet_bootstrap.cc:654] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.204702  7291 ts_tablet_manager.cc:1434] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:15:37.206712  7291 tablet_bootstrap.cc:492] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:37.217860  7291 tablet_bootstrap.cc:654] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.224725  7289 tablet_bootstrap.cc:492] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.225443  7289 ts_tablet_manager.cc:1403] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.016s
I20260709 13:15:37.225523  7291 tablet_bootstrap.cc:492] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.226248  7291 ts_tablet_manager.cc:1403] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:15:37.229218  7289 raft_consensus.cc:359] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.229665  7291 raft_consensus.cc:359] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.230162  7289 raft_consensus.cc:385] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.230400  7291 raft_consensus.cc:385] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.230611  7289 raft_consensus.cc:740] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.230744  7291 raft_consensus.cc:740] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.231771  7289 consensus_queue.cc:260] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.231770  7291 consensus_queue.cc:260] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.236193  7291 ts_tablet_manager.cc:1434] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:37.236537  7289 ts_tablet_manager.cc:1434] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:15:37.237464  7291 tablet_bootstrap.cc:492] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:37.237531  7289 tablet_bootstrap.cc:492] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
W20260709 13:15:37.238385  7200 tablet.cc:2406] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:37.245662  7289 tablet_bootstrap.cc:654] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.248277  7291 tablet_bootstrap.cc:654] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.258565  7289 tablet_bootstrap.cc:492] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.259678  7289 ts_tablet_manager.cc:1403] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.010s
I20260709 13:15:37.262399  7289 raft_consensus.cc:359] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.263113  7289 raft_consensus.cc:385] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.263363  7289 raft_consensus.cc:740] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.264145  7289 consensus_queue.cc:260] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.266409  7289 ts_tablet_manager.cc:1434] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:37.267474  7289 tablet_bootstrap.cc:492] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:37.274219  7289 tablet_bootstrap.cc:654] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.275756  7291 tablet_bootstrap.cc:492] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.276746  7291 ts_tablet_manager.cc:1403] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.012s
I20260709 13:15:37.281236  7291 raft_consensus.cc:359] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.283895  7291 raft_consensus.cc:385] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.284081  7293 raft_consensus.cc:493] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.284621  7288 tablet_bootstrap.cc:492] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.284458  7291 raft_consensus.cc:740] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.284819  7293 raft_consensus.cc:515] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.285382  7288 ts_tablet_manager.cc:1403] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.100s	user 0.030s	sys 0.061s
I20260709 13:15:37.286265  7289 tablet_bootstrap.cc:492] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.285964  7291 consensus_queue.cc:260] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.286808  7289 ts_tablet_manager.cc:1403] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.012s
I20260709 13:15:37.288820  7288 raft_consensus.cc:359] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.289987  7288 raft_consensus.cc:385] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.290390  7288 raft_consensus.cc:740] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.291203  7289 raft_consensus.cc:359] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.291452  7288 consensus_queue.cc:260] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.292364  7289 raft_consensus.cc:385] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.292853  7289 raft_consensus.cc:740] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.293947  7289 consensus_queue.cc:260] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.300138  7289 ts_tablet_manager.cc:1434] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:15:37.301707  7289 tablet_bootstrap.cc:492] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:37.302543  7288 ts_tablet_manager.cc:1434] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:15:37.303977  7288 tablet_bootstrap.cc:492] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.308925  7293 leader_election.cc:290] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.310106  7306 raft_consensus.cc:493] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.310716  7306 raft_consensus.cc:515] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.311652  7291 ts_tablet_manager.cc:1434] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.034s	user 0.022s	sys 0.009s
I20260709 13:15:37.313787  7306 leader_election.cc:290] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.316651  7291 tablet_bootstrap.cc:492] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:37.316900  7289 tablet_bootstrap.cc:654] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.317049  7288 tablet_bootstrap.cc:654] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.328262  7291 tablet_bootstrap.cc:654] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.329695  7288 tablet_bootstrap.cc:492] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.330461  7288 ts_tablet_manager.cc:1403] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.007s
I20260709 13:15:37.333036  7289 tablet_bootstrap.cc:492] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.333845  7289 ts_tablet_manager.cc:1403] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.003s
I20260709 13:15:37.334611  7288 raft_consensus.cc:359] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.335637  7288 raft_consensus.cc:385] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.336030  7288 raft_consensus.cc:740] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.337244  7288 consensus_queue.cc:260] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.338876  7289 raft_consensus.cc:359] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.339959  7289 raft_consensus.cc:385] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.340193  7288 ts_tablet_manager.cc:1434] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:15:37.340350  7289 raft_consensus.cc:740] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.342398  7288 tablet_bootstrap.cc:492] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.342239  7289 consensus_queue.cc:260] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.345139  7289 ts_tablet_manager.cc:1434] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:15:37.346274  7289 tablet_bootstrap.cc:492] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:37.342600  7291 tablet_bootstrap.cc:492] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.348445  7291 ts_tablet_manager.cc:1403] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.004s
I20260709 13:15:37.350497  7288 tablet_bootstrap.cc:654] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.351836  7291 raft_consensus.cc:359] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.352702  7291 raft_consensus.cc:385] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.353034  7291 raft_consensus.cc:740] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.354341  7289 tablet_bootstrap.cc:654] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.353991  7291 consensus_queue.cc:260] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.358029  7291 ts_tablet_manager.cc:1434] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:15:37.359309  7291 tablet_bootstrap.cc:492] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:37.362718  7288 tablet_bootstrap.cc:492] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.363337  7288 ts_tablet_manager.cc:1403] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:15:37.366807  7288 raft_consensus.cc:359] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.367522  7291 tablet_bootstrap.cc:654] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.367651  7288 raft_consensus.cc:385] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.368193  7288 raft_consensus.cc:740] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.369426  7288 consensus_queue.cc:260] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.373073  7288 ts_tablet_manager.cc:1434] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:15:37.374395  7288 tablet_bootstrap.cc:492] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.384029  7291 tablet_bootstrap.cc:492] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.384291  7288 tablet_bootstrap.cc:654] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.384704  7291 ts_tablet_manager.cc:1403] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.011s
I20260709 13:15:37.385520  7294 raft_consensus.cc:493] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.385653  7306 raft_consensus.cc:493] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.386160  7294 raft_consensus.cc:515] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.386269  7306 raft_consensus.cc:515] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.388032  7291 raft_consensus.cc:359] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.388554  7306 leader_election.cc:290] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.388816  7291 raft_consensus.cc:385] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.389163  7291 raft_consensus.cc:740] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.389757  7306 raft_consensus.cc:493] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.390247  7306 raft_consensus.cc:515] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.392133  7294 leader_election.cc:290] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.390117  7291 consensus_queue.cc:260] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.392750  7306 leader_election.cc:290] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.395051  7291 ts_tablet_manager.cc:1434] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:37.396153  7291 tablet_bootstrap.cc:492] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:37.404778  7288 tablet_bootstrap.cc:492] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.405503  7288 ts_tablet_manager.cc:1403] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.009s
I20260709 13:15:37.406492  7291 tablet_bootstrap.cc:654] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.406859  7293 raft_consensus.cc:493] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.407430  7293 raft_consensus.cc:515] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.408674  7288 raft_consensus.cc:359] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.409458  7288 raft_consensus.cc:385] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.409660  7293 leader_election.cc:290] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.409780  7288 raft_consensus.cc:740] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.410796  7288 consensus_queue.cc:260] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.413321  7288 ts_tablet_manager.cc:1434] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:15:37.414403  7288 tablet_bootstrap.cc:492] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.426802  7294 raft_consensus.cc:493] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.427862  7288 tablet_bootstrap.cc:654] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.427627  7294 raft_consensus.cc:515] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.432914  7294 leader_election.cc:290] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.445192  7289 tablet_bootstrap.cc:492] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.446815  7289 ts_tablet_manager.cc:1403] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.043s
I20260709 13:15:37.451349  7289 raft_consensus.cc:359] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.457585  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.458201  7289 raft_consensus.cc:385] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.458402  7244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652b53f69344c3da288ee8f6da3a147" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.458835  7289 raft_consensus.cc:740] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.459188  7096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:37.459301  7244 raft_consensus.cc:2468] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:37.460096  7289 consensus_queue.cc:260] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.460954  7095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652b53f69344c3da288ee8f6da3a147" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:37.461522  7140 leader_election.cc:304] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:37.461898  7095 raft_consensus.cc:2468] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:37.461954  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.459194  7246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
W20260709 13:15:37.463402  7140 leader_election.cc:343] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.463677  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:37.464394  7098 raft_consensus.cc:2468] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
W20260709 13:15:37.464561  7139 leader_election.cc:343] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:37.464643  7140 leader_election.cc:343] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.465220  7139 leader_election.cc:304] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3; no voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e
I20260709 13:15:37.465704  7097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:37.466122  7293 raft_consensus.cc:2804] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.466466  7097 raft_consensus.cc:2468] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:37.466580  7293 raft_consensus.cc:493] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.467046  7293 raft_consensus.cc:3060] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.467414  7309 raft_consensus.cc:2749] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:37.459739  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:37.456668  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.469376  7248 raft_consensus.cc:2468] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:37.470063  7289 ts_tablet_manager.cc:1434] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:15:37.458563  7247 raft_consensus.cc:2468] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:37.472208  7139 leader_election.cc:304] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.473848  7309 raft_consensus.cc:2804] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.474277  7309 raft_consensus.cc:493] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.474617  7309 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.475353  7293 raft_consensus.cc:515] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.477455  7140 leader_election.cc:304] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:37.478355  7306 raft_consensus.cc:2804] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.478750  7306 raft_consensus.cc:493] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.479355  7306 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.478410  7289 tablet_bootstrap.cc:492] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:37.473229  7139 leader_election.cc:304] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:37.482438  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfea64d5bd1e4237a3c3910a02e7532e" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.483227  7247 raft_consensus.cc:2468] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:37.485472  7288 tablet_bootstrap.cc:492] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.486088  7288 ts_tablet_manager.cc:1403] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.072s	user 0.004s	sys 0.009s
I20260709 13:15:37.487836  7309 raft_consensus.cc:515] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.489331  7306 raft_consensus.cc:515] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.490527  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.491525  7065 leader_election.cc:304] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.496942  7246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652b53f69344c3da288ee8f6da3a147" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:37.497443  7294 raft_consensus.cc:2804] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.497643  7246 raft_consensus.cc:3060] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.497918  7294 raft_consensus.cc:493] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.498308  7294 raft_consensus.cc:3060] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.499541  7306 leader_election.cc:290] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.499891  7325 raft_consensus.cc:2804] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.500367  7325 raft_consensus.cc:493] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.500650  7325 raft_consensus.cc:3060] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.493772  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:37.501353  7248 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:37.501917  7139 leader_election.cc:343] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.504719  7289 tablet_bootstrap.cc:654] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.494740  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfea64d5bd1e4237a3c3910a02e7532e" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:37.508075  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:37.496268  7291 tablet_bootstrap.cc:492] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.508802  7325 raft_consensus.cc:515] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.509383  7291 ts_tablet_manager.cc:1403] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.113s	user 0.034s	sys 0.022s
I20260709 13:15:37.512317  7291 raft_consensus.cc:359] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.507310  7097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:37.495661  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
W20260709 13:15:37.513572  7139 leader_election.cc:343] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.514102  7097 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.512480  7325 leader_election.cc:290] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.514335  7173 raft_consensus.cc:2393] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e43bc14318064a41861c1d052983ad2e in current term 1: Already voted for candidate 74ce1c22402c4b91844372d1b9ba67b3 in this term.
I20260709 13:15:37.506506  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652b53f69344c3da288ee8f6da3a147" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:37.516602  7294 raft_consensus.cc:515] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.517323  7099 raft_consensus.cc:3060] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.518918  7294 leader_election.cc:290] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.518771  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:37.519569  7098 raft_consensus.cc:3060] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:37.519937  7065 leader_election.cc:343] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.520459  7291 raft_consensus.cc:385] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.520906  7291 raft_consensus.cc:740] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.521646  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfea64d5bd1e4237a3c3910a02e7532e" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:37.491501  7309 leader_election.cc:290] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.521947  7291 consensus_queue.cc:260] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.523909  7293 leader_election.cc:290] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
W20260709 13:15:37.526592  7065 leader_election.cc:343] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.489400  7288 raft_consensus.cc:359] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.532488  7288 raft_consensus.cc:385] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.532832  7288 raft_consensus.cc:740] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.533921  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfea64d5bd1e4237a3c3910a02e7532e" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:37.534593  7245 raft_consensus.cc:3060] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.535784  7099 raft_consensus.cc:2468] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:37.536118  7244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:37.536737  7244 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.537791  7291 ts_tablet_manager.cc:1434] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:15:37.538296  7243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:37.538935  7291 tablet_bootstrap.cc:492] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:37.541885  7139 leader_election.cc:304] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.542624  7098 raft_consensus.cc:2468] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:37.544131  7288 consensus_queue.cc:260] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.544826  7291 tablet_bootstrap.cc:654] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.549723  7309 raft_consensus.cc:2804] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.559893  7309 raft_consensus.cc:697] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:37.546468  7246 raft_consensus.cc:2468] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:37.551657  7139 leader_election.cc:304] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:37.546137  7097 raft_consensus.cc:2468] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:37.562222  7244 raft_consensus.cc:2468] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:37.563148  7248 raft_consensus.cc:2468] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:37.563761  7325 raft_consensus.cc:2804] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.564718  7325 raft_consensus.cc:697] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:37.565681  7291 tablet_bootstrap.cc:492] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:37.566290  7291 ts_tablet_manager.cc:1403] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:15:37.566658  7140 leader_election.cc:304] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: e43bc14318064a41861c1d052983ad2e
I20260709 13:15:37.568778  7293 raft_consensus.cc:2804] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.567621  7139 leader_election.cc:304] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.569226  7291 raft_consensus.cc:359] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.572705  7294 raft_consensus.cc:493] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.572943  7291 raft_consensus.cc:385] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.573307  7291 raft_consensus.cc:740] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.573220  7294 raft_consensus.cc:515] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.574185  7291 consensus_queue.cc:260] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.569526  7293 raft_consensus.cc:697] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:37.576395  7291 ts_tablet_manager.cc:1434] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:37.576169  7293 consensus_queue.cc:237] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.571161  7245 raft_consensus.cc:2468] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:37.572216  7247 raft_consensus.cc:2468] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:37.567042  7325 consensus_queue.cc:237] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.583441  7065 leader_election.cc:304] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:37.570328  7309 consensus_queue.cc:237] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.585856  7294 leader_election.cc:290] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.577055  7306 raft_consensus.cc:2804] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.586828  7294 raft_consensus.cc:2804] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.587529  7294 raft_consensus.cc:697] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:37.588879  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:37.588716  7294 consensus_queue.cc:237] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.589933  7173 raft_consensus.cc:2468] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:37.591682  7065 leader_election.cc:304] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.593662  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.595001  7289 tablet_bootstrap.cc:492] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.595742  7289 ts_tablet_manager.cc:1403] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.118s	user 0.037s	sys 0.053s
I20260709 13:15:37.598060  7306 raft_consensus.cc:697] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:37.598944  7289 raft_consensus.cc:359] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.599721  7289 raft_consensus.cc:385] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.600034  7289 raft_consensus.cc:740] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.599432  7306 consensus_queue.cc:237] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.603794  7289 consensus_queue.cc:260] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.603518  7288 ts_tablet_manager.cc:1434] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.117s	user 0.011s	sys 0.000s
I20260709 13:15:37.603998  7327 raft_consensus.cc:2804] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.605974  7327 raft_consensus.cc:493] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.606333  7327 raft_consensus.cc:3060] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.606642  7288 tablet_bootstrap.cc:492] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.620875  7289 ts_tablet_manager.cc:1434] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:15:37.622138  7289 tablet_bootstrap.cc:492] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:37.619848  7065 leader_election.cc:304] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:37.624179  7332 raft_consensus.cc:493] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.628875  7327 raft_consensus.cc:515] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.629456  7332 raft_consensus.cc:515] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.631048  7288 tablet_bootstrap.cc:654] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.631606  7327 leader_election.cc:290] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.632979  7332 leader_election.cc:290] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.627156  6993 catalog_manager.cc:5697] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.635941  7289 tablet_bootstrap.cc:654] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.640862  6994 catalog_manager.cc:5697] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 0 to 1, leader changed from <none> to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.637223  7332 raft_consensus.cc:2764] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:15:37.645552  7065 leader_election.cc:343] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.648556  7289 tablet_bootstrap.cc:492] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:37.648556  7288 tablet_bootstrap.cc:492] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.649163  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:37.649389  7289 ts_tablet_manager.cc:1403] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.013s
I20260709 13:15:37.649389  7288 ts_tablet_manager.cc:1403] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.005s
I20260709 13:15:37.650094  7173 raft_consensus.cc:3060] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.653021  7289 raft_consensus.cc:359] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.653388  7288 raft_consensus.cc:359] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.653934  7289 raft_consensus.cc:385] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.654209  7288 raft_consensus.cc:385] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.654307  7289 raft_consensus.cc:740] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.654666  7288 raft_consensus.cc:740] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.655393  7289 consensus_queue.cc:260] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.655634  7288 consensus_queue.cc:260] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.657845  7289 ts_tablet_manager.cc:1434] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:15:37.661338  7288 ts_tablet_manager.cc:1434] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:15:37.662657  7288 tablet_bootstrap.cc:492] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.666038  7173 raft_consensus.cc:2468] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:37.668627  7065 leader_election.cc:304] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.669953  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.670452  7288 tablet_bootstrap.cc:654] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.670377  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:37.670774  7245 raft_consensus.cc:2468] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:37.672336  7332 raft_consensus.cc:2804] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.673132  7332 raft_consensus.cc:697] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:37.674230  7332 consensus_queue.cc:237] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.678321  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
W20260709 13:15:37.678959  7065 leader_election.cc:343] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.679137  7173 raft_consensus.cc:2468] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:37.680202  7296 raft_consensus.cc:493] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.680791  7296 raft_consensus.cc:515] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.684155  7288 tablet_bootstrap.cc:492] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.684734  7288 ts_tablet_manager.cc:1403] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:15:37.687294  7288 raft_consensus.cc:359] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.687819  7288 raft_consensus.cc:385] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.688064  7288 raft_consensus.cc:740] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.688704  7288 consensus_queue.cc:260] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.690852  7296 leader_election.cc:290] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:37.681037  7065 leader_election.cc:304] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.692175  7332 raft_consensus.cc:2804] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.692561  7332 raft_consensus.cc:493] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.692967  7332 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.705449  7332 raft_consensus.cc:515] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.708469  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:37.709154  7173 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.715152  7288 ts_tablet_manager.cc:1434] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 13:15:37.716274  7288 tablet_bootstrap.cc:492] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:37.716040  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:37.717075  7098 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 0.
I20260709 13:15:37.719005  7213 leader_election.cc:304] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.720451  7344 raft_consensus.cc:2804] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.720939  7344 raft_consensus.cc:493] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.721520  7344 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.722506  7332 leader_election.cc:290] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.724104  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:37.726025  7245 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.721345  7173 raft_consensus.cc:2468] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:37.727519  7065 leader_election.cc:304] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.733469  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:37.733290  6994 catalog_manager.cc:5697] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 0 to 1, leader changed from <none> to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.734237  7174 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 0.
I20260709 13:15:37.734448  7288 tablet_bootstrap.cc:654] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.734838  7332 raft_consensus.cc:2804] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.735423  7332 raft_consensus.cc:697] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:37.733436  7245 raft_consensus.cc:2468] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:37.736224  7332 consensus_queue.cc:237] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.734571  7344 raft_consensus.cc:515] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.742296  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:37.742895  7098 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.745689  6995 catalog_manager.cc:5697] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.747666  6995 catalog_manager.cc:5697] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.749476  6995 catalog_manager.cc:5697] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.754577  7098 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 1.
I20260709 13:15:37.756099  7213 leader_election.cc:304] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.757372  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:37.758095  7174 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.763824  7296 raft_consensus.cc:2804] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.766152  7174 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 1.
I20260709 13:15:37.767660  7344 leader_election.cc:290] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:37.770984  7296 raft_consensus.cc:697] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:37.772024  7296 consensus_queue.cc:237] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.774720  7288 tablet_bootstrap.cc:492] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:37.775310  7288 ts_tablet_manager.cc:1403] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.027s
I20260709 13:15:37.778184  7288 raft_consensus.cc:359] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.778936  7288 raft_consensus.cc:385] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.779268  7288 raft_consensus.cc:740] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.779994  7288 consensus_queue.cc:260] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.780546  6994 catalog_manager.cc:5697] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 0 to 1, leader changed from <none> to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.782197  7288 ts_tablet_manager.cc:1434] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:37.787149  6995 catalog_manager.cc:5697] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 0 to 1, leader changed from <none> to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 1 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.874258  7332 raft_consensus.cc:493] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.874786  7332 raft_consensus.cc:515] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.876816  7332 leader_election.cc:290] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.877502  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:37.877952  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.878746  7245 raft_consensus.cc:2393] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e43bc14318064a41861c1d052983ad2e in current term 1: Already voted for candidate 74ce1c22402c4b91844372d1b9ba67b3 in this term.
I20260709 13:15:37.879721  7065 leader_election.cc:304] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:37.880437  7332 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.885847  7332 raft_consensus.cc:2749] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:37.932899  7332 raft_consensus.cc:493] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.933600  7332 raft_consensus.cc:515] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.935693  7332 leader_election.cc:290] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.936528  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:37.936841  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:37.937240  7174 raft_consensus.cc:2468] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:37.937677  7245 raft_consensus.cc:2468] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:37.938320  7065 leader_election.cc:304] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.939249  7332 raft_consensus.cc:2804] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.939591  7332 raft_consensus.cc:493] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.939875  7332 raft_consensus.cc:3060] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.945305  7332 raft_consensus.cc:515] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.947166  7332 leader_election.cc:290] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:37.948112  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:37.948462  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:37.948702  7174 raft_consensus.cc:3060] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.949079  7245 raft_consensus.cc:3060] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.954541  7174 raft_consensus.cc:2468] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:37.954541  7245 raft_consensus.cc:2468] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:37.955802  7065 leader_election.cc:304] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:37.956594  7332 raft_consensus.cc:2804] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.957149  7332 raft_consensus.cc:697] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:37.957906  7332 consensus_queue.cc:237] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:37.964808  6995 catalog_manager.cc:5697] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 0 to 1, leader changed from <none> to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.007355  7306 consensus_queue.cc:1048] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.019672  7309 consensus_queue.cc:1048] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.062429  7309 raft_consensus.cc:493] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.062961  7309 raft_consensus.cc:515] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.064950  7309 leader_election.cc:290] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:38.065747  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfea64d5bd1e4237a3c3910a02e7532e" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:38.066161  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfea64d5bd1e4237a3c3910a02e7532e" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:38.066963  7245 raft_consensus.cc:2393] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ce1c22402c4b91844372d1b9ba67b3 in current term 1: Already voted for candidate e43bc14318064a41861c1d052983ad2e in this term.
I20260709 13:15:38.067849  7140 leader_election.cc:304] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3; no voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e
I20260709 13:15:38.068516  7309 raft_consensus.cc:3060] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.072693  7306 consensus_queue.cc:1048] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.074421  7309 raft_consensus.cc:2749] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.078647  7306 consensus_queue.cc:1048] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.085078  7306 consensus_queue.cc:1048] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.099062  7247 raft_consensus.cc:3060] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.107371  7309 consensus_queue.cc:1048] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.122601  7332 consensus_queue.cc:1048] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.135677  7332 consensus_queue.cc:1048] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.155839  7332 consensus_queue.cc:1048] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.168205  7173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
mode: GRACEFUL
new_leader_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:45262
I20260709 13:15:38.168874  7173 raft_consensus.cc:606] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Received request to transfer leadership to TS e43bc14318064a41861c1d052983ad2e
I20260709 13:15:38.169530  7327 consensus_queue.cc:1048] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.183341  7296 raft_consensus.cc:493] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.184019  7296 raft_consensus.cc:515] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.185295  7327 consensus_queue.cc:1048] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:38.186568  7296 leader_election.cc:290] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:38.193569  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:38.197975  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:38.197955  7247 raft_consensus.cc:3060] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.205127  7245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f"
dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
mode: GRACEFUL
new_leader_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:40268
I20260709 13:15:38.205942  7245 raft_consensus.cc:606] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Received request to transfer leadership to TS e43bc14318064a41861c1d052983ad2e
I20260709 13:15:38.209251  7294 consensus_queue.cc:1048] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.214568  7174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
mode: GRACEFUL
new_leader_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:45262
I20260709 13:15:38.215090  7214 leader_election.cc:304] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba; no voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e
I20260709 13:15:38.215319  7174 raft_consensus.cc:606] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Received request to transfer leadership to TS e43bc14318064a41861c1d052983ad2e
I20260709 13:15:38.218732  7349 raft_consensus.cc:2749] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.230670  7309 consensus_queue.cc:1048] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.242026  7098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
mode: GRACEFUL
new_leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:15:38.242712  7098 raft_consensus.cc:606] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Received request to transfer leadership to TS 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:38.243098  7330 consensus_queue.cc:1048] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.253919  7309 raft_consensus.cc:993] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3: : Instructing follower e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:38.254444  7306 raft_consensus.cc:1081] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Signalling peer e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:38.254861  7098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
mode: GRACEFUL
new_leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:15:38.256261  7097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:45480
I20260709 13:15:38.256950  7097 raft_consensus.cc:493] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.257370  7097 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.258585  7098 raft_consensus.cc:606] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Received request to transfer leadership to TS 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:38.264310  7097 raft_consensus.cc:515] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.267334  7097 leader_election.cc:290] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:38.268016  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:38.268676  7173 raft_consensus.cc:3055] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:38.268708  7349 consensus_queue.cc:1048] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:38.269145  7173 raft_consensus.cc:740] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:38.271060  7173 consensus_queue.cc:260] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.271658  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:38.272215  7097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
mode: GRACEFUL
new_leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:15:38.272341  7245 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.272608  7173 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.276316  7097 raft_consensus.cc:606] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Received request to transfer leadership to TS 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:38.282406  7173 raft_consensus.cc:2468] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:38.284026  7349 raft_consensus.cc:993] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba: : Instructing follower e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:38.285229  7349 raft_consensus.cc:1081] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Signalling peer e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:38.285364  7245 raft_consensus.cc:2468] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:38.286998  7099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:45486
I20260709 13:15:38.286720  7065 leader_election.cc:304] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:38.287745  7099 raft_consensus.cc:493] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.288147  7099 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.288285  7332 raft_consensus.cc:2804] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.288887  7332 raft_consensus.cc:697] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:38.286906  7173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c652b53f69344c3da288ee8f6da3a147"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
mode: GRACEFUL
new_leader_uuid: "14c4cd7930244b0fb0af262aba6bedba"
 from {username='slave'} at 127.0.0.1:45262
I20260709 13:15:38.289647  7173 raft_consensus.cc:606] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Received request to transfer leadership to TS 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:38.290055  7332 consensus_queue.cc:237] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.297575  7296 consensus_queue.cc:1048] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:38.297502  7099 raft_consensus.cc:515] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.303100  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:38.304590  7099 leader_election.cc:290] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:38.306396  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:38.307004  7245 raft_consensus.cc:3055] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:38.307309  7245 raft_consensus.cc:740] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:38.308169  7245 consensus_queue.cc:260] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.309458  7245 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.316231  7245 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:38.317338  7065 leader_election.cc:304] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:38.317704  6994 catalog_manager.cc:5697] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 1 to 2, leader changed from 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2) to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 2 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.318619  7332 raft_consensus.cc:2804] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.319176  7332 raft_consensus.cc:697] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:38.319886  7332 consensus_queue.cc:237] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.331539  6994 catalog_manager.cc:5697] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 1 to 2, leader changed from 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3) to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 2 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.408378  7332 consensus_queue.cc:1048] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:38.420035  7294 consensus_queue.cc:1048] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.429081  7294 raft_consensus.cc:993] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e: : Instructing follower 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:38.429608  7294 raft_consensus.cc:1081] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Signalling peer 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:38.431631  7173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45244
I20260709 13:15:38.432233  7173 raft_consensus.cc:493] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.432641  7173 raft_consensus.cc:3060] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.438091  7173 raft_consensus.cc:515] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.439966  7173 leader_election.cc:290] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:38.441128  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:38.441231  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d4ae8c7a0d4fcd8772e0507f3cbf33" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:38.441941  7099 raft_consensus.cc:3055] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:38.442167  7245 raft_consensus.cc:3060] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.442415  7099 raft_consensus.cc:740] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:38.443432  7099 consensus_queue.cc:260] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.444873  7099 raft_consensus.cc:3060] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.450810  7245 raft_consensus.cc:2468] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:38.452316  7140 leader_election.cc:304] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:38.453125  7099 raft_consensus.cc:2468] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:38.453269  7306 raft_consensus.cc:2804] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.453927  7306 raft_consensus.cc:697] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:38.454870  7306 consensus_queue.cc:237] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.456480  7309 raft_consensus.cc:993] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3: : Instructing follower e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:38.457046  7309 raft_consensus.cc:1081] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Signalling peer e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:38.458750  7099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:45480
I20260709 13:15:38.459303  7099 raft_consensus.cc:493] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.459604  7099 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.465359  6995 catalog_manager.cc:5697] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 1 to 2, leader changed from e43bc14318064a41861c1d052983ad2e (127.26.202.1) to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.465668  7099 raft_consensus.cc:515] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.467713  7099 leader_election.cc:290] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:38.468483  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:38.468803  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:38.469208  7173 raft_consensus.cc:3055] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:38.469489  7245 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.469637  7173 raft_consensus.cc:740] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:38.470640  7173 consensus_queue.cc:260] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.471766  7173 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.476258  7245 raft_consensus.cc:2468] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:38.477533  7065 leader_election.cc:304] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:38.478473  7327 raft_consensus.cc:2804] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.478649  7173 raft_consensus.cc:2468] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:38.478953  7327 raft_consensus.cc:697] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:38.479844  7327 consensus_queue.cc:237] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.486327  6995 catalog_manager.cc:5697] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 1 to 2, leader changed from 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2) to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 2 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.647814  7294 raft_consensus.cc:993] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e: : Instructing follower 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:38.648350  7327 raft_consensus.cc:1081] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Signalling peer 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:38.649895  7173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45244
I20260709 13:15:38.650519  7173 raft_consensus.cc:493] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.650885  7173 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.654119  7294 raft_consensus.cc:993] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e: : Instructing follower 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:38.654608  7327 raft_consensus.cc:1081] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Signalling peer 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:38.656324  7174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45244
I20260709 13:15:38.656912  7174 raft_consensus.cc:493] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.657326  7174 raft_consensus.cc:3060] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.657823  7173 raft_consensus.cc:515] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.660161  7173 leader_election.cc:290] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:38.661248  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:38.661823  7099 raft_consensus.cc:3055] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:38.662086  7099 raft_consensus.cc:740] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:38.662747  7099 consensus_queue.cc:260] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.663627  7099 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.663902  7174 raft_consensus.cc:515] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.665963  7174 leader_election.cc:290] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:38.667133  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:38.666990  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:38.667770  7247 raft_consensus.cc:3060] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.667853  7098 raft_consensus.cc:3055] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:38.667929  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:38.668464  7098 raft_consensus.cc:740] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:38.668684  7245 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.669335  7098 consensus_queue.cc:260] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.670710  7098 raft_consensus.cc:3060] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.673787  7247 raft_consensus.cc:2468] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:38.675447  7140 leader_election.cc:304] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:38.676415  7309 raft_consensus.cc:2804] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.676904  7309 raft_consensus.cc:697] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:38.677505  7099 raft_consensus.cc:2468] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:38.678263  7098 raft_consensus.cc:2468] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:38.677884  7309 consensus_queue.cc:237] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.676873  7245 raft_consensus.cc:2468] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:38.678984  7139 leader_election.cc:304] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:38.679898  7306 raft_consensus.cc:2804] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.680382  7306 raft_consensus.cc:697] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:38.681164  7306 consensus_queue.cc:237] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.686996  6995 catalog_manager.cc:5697] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 1 to 2, leader changed from e43bc14318064a41861c1d052983ad2e (127.26.202.1) to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.690871  7306 raft_consensus.cc:993] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3: : Instructing follower 14c4cd7930244b0fb0af262aba6bedba to start an election
I20260709 13:15:38.691450  7306 raft_consensus.cc:1081] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Signalling peer 14c4cd7930244b0fb0af262aba6bedba to start an election
I20260709 13:15:38.693063  7245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c652b53f69344c3da288ee8f6da3a147"
dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
 from {username='slave'} at 127.0.0.1:40262
I20260709 13:15:38.693576  7245 raft_consensus.cc:493] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:38.693867  7245 raft_consensus.cc:3060] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.700158  7245 raft_consensus.cc:515] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.703226  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652b53f69344c3da288ee8f6da3a147" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:38.702382  6995 catalog_manager.cc:5697] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 1 to 2, leader changed from e43bc14318064a41861c1d052983ad2e (127.26.202.1) to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.703652  7245 leader_election.cc:290] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 2 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:38.703877  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c652b53f69344c3da288ee8f6da3a147" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:38.703963  7098 raft_consensus.cc:3060] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.704741  7174 raft_consensus.cc:3055] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:38.705662  7174 raft_consensus.cc:740] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:38.706595  7174 consensus_queue.cc:260] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.707895  7174 raft_consensus.cc:3060] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.714293  7098 raft_consensus.cc:2468] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 2.
I20260709 13:15:38.715149  7174 raft_consensus.cc:2468] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 2.
I20260709 13:15:38.715598  7213 leader_election.cc:304] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:38.716496  7374 raft_consensus.cc:2804] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.716892  7374 raft_consensus.cc:697] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 2 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:38.717702  7374 consensus_queue.cc:237] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:38.723603  6995 catalog_manager.cc:5697] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 1 to 2, leader changed from 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2) to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 2 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:38.746310  7245 raft_consensus.cc:1275] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:38.747747  7327 consensus_queue.cc:1048] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.755511  7174 raft_consensus.cc:1275] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:38.757246  7294 consensus_queue.cc:1048] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.815802  7174 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.821563  7174 raft_consensus.cc:1275] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:38.822935  7327 consensus_queue.cc:1048] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.832206  7245 raft_consensus.cc:1275] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:38.835047  7294 consensus_queue.cc:1048] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.872684  7245 raft_consensus.cc:1275] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:38.874253  7306 consensus_queue.cc:1048] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.882622  7098 raft_consensus.cc:1275] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:38.884598  7309 consensus_queue.cc:1048] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.910614  7174 raft_consensus.cc:1275] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:38.911908  7294 consensus_queue.cc:1048] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:38.920703  7245 raft_consensus.cc:1275] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:38.922472  7332 consensus_queue.cc:1048] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.081545  7245 raft_consensus.cc:1275] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.083069  7309 consensus_queue.cc:1048] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.091643  7098 raft_consensus.cc:1275] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.093304  7325 consensus_queue.cc:1048] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.154841  7174 raft_consensus.cc:1275] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Refusing update from remote peer 14c4cd7930244b0fb0af262aba6bedba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.156184  7374 consensus_queue.cc:1048] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.165480  7098 raft_consensus.cc:1275] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Refusing update from remote peer 14c4cd7930244b0fb0af262aba6bedba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.168155  7379 consensus_queue.cc:1048] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:39.183357  7245 raft_consensus.cc:1275] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.184789  7325 consensus_queue.cc:1048] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.189608  7098 raft_consensus.cc:1275] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.191596  7306 consensus_queue.cc:1048] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.328219  6993 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34624:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:41.331357  6993 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:41.973125  7086 tablet_service.cc:1511] Processing CreateTablet for tablet 5227f43a1f3447dea8246822131481cd (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:41.974522  7163 tablet_service.cc:1511] Processing CreateTablet for tablet 5227f43a1f3447dea8246822131481cd (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:41.975589  7086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5227f43a1f3447dea8246822131481cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.976312  7163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5227f43a1f3447dea8246822131481cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.976214  7234 tablet_service.cc:1511] Processing CreateTablet for tablet 5227f43a1f3447dea8246822131481cd (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:41.978008  7234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5227f43a1f3447dea8246822131481cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.983330  7083 tablet_service.cc:1511] Processing CreateTablet for tablet c9993f636c9a45ff883a4d3075e649ed (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:41.984989  7083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9993f636c9a45ff883a4d3075e649ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.987609  7162 tablet_service.cc:1511] Processing CreateTablet for tablet c9993f636c9a45ff883a4d3075e649ed (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:41.992832  7232 tablet_service.cc:1511] Processing CreateTablet for tablet c9993f636c9a45ff883a4d3075e649ed (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:41.993567  7157 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9f4013a84a468d8d55fb2f6d1b83bd (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:41.994552  7232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9993f636c9a45ff883a4d3075e649ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.994550  7162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9993f636c9a45ff883a4d3075e649ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.995688  7157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9f4013a84a468d8d55fb2f6d1b83bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.000316  7236 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9f4013a84a468d8d55fb2f6d1b83bd (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:42.000903  7160 tablet_service.cc:1511] Processing CreateTablet for tablet fc283d09fea74a5696d6b1cb7838e579 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:42.002045  7236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9f4013a84a468d8d55fb2f6d1b83bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.002425  7160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc283d09fea74a5696d6b1cb7838e579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.003062  7087 tablet_service.cc:1511] Processing CreateTablet for tablet 4e9f4013a84a468d8d55fb2f6d1b83bd (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:42.004448  7087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e9f4013a84a468d8d55fb2f6d1b83bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.007077  7237 tablet_service.cc:1511] Processing CreateTablet for tablet fc283d09fea74a5696d6b1cb7838e579 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:42.008708  7237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc283d09fea74a5696d6b1cb7838e579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.011968  7233 tablet_service.cc:1511] Processing CreateTablet for tablet c78ab5df95424c3ba291e65d738ce8ae (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:42.013505  7233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c78ab5df95424c3ba291e65d738ce8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.010166  7159 tablet_service.cc:1511] Processing CreateTablet for tablet c78ab5df95424c3ba291e65d738ce8ae (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:42.014878  7159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c78ab5df95424c3ba291e65d738ce8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.015872  7235 tablet_service.cc:1511] Processing CreateTablet for tablet d1bcf63f24784b5499c1b6fef935921f (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:42.010308  7156 tablet_service.cc:1511] Processing CreateTablet for tablet d1bcf63f24784b5499c1b6fef935921f (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:42.017550  7235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bcf63f24784b5499c1b6fef935921f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.017846  7156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bcf63f24784b5499c1b6fef935921f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.008351  7081 tablet_service.cc:1511] Processing CreateTablet for tablet fc283d09fea74a5696d6b1cb7838e579 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:42.022053  7081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc283d09fea74a5696d6b1cb7838e579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.030483  7084 tablet_service.cc:1511] Processing CreateTablet for tablet c78ab5df95424c3ba291e65d738ce8ae (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:42.032161  7084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c78ab5df95424c3ba291e65d738ce8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.034370  7082 tablet_service.cc:1511] Processing CreateTablet for tablet d1bcf63f24784b5499c1b6fef935921f (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:42.035832  7082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bcf63f24784b5499c1b6fef935921f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.038563  7085 tablet_service.cc:1511] Processing CreateTablet for tablet 4aea51e0974e4579ac931b2af6ff0fe0 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:42.040088  7085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aea51e0974e4579ac931b2af6ff0fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.042770  7088 tablet_service.cc:1511] Processing CreateTablet for tablet 333ed386c7554a69978c87513ae1070c (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:42.044293  7088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333ed386c7554a69978c87513ae1070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.044266  7089 tablet_service.cc:1511] Processing CreateTablet for tablet 8f91d830f34c448abdb1f81dc7d15444 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:42.046062  7089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f91d830f34c448abdb1f81dc7d15444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.059227  7158 tablet_service.cc:1511] Processing CreateTablet for tablet 4aea51e0974e4579ac931b2af6ff0fe0 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:42.060957  7158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aea51e0974e4579ac931b2af6ff0fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.080041  7231 tablet_service.cc:1511] Processing CreateTablet for tablet 4aea51e0974e4579ac931b2af6ff0fe0 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:42.081887  7231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aea51e0974e4579ac931b2af6ff0fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.087881  7164 tablet_service.cc:1511] Processing CreateTablet for tablet 333ed386c7554a69978c87513ae1070c (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:42.089666  7164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333ed386c7554a69978c87513ae1070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.129817  7407 tablet_bootstrap.cc:492] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.136435  7161 tablet_service.cc:1511] Processing CreateTablet for tablet 8f91d830f34c448abdb1f81dc7d15444 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:42.138015  7161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f91d830f34c448abdb1f81dc7d15444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.161661  7408 tablet_bootstrap.cc:492] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:42.163139  7409 tablet_bootstrap.cc:492] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.166134  7237 tablet_service.cc:1511] Processing CreateTablet for tablet 8f91d830f34c448abdb1f81dc7d15444 (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:42.171476  7237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f91d830f34c448abdb1f81dc7d15444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.174896  7407 tablet_bootstrap.cc:654] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.170058  7408 tablet_bootstrap.cc:654] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.168258  7233 tablet_service.cc:1511] Processing CreateTablet for tablet 333ed386c7554a69978c87513ae1070c (DEFAULT_TABLE table=soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:42.180241  7233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333ed386c7554a69978c87513ae1070c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.186856  7409 tablet_bootstrap.cc:654] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.198956  7408 tablet_bootstrap.cc:492] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.199753  7408 ts_tablet_manager.cc:1403] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.007s
I20260709 13:15:42.204614  7408 raft_consensus.cc:359] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.205920  7408 raft_consensus.cc:385] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.206247  7408 raft_consensus.cc:740] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.207048  7408 consensus_queue.cc:260] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.210250  7408 ts_tablet_manager.cc:1434] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:42.211632  7408 tablet_bootstrap.cc:492] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:42.211884  7409 tablet_bootstrap.cc:492] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.212606  7409 ts_tablet_manager.cc:1403] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.008s
I20260709 13:15:42.213410  7407 tablet_bootstrap.cc:492] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:42.214118  7407 ts_tablet_manager.cc:1403] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.007s
I20260709 13:15:42.216498  7409 raft_consensus.cc:359] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.217499  7409 raft_consensus.cc:385] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.217871  7409 raft_consensus.cc:740] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.218856  7409 consensus_queue.cc:260] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.219120  7407 raft_consensus.cc:359] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.220116  7407 raft_consensus.cc:385] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.220504  7407 raft_consensus.cc:740] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.221684  7408 tablet_bootstrap.cc:654] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.221459  7407 consensus_queue.cc:260] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.224560  7407 ts_tablet_manager.cc:1434] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:15:42.225865  7407 tablet_bootstrap.cc:492] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.228825  7409 ts_tablet_manager.cc:1434] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:42.230278  7409 tablet_bootstrap.cc:492] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.233155  7407 tablet_bootstrap.cc:654] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.237219  7409 tablet_bootstrap.cc:654] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.240190  7407 tablet_bootstrap.cc:492] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:42.240896  7407 ts_tablet_manager.cc:1403] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:15:42.244329  7407 raft_consensus.cc:359] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.244895  7409 tablet_bootstrap.cc:492] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.245112  7407 raft_consensus.cc:385] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.245448  7407 raft_consensus.cc:740] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.245528  7409 ts_tablet_manager.cc:1403] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:15:42.246382  7407 consensus_queue.cc:260] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.249053  7407 ts_tablet_manager.cc:1434] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:42.249209  7408 tablet_bootstrap.cc:492] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.249071  7409 raft_consensus.cc:359] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.250054  7408 ts_tablet_manager.cc:1403] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.010s
I20260709 13:15:42.250286  7407 tablet_bootstrap.cc:492] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.250145  7409 raft_consensus.cc:385] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.250833  7409 raft_consensus.cc:740] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.251823  7409 consensus_queue.cc:260] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.253734  7408 raft_consensus.cc:359] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.254685  7408 raft_consensus.cc:385] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.255054  7408 raft_consensus.cc:740] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.255890  7408 consensus_queue.cc:260] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.257977  7409 ts_tablet_manager.cc:1434] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:15:42.259214  7408 ts_tablet_manager.cc:1434] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:15:42.259231  7409 tablet_bootstrap.cc:492] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.260560  7408 tablet_bootstrap.cc:492] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:42.261687  7407 tablet_bootstrap.cc:654] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:42.266601  7045 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:42.269518  7408 tablet_bootstrap.cc:654] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.269973  7409 tablet_bootstrap.cc:654] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.277798  7407 tablet_bootstrap.cc:492] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:42.278479  7407 ts_tablet_manager.cc:1403] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.000s
I20260709 13:15:42.279850  7409 tablet_bootstrap.cc:492] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.280478  7409 ts_tablet_manager.cc:1403] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:15:42.276796  7398 raft_consensus.cc:493] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.282092  7407 raft_consensus.cc:359] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.282898  7407 raft_consensus.cc:385] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.281823  7398 raft_consensus.cc:515] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.283267  7407 raft_consensus.cc:740] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.283747  7409 raft_consensus.cc:359] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.284595  7409 raft_consensus.cc:385] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.284148  7407 consensus_queue.cc:260] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.284904  7409 raft_consensus.cc:740] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.285964  7409 consensus_queue.cc:260] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.287812  7407 ts_tablet_manager.cc:1434] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:42.289028  7407 tablet_bootstrap.cc:492] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.288339  7172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5227f43a1f3447dea8246822131481cd" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.289675  7172 raft_consensus.cc:2468] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:42.292696  7065 leader_election.cc:304] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:42.294237  7401 raft_consensus.cc:2804] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.294641  7401 raft_consensus.cc:493] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.294972  7401 raft_consensus.cc:3060] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.288398  7409 ts_tablet_manager.cc:1434] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:15:42.297590  7409 tablet_bootstrap.cc:492] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.308413  7409 tablet_bootstrap.cc:654] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.312176  7408 tablet_bootstrap.cc:492] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.312975  7408 ts_tablet_manager.cc:1403] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.053s	user 0.030s	sys 0.021s
I20260709 13:15:42.313190  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5227f43a1f3447dea8246822131481cd" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:42.314091  7245 raft_consensus.cc:2468] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:42.313794  7401 raft_consensus.cc:515] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.318260  7408 raft_consensus.cc:359] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.327320  7408 raft_consensus.cc:385] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.328174  7407 tablet_bootstrap.cc:654] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.328018  7408 raft_consensus.cc:740] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.316336  7398 leader_election.cc:290] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.329804  7172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5227f43a1f3447dea8246822131481cd" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:42.330021  7408 consensus_queue.cc:260] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.330653  7172 raft_consensus.cc:3060] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.332756  7409 tablet_bootstrap.cc:492] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.333737  7409 ts_tablet_manager.cc:1403] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.009s
I20260709 13:15:42.338613  7409 raft_consensus.cc:359] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.339540  7409 raft_consensus.cc:385] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.339902  7409 raft_consensus.cc:740] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.340719  7409 consensus_queue.cc:260] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.341712  7172 raft_consensus.cc:2468] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:42.343297  7409 ts_tablet_manager.cc:1434] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:42.343847  7408 ts_tablet_manager.cc:1434] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.008s
I20260709 13:15:42.344620  7327 raft_consensus.cc:493] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.345156  7409 tablet_bootstrap.cc:492] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.345156  7408 tablet_bootstrap.cc:492] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:42.355155  7408 tablet_bootstrap.cc:654] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.352761  7409 tablet_bootstrap.cc:654] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.345206  7327 raft_consensus.cc:515] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.359477  7327 leader_election.cc:290] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.363570  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc283d09fea74a5696d6b1cb7838e579" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.367086  7065 leader_election.cc:304] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:42.369082  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc283d09fea74a5696d6b1cb7838e579" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:42.370069  7247 raft_consensus.cc:2468] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:42.371917  7409 tablet_bootstrap.cc:492] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.372965  7409 ts_tablet_manager.cc:1403] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.017s
I20260709 13:15:42.374626  7398 raft_consensus.cc:2804] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.375463  7398 raft_consensus.cc:697] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:42.379861  7408 tablet_bootstrap.cc:492] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.379021  7409 raft_consensus.cc:359] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.380659  7408 ts_tablet_manager.cc:1403] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.016s
I20260709 13:15:42.377179  7398 consensus_queue.cc:237] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.384443  7408 raft_consensus.cc:359] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.385317  7408 raft_consensus.cc:385] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.385385  7409 raft_consensus.cc:385] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:42.386018  7065 leader_election.cc:343] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.386479  7409 raft_consensus.cc:740] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.386948  7401 leader_election.cc:290] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.387089  7065 leader_election.cc:304] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:42.387841  7409 consensus_queue.cc:260] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.391238  7409 ts_tablet_manager.cc:1434] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.007s
I20260709 13:15:42.392513  7409 tablet_bootstrap.cc:492] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.385682  7408 raft_consensus.cc:740] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.394963  7408 consensus_queue.cc:260] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.397686  7408 ts_tablet_manager.cc:1434] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:15:42.398871  7408 tablet_bootstrap.cc:492] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:42.399833  6993 catalog_manager.cc:5697] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 0 to 1, leader changed from <none> to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.406523  7408 tablet_bootstrap.cc:654] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.406523  7409 tablet_bootstrap.cc:654] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.389107  7401 raft_consensus.cc:2804] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.424105  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5227f43a1f3447dea8246822131481cd" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:42.424965  7247 raft_consensus.cc:3060] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:42.426767  7028 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8d20 after lost signal to thread 27435
I20260709 13:15:42.428042  7407 tablet_bootstrap.cc:492] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
W20260709 13:15:42.428179  7028 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7f80 after lost signal to thread 7031
I20260709 13:15:42.428714  7407 ts_tablet_manager.cc:1403] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.140s	user 0.032s	sys 0.008s
W20260709 13:15:42.429896  7028 debug-util.cc:398] Leaking SignalData structure 0x7b0800056ea0 after lost signal to thread 7123
W20260709 13:15:42.431319  7028 debug-util.cc:398] Leaking SignalData structure 0x7b0800221820 after lost signal to thread 7198
I20260709 13:15:42.431986  7407 raft_consensus.cc:359] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
W20260709 13:15:42.432821  7028 debug-util.cc:398] Leaking SignalData structure 0x7b08003b45e0 after lost signal to thread 7272
I20260709 13:15:42.432821  7407 raft_consensus.cc:385] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.433482  7407 raft_consensus.cc:740] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.434460  7247 raft_consensus.cc:2468] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:42.434357  7407 consensus_queue.cc:260] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.437143  7407 ts_tablet_manager.cc:1434] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 13:15:42.438493  7407 tablet_bootstrap.cc:492] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.438969  7408 tablet_bootstrap.cc:492] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.439667  7408 ts_tablet_manager.cc:1403] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.007s
I20260709 13:15:42.443778  7409 tablet_bootstrap.cc:492] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.444650  7401 raft_consensus.cc:493] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.443699  7408 raft_consensus.cc:359] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.445168  7401 raft_consensus.cc:3060] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.445197  7408 raft_consensus.cc:385] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.445802  7408 raft_consensus.cc:740] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.446771  7407 tablet_bootstrap.cc:654] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.446624  7408 consensus_queue.cc:260] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.449337  7408 ts_tablet_manager.cc:1434] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:15:42.450531  7408 tablet_bootstrap.cc:492] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:42.444770  7409 ts_tablet_manager.cc:1403] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.007s
I20260709 13:15:42.454245  7401 raft_consensus.cc:515] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.457952  7401 leader_election.cc:290] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.459429  7409 raft_consensus.cc:359] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.460274  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc283d09fea74a5696d6b1cb7838e579" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:42.462929  7401 raft_consensus.cc:493] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.463022  7065 leader_election.cc:343] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.463575  7409 raft_consensus.cc:385] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.463253  7407 tablet_bootstrap.cc:492] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:42.461131  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc283d09fea74a5696d6b1cb7838e579" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:42.463778  7401 raft_consensus.cc:515] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.464414  7247 raft_consensus.cc:3060] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.464059  7408 tablet_bootstrap.cc:654] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.467523  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bcf63f24784b5499c1b6fef935921f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.468348  7173 raft_consensus.cc:2468] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:42.470041  7065 leader_election.cc:304] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:42.471105  7398 raft_consensus.cc:2804] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.471553  7398 raft_consensus.cc:493] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.471930  7398 raft_consensus.cc:3060] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.475270  7247 raft_consensus.cc:2468] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:42.463937  7409 raft_consensus.cc:740] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.464495  7407 ts_tablet_manager.cc:1403] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 13:15:42.481848  7065 leader_election.cc:304] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:42.482251  7409 consensus_queue.cc:260] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.483197  7402 raft_consensus.cc:2804] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.483853  7402 raft_consensus.cc:697] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:42.485683  7409 ts_tablet_manager.cc:1434] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:15:42.484849  7402 consensus_queue.cc:237] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.498808  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bcf63f24784b5499c1b6fef935921f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:42.499863  7247 raft_consensus.cc:2468] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 0.
I20260709 13:15:42.500015  7398 raft_consensus.cc:515] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.501267  7401 leader_election.cc:290] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.507988  7398 leader_election.cc:290] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.508764  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bcf63f24784b5499c1b6fef935921f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:42.512486  7173 raft_consensus.cc:3060] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.512351  7409 tablet_bootstrap.cc:492] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.481822  7407 raft_consensus.cc:359] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.511147  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bcf63f24784b5499c1b6fef935921f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:42.523355  7407 raft_consensus.cc:385] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.523653  7247 raft_consensus.cc:3060] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.524715  7386 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.525310  7386 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.529175  7172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.530057  7172 raft_consensus.cc:2468] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 0.
I20260709 13:15:42.531687  7214 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:42.531353  6997 catalog_manager.cc:5697] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 0 to 1, leader changed from <none> to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.532697  7247 raft_consensus.cc:2468] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:42.533960  7065 leader_election.cc:304] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:42.534183  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:42.534932  7402 raft_consensus.cc:2804] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.523864  7407 raft_consensus.cc:740] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
W20260709 13:15:42.536017  7213 leader_election.cc:343] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.536700  7386 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:42.537283  7386 raft_consensus.cc:2804] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.537859  7386 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.537088  7407 consensus_queue.cc:260] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.538208  7386 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.538674  7409 tablet_bootstrap.cc:654] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.535540  7402 raft_consensus.cc:697] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:42.544866  7402 consensus_queue.cc:237] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.534719  7173 raft_consensus.cc:2468] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:42.549787  7386 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.552588  7407 ts_tablet_manager.cc:1434] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.006s
I20260709 13:15:42.553900  7408 tablet_bootstrap.cc:492] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.555569  7407 tablet_bootstrap.cc:492] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.556635  7408 ts_tablet_manager.cc:1403] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.038s
I20260709 13:15:42.563894  7408 raft_consensus.cc:359] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.567167  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:42.572902  7408 raft_consensus.cc:385] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.573329  7408 raft_consensus.cc:740] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.570668  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
W20260709 13:15:42.574322  7213 leader_election.cc:343] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.574777  7173 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.574404  7408 consensus_queue.cc:260] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.572011  6997 catalog_manager.cc:5697] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 0 to 1, leader changed from <none> to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 1 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.578433  7408 ts_tablet_manager.cc:1434] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 13:15:42.579706  7408 tablet_bootstrap.cc:492] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:42.584671  7407 tablet_bootstrap.cc:654] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.587813  7408 tablet_bootstrap.cc:654] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.571543  7386 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:42.593495  7409 tablet_bootstrap.cc:492] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.594264  7409 ts_tablet_manager.cc:1403] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.030s
I20260709 13:15:42.600466  7173 raft_consensus.cc:2468] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 1.
I20260709 13:15:42.602133  7409 raft_consensus.cc:359] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.604053  7409 raft_consensus.cc:385] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.603924  7214 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: e43bc14318064a41861c1d052983ad2e
I20260709 13:15:42.604467  7409 raft_consensus.cc:740] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.605602  7386 raft_consensus.cc:2804] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.605397  7409 consensus_queue.cc:260] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.609061  7386 raft_consensus.cc:697] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:42.610136  7407 tablet_bootstrap.cc:492] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:42.610821  7407 ts_tablet_manager.cc:1403] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.004s
I20260709 13:15:42.611701  7429 raft_consensus.cc:493] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.611672  7386 consensus_queue.cc:237] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.612500  7429 raft_consensus.cc:515] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.614701  7407 raft_consensus.cc:359] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.615763  7407 raft_consensus.cc:385] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.616114  7407 raft_consensus.cc:740] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.616902  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9f4013a84a468d8d55fb2f6d1b83bd" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:42.619488  7408 tablet_bootstrap.cc:492] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.620164  7408 ts_tablet_manager.cc:1403] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.010s
I20260709 13:15:42.621030  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9f4013a84a468d8d55fb2f6d1b83bd" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.622123  7173 raft_consensus.cc:2468] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 0.
I20260709 13:15:42.623970  7408 raft_consensus.cc:359] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.624297  7214 leader_election.cc:304] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:42.625298  7407 consensus_queue.cc:260] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.627178  7099 raft_consensus.cc:2468] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 0.
I20260709 13:15:42.627872  7429 leader_election.cc:290] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:42.630410  7429 raft_consensus.cc:2804] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.630525  7309 raft_consensus.cc:493] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.630945  7429 raft_consensus.cc:493] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.631565  7429 raft_consensus.cc:3060] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.631218  7309 raft_consensus.cc:515] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.632835  7407 ts_tablet_manager.cc:1434] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:15:42.633318  7408 raft_consensus.cc:385] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.636091  7408 raft_consensus.cc:740] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.639088  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aea51e0974e4579ac931b2af6ff0fe0" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:42.639885  7099 raft_consensus.cc:2468] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:42.640326  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aea51e0974e4579ac931b2af6ff0fe0" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:42.641388  7247 raft_consensus.cc:2468] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:42.643451  7139 leader_election.cc:304] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:42.644804  7403 raft_consensus.cc:2804] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.636341  7309 leader_election.cc:290] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.645548  7403 raft_consensus.cc:493] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.646142  7403 raft_consensus.cc:3060] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.653587  7408 consensus_queue.cc:260] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.659807  6997 catalog_manager.cc:5697] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 0 to 1, leader changed from <none> to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 1 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.666757  7408 ts_tablet_manager.cc:1434] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.008s
I20260709 13:15:42.668735  7408 tablet_bootstrap.cc:492] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
W20260709 13:15:42.673067  7214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.202.2:45387, user_credentials={real_user=slave}} blocked reactor thread for 48922us
I20260709 13:15:42.674556  7407 tablet_bootstrap.cc:492] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.679170  7429 raft_consensus.cc:515] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.689926  7408 tablet_bootstrap.cc:654] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.692745  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9f4013a84a468d8d55fb2f6d1b83bd" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:42.693701  7099 raft_consensus.cc:3060] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.692807  7409 ts_tablet_manager.cc:1434] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.098s	user 0.016s	sys 0.040s
I20260709 13:15:42.699054  7407 tablet_bootstrap.cc:654] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.699164  7409 tablet_bootstrap.cc:492] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.709937  7429 leader_election.cc:290] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:42.710956  7099 raft_consensus.cc:2468] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 1.
I20260709 13:15:42.711248  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9f4013a84a468d8d55fb2f6d1b83bd" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:42.711947  7173 raft_consensus.cc:3060] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.712821  7213 leader_election.cc:304] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:42.710639  7403 raft_consensus.cc:515] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.713333  7409 tablet_bootstrap.cc:654] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.715943  7429 raft_consensus.cc:2804] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.716950  7408 tablet_bootstrap.cc:492] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.717607  7408 ts_tablet_manager.cc:1403] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.002s
I20260709 13:15:42.717959  7429 raft_consensus.cc:697] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:42.719053  7429 consensus_queue.cc:237] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.720651  7408 raft_consensus.cc:359] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.721555  7408 raft_consensus.cc:385] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.721902  7408 raft_consensus.cc:740] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.722759  7408 consensus_queue.cc:260] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.724776  7173 raft_consensus.cc:2468] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 1.
I20260709 13:15:42.726289  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aea51e0974e4579ac931b2af6ff0fe0" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:42.727311  7099 raft_consensus.cc:3060] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.728199  7407 tablet_bootstrap.cc:492] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:42.729151  7407 ts_tablet_manager.cc:1403] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.005s
I20260709 13:15:42.729228  7408 ts_tablet_manager.cc:1434] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:42.731235  7408 tablet_bootstrap.cc:492] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3: Bootstrap starting.
I20260709 13:15:42.731729  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aea51e0974e4579ac931b2af6ff0fe0" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:42.732460  7247 raft_consensus.cc:3060] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.737130  7403 leader_election.cc:290] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.736702  6997 catalog_manager.cc:5697] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 0 to 1, leader changed from <none> to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 1 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.742476  7408 tablet_bootstrap.cc:654] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.742303  7402 raft_consensus.cc:493] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.743518  7409 tablet_bootstrap.cc:492] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.744076  7409 ts_tablet_manager.cc:1403] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.004s
I20260709 13:15:42.743203  7402 raft_consensus.cc:515] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.747145  7402 leader_election.cc:290] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.750802  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.754794  7245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
W20260709 13:15:42.756616  7065 leader_election.cc:343] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:42.757472  7065 leader_election.cc:343] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.757920  7065 leader_election.cc:304] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:42.759231  7402 raft_consensus.cc:2749] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.762202  7247 raft_consensus.cc:2468] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:42.764485  7140 leader_election.cc:304] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:42.766860  7403 raft_consensus.cc:2804] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.767700  7403 raft_consensus.cc:697] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:42.768656  7403 consensus_queue.cc:237] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.770354  7407 raft_consensus.cc:359] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.771433  7407 raft_consensus.cc:385] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.771826  7407 raft_consensus.cc:740] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.772866  7407 consensus_queue.cc:260] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.773393  7409 raft_consensus.cc:359] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.774777  7409 raft_consensus.cc:385] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.775122  7409 raft_consensus.cc:740] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.776073  7409 consensus_queue.cc:260] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.777410  7429 raft_consensus.cc:493] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.777902  7429 raft_consensus.cc:515] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.780289  7429 leader_election.cc:290] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:42.780738  7408 tablet_bootstrap.cc:492] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3: No bootstrap required, opened a new log
I20260709 13:15:42.781395  7408 ts_tablet_manager.cc:1403] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3: Time spent bootstrapping tablet: real 0.050s	user 0.027s	sys 0.015s
I20260709 13:15:42.781304  7097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f91d830f34c448abdb1f81dc7d15444" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:42.782217  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f91d830f34c448abdb1f81dc7d15444" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.782974  7173 raft_consensus.cc:2468] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 0.
W20260709 13:15:42.783214  7213 leader_election.cc:343] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.784439  7214 leader_election.cc:304] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: e43bc14318064a41861c1d052983ad2e
I20260709 13:15:42.785166  7408 raft_consensus.cc:359] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.785727  7429 raft_consensus.cc:2804] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.785933  7408 raft_consensus.cc:385] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.786325  7429 raft_consensus.cc:493] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.786414  7408 raft_consensus.cc:740] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.786908  7429 raft_consensus.cc:3060] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.787089  7099 raft_consensus.cc:2468] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:42.788684  7407 ts_tablet_manager.cc:1434] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.000s
I20260709 13:15:42.787725  7408 consensus_queue.cc:260] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.789912  7407 tablet_bootstrap.cc:492] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.791137  7408 ts_tablet_manager.cc:1434] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:15:42.796708  7407 tablet_bootstrap.cc:654] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.796548  7429 raft_consensus.cc:515] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.803807  7409 ts_tablet_manager.cc:1434] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.002s
I20260709 13:15:42.805925  7409 tablet_bootstrap.cc:492] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba: Bootstrap starting.
I20260709 13:15:42.807699  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f91d830f34c448abdb1f81dc7d15444" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:42.808140  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f91d830f34c448abdb1f81dc7d15444" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:42.808971  7173 raft_consensus.cc:3060] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:42.810088  7213 leader_election.cc:343] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.816138  7402 consensus_queue.cc:1048] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.828583  7402 consensus_queue.cc:1048] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.831985  7173 raft_consensus.cc:2468] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 1.
I20260709 13:15:42.834941  7214 leader_election.cc:304] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: e43bc14318064a41861c1d052983ad2e
I20260709 13:15:42.836308  7436 raft_consensus.cc:2804] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.836869  7436 raft_consensus.cc:697] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:42.837853  7436 consensus_queue.cc:237] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.840345  7386 raft_consensus.cc:493] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.840962  7386 raft_consensus.cc:515] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.843330  7386 leader_election.cc:290] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:42.843676  6993 catalog_manager.cc:5697] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.844798  7409 tablet_bootstrap.cc:654] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.845348  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9993f636c9a45ff883a4d3075e649ed" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:42.848516  7099 raft_consensus.cc:2468] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 0.
I20260709 13:15:42.850071  7213 leader_election.cc:304] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:42.846509  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9993f636c9a45ff883a4d3075e649ed" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.851269  7435 raft_consensus.cc:2804] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.851490  7173 raft_consensus.cc:2468] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 0.
I20260709 13:15:42.851759  7435 raft_consensus.cc:493] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.852267  7435 raft_consensus.cc:3060] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.846791  7407 tablet_bootstrap.cc:492] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:42.855147  7407 ts_tablet_manager.cc:1403] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.017s
I20260709 13:15:42.858433  7407 raft_consensus.cc:359] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.860816  7429 leader_election.cc:290] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:42.863716  7409 tablet_bootstrap.cc:492] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba: No bootstrap required, opened a new log
I20260709 13:15:42.874467  7409 ts_tablet_manager.cc:1403] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.007s
I20260709 13:15:42.877661  7409 raft_consensus.cc:359] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.878460  7409 raft_consensus.cc:385] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.878738  7409 raft_consensus.cc:740] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.879441  7409 consensus_queue.cc:260] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.880440  7407 raft_consensus.cc:385] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.880767  7407 raft_consensus.cc:740] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.882563  7407 consensus_queue.cc:260] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.887903  7409 ts_tablet_manager.cc:1434] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:15:42.888732  7403 raft_consensus.cc:493] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.889326  7403 raft_consensus.cc:515] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.891782  7403 leader_election.cc:290] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.893941  7407 ts_tablet_manager.cc:1434] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:15:42.895102  7407 tablet_bootstrap.cc:492] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e: Bootstrap starting.
I20260709 13:15:42.892828  7435 raft_consensus.cc:515] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.904829  7097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9993f636c9a45ff883a4d3075e649ed" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:42.905525  7097 raft_consensus.cc:3060] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.907792  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9993f636c9a45ff883a4d3075e649ed" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:42.908489  7173 raft_consensus.cc:3060] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.913480  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc283d09fea74a5696d6b1cb7838e579" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:42.917716  7173 raft_consensus.cc:2468] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 1.
I20260709 13:15:42.918746  7435 leader_election.cc:290] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:42.919001  7402 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.919698  7402 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.921065  7214 leader_election.cc:304] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:42.922456  7402 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.920254  7407 tablet_bootstrap.cc:654] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.926709  7097 raft_consensus.cc:2468] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 1.
I20260709 13:15:42.929420  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc283d09fea74a5696d6b1cb7838e579" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:42.931267  7247 raft_consensus.cc:2393] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ce1c22402c4b91844372d1b9ba67b3 in current term 1: Already voted for candidate e43bc14318064a41861c1d052983ad2e in this term.
I20260709 13:15:42.932767  7436 raft_consensus.cc:2804] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.938519  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:42.940879  7436 raft_consensus.cc:697] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:42.943593  7436 consensus_queue.cc:237] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.932852  7140 leader_election.cc:304] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3; no voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e
I20260709 13:15:42.940102  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.946432  7173 raft_consensus.cc:2393] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e43bc14318064a41861c1d052983ad2e in current term 1: Already voted for candidate 14c4cd7930244b0fb0af262aba6bedba in this term.
I20260709 13:15:42.947448  7403 raft_consensus.cc:3060] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.951977  7065 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:42.954794  7401 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.959571  7403 raft_consensus.cc:2749] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.968390  7401 raft_consensus.cc:2749] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.969214  7402 consensus_queue.cc:1048] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.972151  7407 tablet_bootstrap.cc:492] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e: No bootstrap required, opened a new log
I20260709 13:15:42.972702  7407 ts_tablet_manager.cc:1403] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.003s
I20260709 13:15:42.976039  7407 raft_consensus.cc:359] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.976666  7407 raft_consensus.cc:385] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.976917  7407 raft_consensus.cc:740] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.977692  7407 consensus_queue.cc:260] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.980607  6997 catalog_manager.cc:5697] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 0 to 1, leader changed from <none> to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 1 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.984689  6997 catalog_manager.cc:5697] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 0 to 1, leader changed from <none> to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 1 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.988190  7407 ts_tablet_manager.cc:1434] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:15:42.989952  7401 raft_consensus.cc:493] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.990527  7401 raft_consensus.cc:515] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:42.992697  7401 leader_election.cc:290] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:42.997741  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f91d830f34c448abdb1f81dc7d15444" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:42.998792  7174 raft_consensus.cc:2393] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e43bc14318064a41861c1d052983ad2e in current term 1: Already voted for candidate 14c4cd7930244b0fb0af262aba6bedba in this term.
I20260709 13:15:43.001633  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f91d830f34c448abdb1f81dc7d15444" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:43.003674  7065 leader_election.cc:304] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:43.003708  7327 consensus_queue.cc:1048] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.005610  7401 raft_consensus.cc:3060] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.019110  7401 raft_consensus.cc:2749] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.068868  7436 consensus_queue.cc:1048] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.081949  7436 consensus_queue.cc:1048] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.105083  7403 raft_consensus.cc:493] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.105598  7403 raft_consensus.cc:515] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.108692  7401 consensus_queue.cc:1048] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.109118  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:43.109328  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:43.110038  7099 raft_consensus.cc:2468] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:43.110100  7248 raft_consensus.cc:2468] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 0.
I20260709 13:15:43.111131  7403 leader_election.cc:290] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:43.112128  7140 leader_election.cc:304] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:43.113144  7403 raft_consensus.cc:2804] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.113552  7403 raft_consensus.cc:493] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.113897  7403 raft_consensus.cc:3060] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.123029  7403 raft_consensus.cc:515] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.128738  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:43.129434  7099 raft_consensus.cc:3060] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.130287  7436 consensus_queue.cc:1048] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.132001  7327 consensus_queue.cc:1048] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.136426  7403 leader_election.cc:290] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:43.137320  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:43.137961  7248 raft_consensus.cc:3060] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.145303  7099 raft_consensus.cc:2468] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:43.146839  7139 leader_election.cc:304] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:43.148176  7309 raft_consensus.cc:2804] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.148674  7309 raft_consensus.cc:697] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:43.149593  7309 consensus_queue.cc:237] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.153160  7248 raft_consensus.cc:2468] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 1.
I20260709 13:15:43.182191  6995 catalog_manager.cc:5697] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 1 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.183054  7436 consensus_queue.cc:1048] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.236689  7436 consensus_queue.cc:1048] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.247468  7429 consensus_queue.cc:1048] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.276958  7403 consensus_queue.cc:1048] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.304913  7403 consensus_queue.cc:1048] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:43.340629  7247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9993f636c9a45ff883a4d3075e649ed"
dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
mode: GRACEFUL
new_leader_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:40268
I20260709 13:15:43.342916  7247 raft_consensus.cc:606] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Received request to transfer leadership to TS e43bc14318064a41861c1d052983ad2e
I20260709 13:15:43.349776  7247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e9f4013a84a468d8d55fb2f6d1b83bd"
dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
mode: GRACEFUL
new_leader_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:40268
I20260709 13:15:43.350523  7247 raft_consensus.cc:606] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Received request to transfer leadership to TS e43bc14318064a41861c1d052983ad2e
I20260709 13:15:43.359886  7247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae"
dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
mode: GRACEFUL
new_leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:40268
I20260709 13:15:43.360652  7247 raft_consensus.cc:606] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Received request to transfer leadership to TS 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:43.367707  7099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bcf63f24784b5499c1b6fef935921f"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
mode: GRACEFUL
new_leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45494
I20260709 13:15:43.368477  7099 raft_consensus.cc:606] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Received request to transfer leadership to TS 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:43.378302  7429 consensus_queue.cc:1048] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.392330  7435 consensus_queue.cc:1048] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.409543  7435 raft_consensus.cc:993] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba: : Instructing follower e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:43.410068  7435 raft_consensus.cc:1081] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Signalling peer e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:43.412168  7099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9993f636c9a45ff883a4d3075e649ed"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:45486
I20260709 13:15:43.412949  7099 raft_consensus.cc:493] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:43.413447  7099 raft_consensus.cc:3060] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.420077  7099 raft_consensus.cc:515] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.422376  7099 leader_election.cc:290] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:43.423930  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9993f636c9a45ff883a4d3075e649ed" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:43.424237  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9993f636c9a45ff883a4d3075e649ed" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:43.424650  7173 raft_consensus.cc:3060] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.425122  7247 raft_consensus.cc:3055] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.425546  7247 raft_consensus.cc:740] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:43.426636  7247 consensus_queue.cc:260] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.428073  7247 raft_consensus.cc:3060] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.439739  7173 raft_consensus.cc:2468] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:43.439787  7247 raft_consensus.cc:2468] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:43.441599  7065 leader_election.cc:304] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:43.442545  7401 raft_consensus.cc:2804] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.443027  7401 raft_consensus.cc:697] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:43.443842  7401 consensus_queue.cc:237] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.459372  6995 catalog_manager.cc:5697] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 1 to 2, leader changed from 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3) to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 2 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.552445  7466 consensus_queue.cc:1048] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.553884  7386 raft_consensus.cc:993] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba: : Instructing follower 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:43.554546  7386 raft_consensus.cc:1081] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Signalling peer 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:43.556953  7173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45252
I20260709 13:15:43.557665  7173 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:43.558089  7173 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.569336  7403 consensus_queue.cc:1048] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.571561  7173 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.575070  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:43.575778  7099 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.579073  7173 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:43.580971  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:43.581795  7248 raft_consensus.cc:3055] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.582150  7248 raft_consensus.cc:740] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:43.583148  7248 consensus_queue.cc:260] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.583885  7099 raft_consensus.cc:2468] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:43.584671  7248 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.585348  7139 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:43.586359  7403 raft_consensus.cc:2804] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.588842  7403 raft_consensus.cc:697] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:43.589802  7403 consensus_queue.cc:237] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.599538  7248 raft_consensus.cc:2468] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:43.602931  6995 catalog_manager.cc:5697] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 1 to 2, leader changed from 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3) to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.725600  7401 raft_consensus.cc:993] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e: : Instructing follower 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:43.726066  7402 raft_consensus.cc:1081] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Signalling peer 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:43.728003  7173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1bcf63f24784b5499c1b6fef935921f"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45244
I20260709 13:15:43.728477  7173 raft_consensus.cc:493] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:43.728828  7173 raft_consensus.cc:3060] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.732762  7386 raft_consensus.cc:993] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba: : Instructing follower e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:43.733434  7386 raft_consensus.cc:1081] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Signalling peer e43bc14318064a41861c1d052983ad2e to start an election
I20260709 13:15:43.735415  7099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e9f4013a84a468d8d55fb2f6d1b83bd"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
 from {username='slave'} at 127.0.0.1:45486
I20260709 13:15:43.736001  7099 raft_consensus.cc:493] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:43.736368  7099 raft_consensus.cc:3060] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.736243  7173 raft_consensus.cc:515] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.739183  7097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bcf63f24784b5499c1b6fef935921f" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:43.739802  7097 raft_consensus.cc:3055] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.740141  7097 raft_consensus.cc:740] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:43.740453  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bcf63f24784b5499c1b6fef935921f" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:43.741237  7248 raft_consensus.cc:3060] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.740942  7097 consensus_queue.cc:260] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.742308  7097 raft_consensus.cc:3060] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.743939  7099 raft_consensus.cc:515] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.749183  7173 leader_election.cc:290] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:43.750180  7097 raft_consensus.cc:2468] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:43.750561  7248 raft_consensus.cc:2468] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:43.751569  7139 leader_election.cc:304] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:43.752550  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9f4013a84a468d8d55fb2f6d1b83bd" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:43.752581  7403 raft_consensus.cc:2804] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.753808  7173 raft_consensus.cc:3060] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.753947  7403 raft_consensus.cc:697] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:43.754339  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e9f4013a84a468d8d55fb2f6d1b83bd" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:43.755052  7248 raft_consensus.cc:3055] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.755491  7248 raft_consensus.cc:740] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:43.754990  7403 consensus_queue.cc:237] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.753227  7099 leader_election.cc:290] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:43.762002  7248 consensus_queue.cc:260] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.762943  7173 raft_consensus.cc:2468] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:43.763471  7248 raft_consensus.cc:3060] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.764459  7065 leader_election.cc:304] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:43.764129  6997 catalog_manager.cc:5697] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 1 to 2, leader changed from e43bc14318064a41861c1d052983ad2e (127.26.202.1) to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 2 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.765733  7402 raft_consensus.cc:2804] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.766410  7402 raft_consensus.cc:697] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:43.767392  7402 consensus_queue.cc:237] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:43.775976  7248 raft_consensus.cc:2468] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:43.780761  6995 catalog_manager.cc:5697] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 1 to 2, leader changed from 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3) to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 2 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.833882  7248 raft_consensus.cc:1275] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:43.835347  7402 consensus_queue.cc:1048] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:43.846238  7173 raft_consensus.cc:1275] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:43.847981  7402 consensus_queue.cc:1048] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.088688  7097 raft_consensus.cc:1275] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:44.088965  7248 raft_consensus.cc:1275] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:44.090837  7403 consensus_queue.cc:1048] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.091576  7465 consensus_queue.cc:1048] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.186249  7099 raft_consensus.cc:1275] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:44.187579  7465 consensus_queue.cc:1048] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.197220  7248 raft_consensus.cc:1275] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:44.198925  7466 consensus_queue.cc:1048] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.250029  7248 raft_consensus.cc:1275] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:44.251246  7402 consensus_queue.cc:1048] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.264833  7173 raft_consensus.cc:1275] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:44.266610  7398 consensus_queue.cc:1048] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:46.412029  6995 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34624:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:15:47.549654  7482 raft_consensus.cc:493] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.550544  7482 raft_consensus.cc:515] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.555976  7482 leader_election.cc:290] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.556623  7485 raft_consensus.cc:493] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e43bc14318064a41861c1d052983ad2e)
I20260709 13:15:47.557379  7485 raft_consensus.cc:515] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.559810  7485 leader_election.cc:290] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.568261  7478 raft_consensus.cc:493] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e43bc14318064a41861c1d052983ad2e)
I20260709 13:15:47.568797  7478 raft_consensus.cc:515] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.570955  7478 leader_election.cc:290] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.574337  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:47.586071  7483 raft_consensus.cc:493] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.586640  7483 raft_consensus.cc:515] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.592244  7483 leader_election.cc:290] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.593427  7483 raft_consensus.cc:493] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.594055  7483 raft_consensus.cc:515] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.596982  7486 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.597636  7486 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.598073  7483 leader_election.cc:290] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.598387  7093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:47.599851  7486 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.597083  7172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:47.600482  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:47.601469  7098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:47.591495  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:47.608088  7246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:47.608875  7246 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 2.
I20260709 13:15:47.610284  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:47.610914  7242 raft_consensus.cc:2468] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:47.611613  7246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:47.611750  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7374b52bef457387ca7baaaeb0c05d" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:47.612327  7246 raft_consensus.cc:2468] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 1.
I20260709 13:15:47.613147  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:47.613842  7242 raft_consensus.cc:2468] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:47.615916  7140 leader_election.cc:304] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: e43bc14318064a41861c1d052983ad2e
I20260709 13:15:47.619732  7244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:47.621169  7485 raft_consensus.cc:2804] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.621379  7065 leader_election.cc:304] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:47.621716  7485 raft_consensus.cc:493] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e43bc14318064a41861c1d052983ad2e)
I20260709 13:15:47.622217  7485 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.622295  7398 raft_consensus.cc:2804] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.622800  7398 raft_consensus.cc:493] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.623144  7398 raft_consensus.cc:3060] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.624575  7065 leader_election.cc:304] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:47.625317  7487 raft_consensus.cc:493] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 14c4cd7930244b0fb0af262aba6bedba)
I20260709 13:15:47.625818  7140 leader_election.cc:304] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3; no voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e
I20260709 13:15:47.627259  7488 raft_consensus.cc:2749] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.634758  7485 raft_consensus.cc:515] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.625926  7487 raft_consensus.cc:515] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.638140  7484 raft_consensus.cc:2749] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.640595  7485 leader_election.cc:290] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 3 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.639012  7065 leader_election.cc:304] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:47.643379  7484 raft_consensus.cc:2804] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.643567  7495 raft_consensus.cc:493] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.639587  7492 raft_consensus.cc:493] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.662876  7492 raft_consensus.cc:515] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.644075  7484 raft_consensus.cc:493] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.665288  7484 raft_consensus.cc:3060] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.646056  7487 leader_election.cc:290] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.647746  7065 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:47.673900  7486 raft_consensus.cc:2804] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.674360  7486 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:47.674721  7486 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.636250  7398 raft_consensus.cc:515] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.657793  7240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f91d830f34c448abdb1f81dc7d15444" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:47.661875  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:47.683377  7492 leader_election.cc:290] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.683069  6995 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34624:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:15:47.686460  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:47.690201  7099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:47.690603  7094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f91d830f34c448abdb1f81dc7d15444" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:47.692716  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:47.681104  7495 raft_consensus.cc:515] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.697901  7094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aea51e0974e4579ac931b2af6ff0fe0" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:47.698887  7398 leader_election.cc:290] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.706488  7495 leader_election.cc:290] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:47.700555  7172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:47.705268  7486 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.706717  7065 leader_election.cc:304] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:47.708928  7398 raft_consensus.cc:2749] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.700173  7484 raft_consensus.cc:515] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.710572  7097 raft_consensus.cc:1240] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Rejecting Update request from peer 74ce1c22402c4b91844372d1b9ba67b3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.712359  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:47.713593  7484 leader_election.cc:290] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.714843  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:47.715090  7065 leader_election.cc:304] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:47.715484  7248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:47.716321  7139 leader_election.cc:304] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3; no voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e
I20260709 13:15:47.717155  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:47.717609  7139 leader_election.cc:304] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3; no voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e
I20260709 13:15:47.713794  7486 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:47.718524  7496 raft_consensus.cc:2749] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.719485  7487 consensus_queue.cc:1059] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:47.719731  7065 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:47.720455  7496 raft_consensus.cc:3055] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.720795  7492 raft_consensus.cc:2749] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.720793  7496 raft_consensus.cc:740] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:47.721189  7484 raft_consensus.cc:2749] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.716543  7172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ed386c7554a69978c87513ae1070c" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:47.721998  7496 consensus_queue.cc:260] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.727849  7174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aea51e0974e4579ac931b2af6ff0fe0" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:47.723910  7485 raft_consensus.cc:2749] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.730976  7496 raft_consensus.cc:3060] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.747812  7214 leader_election.cc:304] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba; no voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e
I20260709 13:15:47.756366  7494 raft_consensus.cc:2749] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:47.786000  7157 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45238: Illegal state: replica 74ce1c22402c4b91844372d1b9ba67b3 is not leader of this config: current role FOLLOWER
W20260709 13:15:47.792064  6984 catalog_manager.cc:5107] TS 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387): alter failed for tablet 333ed386c7554a69978c87513ae1070c (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]): Illegal state: replica 74ce1c22402c4b91844372d1b9ba67b3 is not leader of this config: current role FOLLOWER
I20260709 13:15:47.802573  6995 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34624 (request call id 38) took 1387 ms. Trace:
I20260709 13:15:47.845697  7519 tablet.cc:1724] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:47.848007  7172 raft_consensus.cc:2468] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
W20260709 13:15:47.874490  7028 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1ae0 after lost signal to thread 27435
W20260709 13:15:47.875756  7028 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0740 after lost signal to thread 7031
W20260709 13:15:47.878013  7028 debug-util.cc:398] Leaking SignalData structure 0x7b0800065f20 after lost signal to thread 7123
W20260709 13:15:47.879974  7028 debug-util.cc:398] Leaking SignalData structure 0x7b0800267280 after lost signal to thread 7198
W20260709 13:15:47.884470  7028 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6660 after lost signal to thread 7272
W20260709 13:15:47.884859  7028 debug-util.cc:398] Leaking SignalData structure 0x7b080032fd60 after lost signal to thread 7327
W20260709 13:15:47.885108  7028 debug-util.cc:398] Leaking SignalData structure 0x7b0800138fc0 after lost signal to thread 7386
I20260709 13:15:47.883683  7524 tablet.cc:1724] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:47.806231  6995 rpcz_store.cc:276] 0709 13:15:46.411528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.411675 (+   147us) service_pool.cc:224] Handling call
0709 13:15:46.412887 (+  1212us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 13:15:47.109518 (+696631us) catalog_manager.cc:2608] Modifying in-memory table state
0709 13:15:47.109702 (+   184us) catalog_manager.cc:2619] Locking tablets
0709 13:15:47.552208 (+442506us) catalog_manager.cc:2632] Updating table and tablets from system table
0709 13:15:47.595652 (+ 43444us) catalog_manager.cc:2648] Moving table from normal map to soft_deleted map
0709 13:15:47.595708 (+    56us) catalog_manager.cc:7250] Moving table from normalized table map to soft_deleted table map.
0709 13:15:47.596793 (+  1085us) catalog_manager.cc:2657] Committing in-memory state
0709 13:15:47.682927 (+ 86134us) catalog_manager.cc:2661] Disable compaction for soft-deleted table
0709 13:15:47.684072 (+  1145us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 13:15:47.698670 (+ 14598us) catalog_manager.cc:3751] Apply alter schema
0709 13:15:47.699608 (+   938us) catalog_manager.cc:3870] Apply alter extra-config
0709 13:15:47.700009 (+   401us) catalog_manager.cc:3941] Updating metadata on disk
0709 13:15:47.714652 (+ 14643us) catalog_manager.cc:3972] Committing alterations to in-memory state
0709 13:15:47.769361 (+ 54709us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4c00197a40. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a260e2a20 00007f4a260f3a29 00007f4a260f413f 00007f4a260b82ab 00007f4a260e5f3c 00007f4a260e63fe 00007f4a2626ecdb 00007f4a2dc21816 00007f4a2dbc5f50 00007f4a2dbc1378 00007f4a2dbbef65
0709 13:15:47.798409 (+ 29048us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:47.576140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:47.576686 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:47.576709 (+    23us) write_op.cc:435] Acquired schema lock
0709 13:15:47.576720 (+    11us) tablet.cc:662] Decoding operations
0709 13:15:47.577711 (+   991us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:47.577791 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:47.577816 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:15:47.578654 (+   838us) tablet.cc:701] Row locks acquired
0709 13:15:47.578677 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:15:47.578818 (+   141us) write_op.cc:270] Start()
0709 13:15:47.578934 (+   116us) write_op.cc:276] Timestamp: P: 1783602947578766 usec, L: 0
0709 13:15:47.578981 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:15:47.579623 (+   642us) log.cc:844] Serialized 3940 byte log entry
0709 13:15:47.584317 (+  4694us) op_driver.cc:464] REPLICATION: finished
0709 13:15:47.592358 (+  8041us) write_op.cc:301] APPLY: starting
0709 13:15:47.592461 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:47.592679 (+   218us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:47.592807 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:47.593707 (+   900us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:47.593933 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:15:47.593977 (+    44us) write_op.cc:312] APPLY: finished
0709 13:15:47.594277 (+   300us) log.cc:844] Serialized 76 byte log entry
0709 13:15:47.594454 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.594603 (+   149us) write_op.cc:454] Released schema lock
0709 13:15:47.594660 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:47.595206 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.595238 (+    32us) write_op.cc:454] Released schema lock
Related trace 'op':
0709 13:15:47.703503 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:47.704072 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:47.704106 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:15:47.704128 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:47.704448 (+   320us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:47.704513 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:47.704545 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:47.704730 (+   185us) tablet.cc:701] Row locks acquired
0709 13:15:47.704741 (+    11us) write_op.cc:260] PREPARE: finished
0709 13:15:47.704842 (+   101us) write_op.cc:270] Start()
0709 13:15:47.704955 (+   113us) write_op.cc:276] Timestamp: P: 1783602947704810 usec, L: 0
0709 13:15:47.704978 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:47.705638 (+   660us) log.cc:844] Serialized 503 byte log entry
0709 13:15:47.707997 (+  2359us) op_driver.cc:464] REPLICATION: finished
0709 13:15:47.709228 (+  1231us) write_op.cc:301] APPLY: starting
0709 13:15:47.710707 (+  1479us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:47.710814 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:47.710913 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:47.711116 (+   203us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:47.711282 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:47.711340 (+    58us) write_op.cc:312] APPLY: finished
0709 13:15:47.711531 (+   191us) log.cc:844] Serialized 22 byte log entry
0709 13:15:47.714266 (+  2735us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.714365 (+    99us) write_op.cc:454] Released schema lock
0709 13:15:47.714409 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:47.719318 (+  4909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.719353 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12916,"spinlock_wait_cycles":4582016,"child_traces":[["op",{"apply.queue_time_us":5974,"apply.run_cpu_time_us":2665,"apply.run_wall_time_us":2670,"num_ops":10,"prepare.queue_time_us":4989,"prepare.run_cpu_time_us":4742,"prepare.run_wall_time_us":4743,"raft.queue_time_us":1260,"raft.run_cpu_time_us":5008,"raft.run_wall_time_us":21322,"replication_time_us":5179,"thread_start_us":15751,"threads_started":4,"wal-append.queue_time_us":1181}],["op",{"apply.queue_time_us":991,"apply.run_cpu_time_us":1576,"apply.run_wall_time_us":10022,"num_ops":1,"prepare.queue_time_us":351,"prepare.run_cpu_time_us":2424,"prepare.run_wall_time_us":2424,"replication_time_us":2775}]]}
W20260709 13:15:47.905063  7513 log.cc:927] Time spent T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 13:15:47.905616  7097 raft_consensus.cc:1240] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Rejecting Update request from peer 74ce1c22402c4b91844372d1b9ba67b3 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:15:47.914664 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:47.915377  7162 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45238: Illegal state: replica 74ce1c22402c4b91844372d1b9ba67b3 is not leader of this config: current role FOLLOWER
I20260709 13:15:47.916714  7065 leader_election.cc:304] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:47.919957  7485 consensus_queue.cc:1059] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:15:47.924110  7484 raft_consensus.cc:2804] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:47.924710  7496 raft_consensus.cc:3055] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:47.925161  7496 raft_consensus.cc:740] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:47.925236  7484 raft_consensus.cc:697] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:47.926301  7496 consensus_queue.cc:260] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:47.926594  7523 tablet.cc:1724] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:47.927629  7496 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.926470  7484 consensus_queue.cc:237] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
W20260709 13:15:47.944976  7517 log.cc:927] Time spent T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:15:48.028781  7535 tablet.cc:1724] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.035411  7533 tablet.cc:1724] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.036553  7532 tablet.cc:1724] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.035801  7528 tablet.cc:1724] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:48.053452  7162 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45238: Illegal state: replica 74ce1c22402c4b91844372d1b9ba67b3 is not leader of this config: current role FOLLOWER
I20260709 13:15:48.079236  7541 tablet.cc:1724] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.100639  7524 tablet.cc:1724] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.119421  7524 tablet.cc:1724] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.168654  7548 tablet.cc:1724] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:48.178551  7162 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45238: Illegal state: replica 74ce1c22402c4b91844372d1b9ba67b3 is not leader of this config: current role FOLLOWER
I20260709 13:15:48.186815  6993 catalog_manager.cc:5697] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 1 to 2, leader changed from 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2) to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 2 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.191797  6993 catalog_manager.cc:5789] TS e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959) does not have the latest schema for tablet 333ed386c7554a69978c87513ae1070c (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:48.164377  7523 tablet.cc:1724] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.212507  7546 tablet.cc:1724] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:15:48.194999  7140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.202.3:44961, user_credentials={real_user=slave}} blocked reactor thread for 60445.2us
I20260709 13:15:48.286782  7547 tablet.cc:1724] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.307178  7545 tablet.cc:1724] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.316021  7094 raft_consensus.cc:1240] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Rejecting Update request from peer 74ce1c22402c4b91844372d1b9ba67b3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:48.320353  7171 raft_consensus.cc:1240] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Rejecting Update request from peer e43bc14318064a41861c1d052983ad2e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:48.299832  7519 tablet.cc:1724] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.330078  7492 consensus_queue.cc:1059] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:48.331172  7492 raft_consensus.cc:3055] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:48.331599  7492 raft_consensus.cc:740] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:48.331267  7532 tablet.cc:1724] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.335677  7528 tablet.cc:1724] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.338989  7550 consensus_queue.cc:1059] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:48.333176  7492 consensus_queue.cc:260] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:48.340792  7535 tablet.cc:1724] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.342073  7488 raft_consensus.cc:3055] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:48.342295  7492 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.342497  7488 raft_consensus.cc:740] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:48.344007  7488 consensus_queue.cc:260] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:48.348169  7488 raft_consensus.cc:3060] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:48.356849  7162 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45238: Illegal state: replica 74ce1c22402c4b91844372d1b9ba67b3 is not leader of this config: current role FOLLOWER
I20260709 13:15:48.308396  7548 tablet.cc:1724] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.375154  7547 tablet.cc:1724] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.382169  7097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
mode: GRACEFUL
new_leader_uuid: "14c4cd7930244b0fb0af262aba6bedba"
 from {username='slave'} at 127.0.0.1:37988
I20260709 13:15:48.383105  7097 raft_consensus.cc:606] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Received request to transfer leadership to TS 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:48.415984  7247 raft_consensus.cc:3060] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.420912  7173 raft_consensus.cc:1275] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:48.422786  7398 consensus_queue.cc:1048] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.432528  7247 raft_consensus.cc:1275] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:48.435165  7398 consensus_queue.cc:1048] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.443444  7173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
mode: GRACEFUL
new_leader_uuid: "14c4cd7930244b0fb0af262aba6bedba"
 from {username='slave'} at 127.0.0.1:40898
I20260709 13:15:48.444147  7173 raft_consensus.cc:606] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Received request to transfer leadership to TS 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:48.447189  6993 catalog_manager.cc:5789] TS 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387) does not have the latest schema for tablet 333ed386c7554a69978c87513ae1070c (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:48.452587 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:48.453346 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:48.455929  6995 catalog_manager.cc:5789] TS 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387) does not have the latest schema for tablet 333ed386c7554a69978c87513ae1070c (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:48.466499  6993 catalog_manager.cc:5789] TS e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959) does not have the latest schema for tablet 333ed386c7554a69978c87513ae1070c (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:48.470933  6995 catalog_manager.cc:5789] TS 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961) does not have the latest schema for tablet 333ed386c7554a69978c87513ae1070c (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:48.479701  6995 catalog_manager.cc:5789] TS e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959) does not have the latest schema for tablet 333ed386c7554a69978c87513ae1070c (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:48.482506  6993 catalog_manager.cc:5789] TS 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961) does not have the latest schema for tablet 333ed386c7554a69978c87513ae1070c (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:48.617718  7484 raft_consensus.cc:993] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e: : Instructing follower 14c4cd7930244b0fb0af262aba6bedba to start an election
I20260709 13:15:48.618423  7398 raft_consensus.cc:1081] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Signalling peer 14c4cd7930244b0fb0af262aba6bedba to start an election
I20260709 13:15:48.620177  7247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d"
dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
 from {username='slave'} at 127.0.0.1:40266
I20260709 13:15:48.620682  7247 raft_consensus.cc:493] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.620988  7247 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.627803  7247 raft_consensus.cc:515] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:48.630975  7097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:48.631287  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69f955f19cbc40f7a28d0309253d013d" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:48.631639  7097 raft_consensus.cc:3055] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:48.631994  7097 raft_consensus.cc:740] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:48.632318  7247 leader_election.cc:290] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:48.632949  7097 consensus_queue.cc:260] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:48.631913  7173 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.636550  7097 raft_consensus.cc:3060] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.641876  7173 raft_consensus.cc:2468] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 3.
I20260709 13:15:48.644449  7214 leader_election.cc:304] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:48.645813  7498 raft_consensus.cc:2804] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:48.646323  7498 raft_consensus.cc:697] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 3 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:48.647209  7498 consensus_queue.cc:237] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:48.647753  7528 tablet.cc:1724] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.651832  7097 raft_consensus.cc:2468] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 3.
I20260709 13:15:48.658702  7548 tablet.cc:1724] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.678475  7535 tablet.cc:1724] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:48.686807  7488 raft_consensus.cc:993] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3: : Instructing follower 14c4cd7930244b0fb0af262aba6bedba to start an election
I20260709 13:15:48.687297  7488 raft_consensus.cc:1081] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Signalling peer 14c4cd7930244b0fb0af262aba6bedba to start an election
I20260709 13:15:48.690775  7247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2"
dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
 from {username='slave'} at 127.0.0.1:40262
I20260709 13:15:48.690037  6993 catalog_manager.cc:5697] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 2 to 3, leader changed from e43bc14318064a41861c1d052983ad2e (127.26.202.1) to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 3 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.691465  7247 raft_consensus.cc:493] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.691931  7247 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.701000  7247 raft_consensus.cc:515] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:48.703531  7247 leader_election.cc:290] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:48.703780  7097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:48.704860  7097 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.705695  7171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa8aa2a6d2a4932933904a51ae6b0e2" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:48.706450  7171 raft_consensus.cc:3055] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:48.706786  7171 raft_consensus.cc:740] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:48.707717  7171 consensus_queue.cc:260] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:48.709233  7171 raft_consensus.cc:3060] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.712842  7097 raft_consensus.cc:2468] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 3.
I20260709 13:15:48.714553  7213 leader_election.cc:304] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:48.715945  7498 raft_consensus.cc:2804] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:48.716449  7498 raft_consensus.cc:697] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 3 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:48.717397  7171 raft_consensus.cc:2468] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 3.
I20260709 13:15:48.717320  7498 consensus_queue.cc:237] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:48.730719  6993 catalog_manager.cc:5697] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 2 to 3, leader changed from 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2) to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 3 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:49.126838  7097 raft_consensus.cc:1275] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Refusing update from remote peer 14c4cd7930244b0fb0af262aba6bedba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:49.128650  7494 consensus_queue.cc:1048] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:49.130056  7097 raft_consensus.cc:1275] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Refusing update from remote peer 14c4cd7930244b0fb0af262aba6bedba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:49.131414  7494 consensus_queue.cc:1048] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:49.146112  7171 raft_consensus.cc:1275] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Refusing update from remote peer 14c4cd7930244b0fb0af262aba6bedba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:49.148738  7564 consensus_queue.cc:1048] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:49.156507  7173 raft_consensus.cc:1275] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Refusing update from remote peer 14c4cd7930244b0fb0af262aba6bedba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:49.158183  7564 consensus_queue.cc:1048] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:49.362624  7566 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:49.363200  7566 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.365365  7566 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:49.366231  7094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:49.366591  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:49.367235  7094 raft_consensus.cc:2393] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14c4cd7930244b0fb0af262aba6bedba in current term 3: Already voted for candidate e43bc14318064a41861c1d052983ad2e in this term.
I20260709 13:15:49.367192  7173 raft_consensus.cc:2468] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 3.
I20260709 13:15:49.368445  7214 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:49.369120  7566 raft_consensus.cc:2804] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.369477  7566 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:49.369717  7566 raft_consensus.cc:3060] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.372817  7398 raft_consensus.cc:493] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.373458  7398 raft_consensus.cc:515] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.375600  7398 leader_election.cc:290] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:49.376215  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:49.376535  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:49.376950  7173 raft_consensus.cc:2468] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 2.
I20260709 13:15:49.376695  7566 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.378154  7065 leader_election.cc:304] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:49.378933  7566 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:49.379283  7398 raft_consensus.cc:2804] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.379541  7094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:49.379750  7398 raft_consensus.cc:493] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.379824  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:49.380205  7398 raft_consensus.cc:3060] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.380395  7094 raft_consensus.cc:2393] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 14c4cd7930244b0fb0af262aba6bedba in current term 3: Already voted for candidate e43bc14318064a41861c1d052983ad2e in this term.
I20260709 13:15:49.386744  7173 raft_consensus.cc:2468] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14c4cd7930244b0fb0af262aba6bedba in term 3.
I20260709 13:15:49.386771  7398 raft_consensus.cc:515] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.388120  7214 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: e43bc14318064a41861c1d052983ad2e
I20260709 13:15:49.389484  7566 raft_consensus.cc:2804] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:49.389649  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:49.390070  7566 raft_consensus.cc:697] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 3 LEADER]: Becoming Leader. State: Replica: 14c4cd7930244b0fb0af262aba6bedba, State: Running, Role: LEADER
I20260709 13:15:49.390435  7173 raft_consensus.cc:3060] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.391096  7566 consensus_queue.cc:237] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.391957  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:49.390066  7398 leader_election.cc:290] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:49.398741  7173 raft_consensus.cc:2468] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 3.
I20260709 13:15:49.400183  7398 raft_consensus.cc:493] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.400755  7398 raft_consensus.cc:515] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.402002  7065 leader_election.cc:304] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:49.402771  7398 leader_election.cc:290] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:49.402791  7484 raft_consensus.cc:2804] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:49.403519  7484 raft_consensus.cc:697] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 3 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:49.403972  7171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:49.404659  7171 raft_consensus.cc:2410] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e43bc14318064a41861c1d052983ad2e for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:49.404407  7484 consensus_queue.cc:237] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.406342  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c78ab5df95424c3ba291e65d738ce8ae" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:49.407853  7065 leader_election.cc:304] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:49.407605  6997 catalog_manager.cc:5697] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba reported cstate change: term changed from 2 to 3, leader changed from 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2) to 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3). New cstate: current_term: 3 leader_uuid: "14c4cd7930244b0fb0af262aba6bedba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:49.409723  6997 catalog_manager.cc:5789] TS 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961) does not have the latest schema for tablet c78ab5df95424c3ba291e65d738ce8ae (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:49.411561  7484 raft_consensus.cc:2749] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:49.414387  6995 catalog_manager.cc:5697] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 1 to 3, leader changed from 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2) to e43bc14318064a41861c1d052983ad2e (127.26.202.1). New cstate: current_term: 3 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.450088  7566 raft_consensus.cc:493] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74ce1c22402c4b91844372d1b9ba67b3)
I20260709 13:15:49.450855  7566 raft_consensus.cc:515] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.453596  7566 leader_election.cc:290] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:49.454265  7171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:49.454862  7094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28722f0fff74de380cfc72c6ffe04e4" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:49.455125  7171 raft_consensus.cc:2368] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14c4cd7930244b0fb0af262aba6bedba for earlier term 2. Current term is 3.
I20260709 13:15:49.456527  7214 leader_election.cc:400] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 2 pre-election: Vote denied by peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387) with higher term. Message: Invalid argument: T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14c4cd7930244b0fb0af262aba6bedba for earlier term 2. Current term is 3.
I20260709 13:15:49.456825  7214 leader_election.cc:403] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:49.457470  7566 raft_consensus.cc:3060] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.463510  7566 raft_consensus.cc:2749] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387) with higher term. Message: Invalid argument: T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14c4cd7930244b0fb0af262aba6bedba for earlier term 2. Current term is 3.
I20260709 13:15:49.489277 27432 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:49.497654  7094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07"
dest_uuid: "e43bc14318064a41861c1d052983ad2e"
mode: GRACEFUL
new_leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:37988
I20260709 13:15:49.498219  7094 raft_consensus.cc:606] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Received request to transfer leadership to TS 74ce1c22402c4b91844372d1b9ba67b3
I20260709 13:15:49.499573 27432 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:15:49.500052 27432 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:49.505125  7398 raft_consensus.cc:993] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e: : Instructing follower 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:49.505836  7484 raft_consensus.cc:1081] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Signalling peer 74ce1c22402c4b91844372d1b9ba67b3 to start an election
I20260709 13:15:49.507333  7171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07"
dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
 from {username='slave'} at 127.0.0.1:45244
I20260709 13:15:49.507911  7171 raft_consensus.cc:493] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:49.508267  7171 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.513785  7484 raft_consensus.cc:493] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.514453  7484 raft_consensus.cc:515] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.515089  7171 raft_consensus.cc:515] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.517258  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba" is_pre_election: true
I20260709 13:15:49.517535  7171 leader_election.cc:290] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 3 election: Requested vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:49.517715  7094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e43bc14318064a41861c1d052983ad2e"
I20260709 13:15:49.518364  7094 raft_consensus.cc:3055] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:49.518594  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:49.518692  7094 raft_consensus.cc:740] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:49.519338  7173 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 3.
I20260709 13:15:49.516155  7484 leader_election.cc:290] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:49.519639  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d22f892c8479db58f0fb5cc09cc07" candidate_uuid: "74ce1c22402c4b91844372d1b9ba67b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:49.520273  7247 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.519917  7094 consensus_queue.cc:260] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.520388  7065 leader_election.cc:304] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 14c4cd7930244b0fb0af262aba6bedba
I20260709 13:15:49.521258  7484 raft_consensus.cc:2804] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:49.521361  7094 raft_consensus.cc:3060] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.521694  7484 raft_consensus.cc:493] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.522099  7484 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.525833  7247 raft_consensus.cc:2468] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 3.
I20260709 13:15:49.526954  7140 leader_election.cc:304] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14c4cd7930244b0fb0af262aba6bedba, 74ce1c22402c4b91844372d1b9ba67b3; no voters: 
I20260709 13:15:49.527691  7550 raft_consensus.cc:2804] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:49.528848  7550 raft_consensus.cc:697] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 LEADER]: Becoming Leader. State: Replica: 74ce1c22402c4b91844372d1b9ba67b3, State: Running, Role: LEADER
I20260709 13:15:49.529318  7094 raft_consensus.cc:2468] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ce1c22402c4b91844372d1b9ba67b3 in term 3.
I20260709 13:15:49.529850  7550 consensus_queue.cc:237] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.530458  7484 raft_consensus.cc:515] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.531157  7566 raft_consensus.cc:493] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e43bc14318064a41861c1d052983ad2e)
I20260709 13:15:49.531603  7566 raft_consensus.cc:515] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.532209  7484 leader_election.cc:290] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 4 election: Requested vote from peers 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387), 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961)
I20260709 13:15:49.533108  7173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3"
I20260709 13:15:49.533269  7247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "e43bc14318064a41861c1d052983ad2e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "14c4cd7930244b0fb0af262aba6bedba"
I20260709 13:15:49.533644  7566 leader_election.cc:290] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959), 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387)
I20260709 13:15:49.533771  7247 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.534397  7094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e43bc14318064a41861c1d052983ad2e" is_pre_election: true
I20260709 13:15:49.533706  7173 raft_consensus.cc:3060] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.535318  7094 raft_consensus.cc:2368] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14c4cd7930244b0fb0af262aba6bedba for earlier term 3. Current term is 4.
I20260709 13:15:49.536484  7213 leader_election.cc:400] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 pre-election: Vote denied by peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959) with higher term. Message: Invalid argument: T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14c4cd7930244b0fb0af262aba6bedba for earlier term 3. Current term is 4.
I20260709 13:15:49.536787  7213 leader_election.cc:403] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:49.539325  7247 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 4.
I20260709 13:15:49.539844  7566 raft_consensus.cc:2749] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959) with higher term. Message: Invalid argument: T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 14c4cd7930244b0fb0af262aba6bedba for earlier term 3. Current term is 4.
I20260709 13:15:49.540300  7171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6e4f758e694e1281a8cd953df6ac6f" candidate_uuid: "14c4cd7930244b0fb0af262aba6bedba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74ce1c22402c4b91844372d1b9ba67b3" is_pre_election: true
I20260709 13:15:49.540438  7173 raft_consensus.cc:2468] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e43bc14318064a41861c1d052983ad2e in term 4.
I20260709 13:15:49.541980  7065 leader_election.cc:304] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ce1c22402c4b91844372d1b9ba67b3, e43bc14318064a41861c1d052983ad2e; no voters: 
I20260709 13:15:49.543941  7484 raft_consensus.cc:2804] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:49.544507  7484 raft_consensus.cc:697] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 4 LEADER]: Becoming Leader. State: Replica: e43bc14318064a41861c1d052983ad2e, State: Running, Role: LEADER
I20260709 13:15:49.545569  7484 consensus_queue.cc:237] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } }
I20260709 13:15:49.551024  6995 catalog_manager.cc:5697] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 reported cstate change: term changed from 2 to 3, leader changed from e43bc14318064a41861c1d052983ad2e (127.26.202.1) to 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2). New cstate: current_term: 3 leader_uuid: "74ce1c22402c4b91844372d1b9ba67b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.560575  6997 catalog_manager.cc:5697] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e43bc14318064a41861c1d052983ad2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.852862  7173 raft_consensus.cc:1275] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:49.854166  7484 consensus_queue.cc:1048] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.869313  7247 raft_consensus.cc:1275] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:49.871075  7398 consensus_queue.cc:1048] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.955526  7097 raft_consensus.cc:1275] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Refusing update from remote peer 14c4cd7930244b0fb0af262aba6bedba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:49.957120  7566 consensus_queue.cc:1048] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:49.967262  6997 catalog_manager.cc:5789] TS e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959) does not have the latest schema for tablet c78ab5df95424c3ba291e65d738ce8ae (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:49.969595  7171 raft_consensus.cc:1275] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Refusing update from remote peer 14c4cd7930244b0fb0af262aba6bedba: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:49.967286  7585 tablet.cc:1724] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:49.971246  7566 consensus_queue.cc:1048] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:49.974749  6997 catalog_manager.cc:5789] TS 14c4cd7930244b0fb0af262aba6bedba (127.26.202.3:44961) does not have the latest schema for tablet c78ab5df95424c3ba291e65d738ce8ae (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:49.973438  7586 tablet.cc:1724] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:49.979642  6993 catalog_manager.cc:5789] TS e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959) does not have the latest schema for tablet c78ab5df95424c3ba291e65d738ce8ae (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:49.979031  7587 tablet.cc:1724] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:15:49.998189  7247 raft_consensus.cc:1275] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:49.999990  7550 consensus_queue.cc:1048] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.001374  6995 catalog_manager.cc:5789] TS 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387) does not have the latest schema for tablet c78ab5df95424c3ba291e65d738ce8ae (table soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd]). Expected version 1 got 0
I20260709 13:15:50.002779  7587 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:45238 (request call id 18) took 2273 ms. Trace:
I20260709 13:15:50.003824  6993 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0: soft_deleted_table [id=5bcfae13540a4eabbe78add84d435ebd] alter complete (version 1)
I20260709 13:15:50.003376  7587 rpcz_store.cc:276] 0709 13:15:47.729202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.729661 (+   459us) service_pool.cc:224] Handling call
0709 13:15:50.002682 (+2273021us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:47.771084 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 13:15:47.772229 (+  1145us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 13:15:47.772262 (+    33us) alter_schema_op.cc:66] Acquired schema lock
0709 13:15:47.772330 (+    68us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 13:15:47.772442 (+   112us) alter_schema_op.cc:128] START. Timestamp: 1783602947772384
0709 13:15:47.772463 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:15:47.797085 (+ 24622us) log.cc:844] Serialized 204 byte log entry
0709 13:15:47.835614 (+ 38529us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18004a3440. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d29522 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:15:47.874972 (+ 39358us) spinlock_profiling.cc:243] Waited 991 us on lock 0x7b18004a3440. stack: 00007f4a24cf7343 00007f4a24cf7240 00007f4a246861d4 00007f4a2e3c4304 00007f4a2e3c4299 00007f4a2dbf1de1 00007f4a2dbfe5b1 00007f4a24d293f3 00007f4a24d2b7c1 00007f4a24d2b779 00007f4a24d2b709 00007f4a24d2b6d1 00007f4a24d2a9cd 000000000038f354 000000000038f199 00007f4a24d0c83a
0709 13:15:49.975151 (+2100179us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.978872 (+  3721us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 13:15:49.980841 (+  1969us) log.cc:844] Serialized 5 byte log entry
0709 13:15:50.001669 (+ 20828us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:50.002414 (+   745us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.002535 (+   121us) alter_schema_op.cc:73] Released schema lock
0709 13:15:50.002576 (+    41us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3458,"prepare.queue_time_us":37072,"prepare.run_cpu_time_us":11826,"prepare.run_wall_time_us":57160,"raft.queue_time_us":3541,"raft.run_cpu_time_us":2747,"raft.run_wall_time_us":3280,"replication_time_us":2202574,"spinlock_wait_cycles":5516032,"thread_start_us":35485,"threads_started":3,"wal-append.queue_time_us":20848,"wal-append.run_cpu_time_us":1735,"wal-append.run_wall_time_us":1002966}]]}
I20260709 13:15:50.017997  7097 raft_consensus.cc:1275] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Refusing update from remote peer 74ce1c22402c4b91844372d1b9ba67b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:50.020674  7576 consensus_queue.cc:1048] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43bc14318064a41861c1d052983ad2e" member_type: VOTER last_known_addr { host: "127.26.202.1" port: 36959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.052768  7171 raft_consensus.cc:1275] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 4 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:50.054111  7398 consensus_queue.cc:1048] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ce1c22402c4b91844372d1b9ba67b3" member_type: VOTER last_known_addr { host: "127.26.202.2" port: 45387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.063534  7247 raft_consensus.cc:1275] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 4 FOLLOWER]: Refusing update from remote peer e43bc14318064a41861c1d052983ad2e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:50.065725  7398 consensus_queue.cc:1048] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "14c4cd7930244b0fb0af262aba6bedba" member_type: VOTER last_known_addr { host: "127.26.202.3" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.563109 27432 tablet_server.cc:179] TabletServer@127.26.202.1:0 shutting down...
W20260709 13:15:50.588786  7139 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 13:15:50.592706  7139 consensus_peers.cc:597] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 -> Peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Couldn't send request to peer e43bc14318064a41861c1d052983ad2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.600644 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:50.601485 27432 tablet_replica.cc:333] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.602118 27432 raft_consensus.cc:2243] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.602597 27432 raft_consensus.cc:2272] T 8f91d830f34c448abdb1f81dc7d15444 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.604504 27432 tablet_replica.cc:333] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.605212 27432 raft_consensus.cc:2243] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.605692 27432 raft_consensus.cc:2272] T c78ab5df95424c3ba291e65d738ce8ae P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.608239 27432 tablet_replica.cc:333] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.608886 27432 raft_consensus.cc:2243] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.609721 27432 raft_consensus.cc:2272] T c9993f636c9a45ff883a4d3075e649ed P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.611475 27432 tablet_replica.cc:333] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.612071 27432 raft_consensus.cc:2243] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.612874 27432 raft_consensus.cc:2272] T 4e9f4013a84a468d8d55fb2f6d1b83bd P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.615276 27432 tablet_replica.cc:333] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.616012 27432 raft_consensus.cc:2243] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.616556 27432 raft_consensus.cc:2272] T 4aea51e0974e4579ac931b2af6ff0fe0 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:50.616604  7139 consensus_peers.cc:597] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 -> Peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Couldn't send request to peer e43bc14318064a41861c1d052983ad2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.618708 27432 tablet_replica.cc:333] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.619333 27432 raft_consensus.cc:2243] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.620177 27432 raft_consensus.cc:2272] T 333ed386c7554a69978c87513ae1070c P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.622218 27432 tablet_replica.cc:333] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.622777 27432 raft_consensus.cc:2243] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.623286 27432 raft_consensus.cc:2272] T d1bcf63f24784b5499c1b6fef935921f P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.625651 27432 tablet_replica.cc:333] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.626420 27432 raft_consensus.cc:2243] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.627207 27432 raft_consensus.cc:2272] T fc283d09fea74a5696d6b1cb7838e579 P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.629521 27432 tablet_replica.cc:333] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.630282 27432 raft_consensus.cc:2243] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.630825 27432 raft_consensus.cc:2272] T 4f2d22f892c8479db58f0fb5cc09cc07 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.634048 27432 tablet_replica.cc:333] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.634830 27432 raft_consensus.cc:2243] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.635569 27432 raft_consensus.cc:2272] T e28722f0fff74de380cfc72c6ffe04e4 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.637933 27432 tablet_replica.cc:333] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.638516 27432 raft_consensus.cc:2243] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.638931 27432 raft_consensus.cc:2272] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.640969 27432 tablet_replica.cc:333] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.641471 27432 raft_consensus.cc:2243] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.642145 27432 raft_consensus.cc:2272] T 1c6e4f758e694e1281a8cd953df6ac6f P e43bc14318064a41861c1d052983ad2e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.644358 27432 tablet_replica.cc:333] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.644857 27432 raft_consensus.cc:2243] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.645314 27432 raft_consensus.cc:2272] T c652b53f69344c3da288ee8f6da3a147 P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.647328 27432 tablet_replica.cc:333] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.647836 27432 raft_consensus.cc:2243] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.648617 27432 raft_consensus.cc:2272] T 5227f43a1f3447dea8246822131481cd P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.650429 27432 tablet_replica.cc:333] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.650974 27432 raft_consensus.cc:2243] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.651750 27432 raft_consensus.cc:2272] T dfea64d5bd1e4237a3c3910a02e7532e P e43bc14318064a41861c1d052983ad2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.653888 27432 tablet_replica.cc:333] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.654433 27432 raft_consensus.cc:2243] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.654860 27432 raft_consensus.cc:2272] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.656824 27432 tablet_replica.cc:333] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.657332 27432 raft_consensus.cc:2243] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.657836 27432 raft_consensus.cc:2272] T 9c7374b52bef457387ca7baaaeb0c05d P e43bc14318064a41861c1d052983ad2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.660415 27432 tablet_replica.cc:333] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e: stopping tablet replica
I20260709 13:15:50.661234 27432 raft_consensus.cc:2243] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.661661 27432 raft_consensus.cc:2272] T 69f955f19cbc40f7a28d0309253d013d P e43bc14318064a41861c1d052983ad2e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:50.663334  7213 consensus_peers.cc:597] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba -> Peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Couldn't send request to peer e43bc14318064a41861c1d052983ad2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:50.678766  7139 consensus_peers.cc:597] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 -> Peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Couldn't send request to peer e43bc14318064a41861c1d052983ad2e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.703732 27432 tablet_server.cc:196] TabletServer@127.26.202.1:0 shutdown complete.
I20260709 13:15:50.737615 27432 tablet_server.cc:179] TabletServer@127.26.202.2:0 shutting down...
W20260709 13:15:50.759883  7213 consensus_peers.cc:597] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba -> Peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Couldn't send request to peer e43bc14318064a41861c1d052983ad2e. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.778311 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:50.779335 27432 tablet_replica.cc:333] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.780033 27432 raft_consensus.cc:2243] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.780570 27432 raft_consensus.cc:2272] T c9993f636c9a45ff883a4d3075e649ed P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.782785 27432 tablet_replica.cc:333] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.783442 27432 raft_consensus.cc:2243] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.783944 27432 raft_consensus.cc:2272] T 333ed386c7554a69978c87513ae1070c P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.786011 27432 tablet_replica.cc:333] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.786597 27432 raft_consensus.cc:2243] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.787456 27432 raft_consensus.cc:2272] T 4aea51e0974e4579ac931b2af6ff0fe0 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.789605 27432 tablet_replica.cc:333] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.790222 27432 raft_consensus.cc:2243] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.790709 27432 raft_consensus.cc:2272] T 8f91d830f34c448abdb1f81dc7d15444 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.792707 27432 tablet_replica.cc:333] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.793392 27432 raft_consensus.cc:2243] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.793887 27432 raft_consensus.cc:2272] T c78ab5df95424c3ba291e65d738ce8ae P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.796622 27432 tablet_replica.cc:333] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.797331 27432 raft_consensus.cc:2243] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.797920 27432 raft_consensus.cc:2272] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.799762 27432 tablet_replica.cc:333] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.800282 27432 raft_consensus.cc:2243] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.801223 27432 raft_consensus.cc:2272] T d1bcf63f24784b5499c1b6fef935921f P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.803483 27432 tablet_replica.cc:333] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.804062 27432 raft_consensus.cc:2243] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.804512 27432 raft_consensus.cc:2272] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.806648 27432 tablet_replica.cc:333] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.807219 27432 raft_consensus.cc:2243] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.808069 27432 raft_consensus.cc:2272] T 9c7374b52bef457387ca7baaaeb0c05d P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.810200 27432 tablet_replica.cc:333] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.810767 27432 raft_consensus.cc:2243] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.811264 27432 raft_consensus.cc:2272] T c652b53f69344c3da288ee8f6da3a147 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.813479 27432 tablet_replica.cc:333] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.814137 27432 raft_consensus.cc:2243] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.814662 27432 raft_consensus.cc:2272] T 5227f43a1f3447dea8246822131481cd P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.816738 27432 tablet_replica.cc:333] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.817306 27432 raft_consensus.cc:2243] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.817736 27432 raft_consensus.cc:2272] T dfea64d5bd1e4237a3c3910a02e7532e P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.819727 27432 tablet_replica.cc:333] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.820251 27432 raft_consensus.cc:2243] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.821082 27432 raft_consensus.cc:2272] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 74ce1c22402c4b91844372d1b9ba67b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.823041 27432 tablet_replica.cc:333] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.823561 27432 raft_consensus.cc:2243] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.823977 27432 raft_consensus.cc:2272] T e28722f0fff74de380cfc72c6ffe04e4 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.827209 27432 tablet_replica.cc:333] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.827970 27432 raft_consensus.cc:2243] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.828442 27432 raft_consensus.cc:2272] T 1c6e4f758e694e1281a8cd953df6ac6f P 74ce1c22402c4b91844372d1b9ba67b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.831256 27432 tablet_replica.cc:333] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.831920 27432 raft_consensus.cc:2243] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.832448 27432 raft_consensus.cc:2272] T 69f955f19cbc40f7a28d0309253d013d P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.834730 27432 tablet_replica.cc:333] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.835279 27432 raft_consensus.cc:2243] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.835754 27432 raft_consensus.cc:2272] T fc283d09fea74a5696d6b1cb7838e579 P 74ce1c22402c4b91844372d1b9ba67b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.837782 27432 tablet_replica.cc:333] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3: stopping tablet replica
I20260709 13:15:50.838322 27432 raft_consensus.cc:2243] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.839143 27432 raft_consensus.cc:2272] T 4f2d22f892c8479db58f0fb5cc09cc07 P 74ce1c22402c4b91844372d1b9ba67b3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:50.873867  7214 consensus_peers.cc:597] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba -> Peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387): Couldn't send request to peer 74ce1c22402c4b91844372d1b9ba67b3. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:45387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:50.875443  7213 consensus_peers.cc:597] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba -> Peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Couldn't send request to peer e43bc14318064a41861c1d052983ad2e. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.881146 27432 tablet_server.cc:196] TabletServer@127.26.202.2:0 shutdown complete.
W20260709 13:15:50.896868  7214 consensus_peers.cc:597] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba -> Peer 74ce1c22402c4b91844372d1b9ba67b3 (127.26.202.2:45387): Couldn't send request to peer 74ce1c22402c4b91844372d1b9ba67b3. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.2:45387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.916198 27432 tablet_server.cc:179] TabletServer@127.26.202.3:0 shutting down...
W20260709 13:15:50.923767  7213 consensus_peers.cc:597] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba -> Peer e43bc14318064a41861c1d052983ad2e (127.26.202.1:36959): Couldn't send request to peer e43bc14318064a41861c1d052983ad2e. Status: Network error: Client connection negotiation failed: client connection to 127.26.202.1:36959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:50.950158 27432 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:50.951133 27432 tablet_replica.cc:333] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.951967 27432 raft_consensus.cc:2243] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.952858 27432 raft_consensus.cc:2272] T 8f91d830f34c448abdb1f81dc7d15444 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.954902 27432 tablet_replica.cc:333] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.955502 27432 raft_consensus.cc:2243] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.955945 27432 raft_consensus.cc:2272] T 333ed386c7554a69978c87513ae1070c P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.957971 27432 tablet_replica.cc:333] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.958557 27432 raft_consensus.cc:2243] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.959059 27432 raft_consensus.cc:2272] T 4aea51e0974e4579ac931b2af6ff0fe0 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.960829 27432 tablet_replica.cc:333] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.961390 27432 raft_consensus.cc:2243] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.961841 27432 raft_consensus.cc:2272] T 4e9f4013a84a468d8d55fb2f6d1b83bd P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.963627 27432 tablet_replica.cc:333] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.964174 27432 raft_consensus.cc:2243] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.964927 27432 raft_consensus.cc:2272] T c78ab5df95424c3ba291e65d738ce8ae P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.967139 27432 tablet_replica.cc:333] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.967706 27432 raft_consensus.cc:2243] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.968153 27432 raft_consensus.cc:2272] T c9993f636c9a45ff883a4d3075e649ed P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.970012 27432 tablet_replica.cc:333] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.970544 27432 raft_consensus.cc:2243] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.970960 27432 raft_consensus.cc:2272] T d1bcf63f24784b5499c1b6fef935921f P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.972680 27432 tablet_replica.cc:333] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.973285 27432 raft_consensus.cc:2243] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.973738 27432 raft_consensus.cc:2272] T 4f2d22f892c8479db58f0fb5cc09cc07 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.976608 27432 tablet_replica.cc:333] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.977221 27432 raft_consensus.cc:2243] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.977667 27432 raft_consensus.cc:2272] T fc283d09fea74a5696d6b1cb7838e579 P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.979465 27432 tablet_replica.cc:333] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.980001 27432 raft_consensus.cc:2243] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.980432 27432 raft_consensus.cc:2272] T 9c7374b52bef457387ca7baaaeb0c05d P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.982524 27432 tablet_replica.cc:333] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.983035 27432 raft_consensus.cc:2243] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.983458 27432 raft_consensus.cc:2272] T e28722f0fff74de380cfc72c6ffe04e4 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.985354 27432 tablet_replica.cc:333] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.985829 27432 raft_consensus.cc:2243] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.986258 27432 raft_consensus.cc:2272] T 72d4ae8c7a0d4fcd8772e0507f3cbf33 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.988188 27432 tablet_replica.cc:333] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.988696 27432 raft_consensus.cc:2243] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.989171 27432 raft_consensus.cc:2272] T 1c6e4f758e694e1281a8cd953df6ac6f P 14c4cd7930244b0fb0af262aba6bedba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.991526 27432 tablet_replica.cc:333] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.992090 27432 raft_consensus.cc:2243] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.992861 27432 raft_consensus.cc:2272] T 6fa8aa2a6d2a4932933904a51ae6b0e2 P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.994938 27432 tablet_replica.cc:333] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.995492 27432 raft_consensus.cc:2243] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.995960 27432 raft_consensus.cc:2272] T 5227f43a1f3447dea8246822131481cd P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.997885 27432 tablet_replica.cc:333] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:50.998422 27432 raft_consensus.cc:2243] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:50.999275 27432 raft_consensus.cc:2272] T c652b53f69344c3da288ee8f6da3a147 P 14c4cd7930244b0fb0af262aba6bedba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:51.001464 27432 tablet_replica.cc:333] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:51.002000 27432 raft_consensus.cc:2243] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:51.002803 27432 raft_consensus.cc:2272] T 69f955f19cbc40f7a28d0309253d013d P 14c4cd7930244b0fb0af262aba6bedba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:51.004936 27432 tablet_replica.cc:333] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba: stopping tablet replica
I20260709 13:15:51.005481 27432 raft_consensus.cc:2243] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:51.005934 27432 raft_consensus.cc:2272] T dfea64d5bd1e4237a3c3910a02e7532e P 14c4cd7930244b0fb0af262aba6bedba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:51.045346 27432 tablet_server.cc:196] TabletServer@127.26.202.3:0 shutdown complete.
I20260709 13:15:51.075614 27432 master.cc:562] Master@127.26.202.62:45955 shutting down...
I20260709 13:15:51.100672 27432 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:51.101261 27432 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:51.101568 27432 tablet_replica.cc:333] T 00000000000000000000000000000000 P 21d60a52cd0042fa960a68a28ad137d0: stopping tablet replica
I20260709 13:15:51.148355 27432 master.cc:584] Master@127.26.202.62:45955 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (15173 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (31327 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (350618 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:15:51.208935 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5107: suppressed but not reported on 4 messages since previous log ~3 seconds ago
I20260709 13:15:51.209559 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 510 messages since previous log ~21 seconds ago
I20260709 13:15:51.209766 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 509 messages since previous log ~21 seconds ago
I20260709 13:15:51.209987 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 503 messages since previous log ~21 seconds ago
I20260709 13:15:51.210247 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~39 seconds ago
I20260709 13:15:51.210454 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~39 seconds ago
I20260709 13:15:51.210655 27432 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~217 seconds ago
I20260709 13:15:51.210875 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~217 seconds ago
I20260709 13:15:51.211134 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 4 messages since previous log ~283 seconds ago
I20260709 13:15:51.211477 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 13:15:51.211830 27432 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~13 seconds ago
